-- Logs begin at Thu 2022-05-26 15:42:19 UTC, end at Thu 2022-05-26 17:11:26 UTC. -- May 26 16:27:38.175585 dv-cinder-836070-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 26 16:27:38.188946 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 26 16:27:38.192022 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 16:27:38 2022] *** May 26 16:27:38.192022 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 16:27:38.192022 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 16:27:38.192022 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: nodename: dv-cinder-836070-4-iscsi May 26 16:27:38.192022 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: machine: x86_64 May 26 16:27:38.192022 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: clock source: unix May 26 16:27:38.192022 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: pcre jit disabled May 26 16:27:38.192022 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: detected number of CPU cores: 4 May 26 16:27:38.192022 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: current working directory: / May 26 16:27:38.192022 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: detected binary path: /usr/bin/uwsgi-core May 26 16:27:38.192022 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: your processes number limit is 47680 May 26 16:27:38.192022 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: your memory page size is 4096 bytes May 26 16:27:38.192022 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: detected max file descriptor number: 2048 May 26 16:27:38.192022 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: lock engine: pthread robust mutexes May 26 16:27:38.193543 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: thunder lock: enabled May 26 16:27:38.193543 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 26 16:27:38.193543 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 16:27:38.238869 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: Python main interpreter initialized at 0x55562d61d9c0 May 26 16:27:38.238869 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: python threads support enabled May 26 16:27:38.238869 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: your server socket listen backlog is limited to 100 connections May 26 16:27:38.238869 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: your mercy for graceful operations on workers is 90 seconds May 26 16:27:38.239275 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: mapped 403077 bytes (393 KB) for 2 cores May 26 16:27:38.239362 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: *** Operational MODE: preforking *** May 26 16:27:38.239594 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: *** uWSGI is running in multiple interpreter mode *** May 26 16:27:38.239594 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: spawned uWSGI master process (pid: 80484) May 26 16:27:38.239814 dv-cinder-836070-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 26 16:27:38.241012 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: spawned uWSGI worker 1 (pid: 80497, cores: 1) May 26 16:27:38.241012 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: spawned uWSGI worker 2 (pid: 80498, cores: 1) May 26 16:27:38.241012 dv-cinder-836070-4-iscsi devstack@keystone.service[80484]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 16:27:44.230788 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:27:44.230788 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: from cryptography.utils import int_from_bytes May 26 16:27:44.231577 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:27:44.231577 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: from cryptography.utils import int_from_bytes May 26 16:27:44.281842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 16:27:44.282025 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 16:27:44.282216 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] command line args: [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 16:27:44.282479 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 16:27:44.282656 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ================================================================================ {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 16:27:44.282909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] admin_token = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.283160 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] config_dir = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.283348 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.283530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] config_source = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.283710 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] debug = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.283912 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.284401 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.284500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.284706 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.284959 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.285188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.285394 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] log_config_append = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.285589 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.285760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] log_dir = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.285933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] log_file = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.286169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.286417 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.286664 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.286912 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.287097 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.287264 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.287510 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.287769 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.288546 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.288768 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.289014 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.289234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.289505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.289766 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.290034 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.290553 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.290735 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] publish_errors = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.290972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.291204 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.291382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.291630 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.291871 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.292109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] standard_threads = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.292340 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.292585 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.292771 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.292954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] use_journal = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.293170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] use_json = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.293398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] use_stderr = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.293595 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] use_syslog = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.293708 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.294125 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.294566 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.294955 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.295212 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.295471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.295717 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.295972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.296230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.296475 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.296724 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.296979 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.297217 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.297494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.297735 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.297984 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.298233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.298471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.298731 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.298988 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.299237 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.299476 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.299730 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.299999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.300253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.300505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.300739 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.300972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.301205 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.301470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.301723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.301975 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.302208 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.302441 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.302690 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.302939 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.303178 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.303432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.304250 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.304495 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.304735 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.305065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.305503 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.305920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.306346 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.306776 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.307049 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.307292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.307537 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.307775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.308020 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.308266 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.308522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.308757 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.308998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.309239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.309504 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.309744 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.309984 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.310217 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.310512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.310872 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.311310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.311696 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.312149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.312559 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.312960 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.313388 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.313780 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.314931 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.314931 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.314931 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.314931 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.315502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.315502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.315771 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.315907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.316115 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.316358 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.316605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.316847 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.317088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.317356 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.317602 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.317843 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.318113 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.318387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.318642 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.318788 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:27:44.318788 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: from cryptography.utils import int_from_bytes May 26 16:27:44.319475 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.319624 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:27:44.319624 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: from cryptography.utils import int_from_bytes May 26 16:27:44.319882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.319882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.319882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.319882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.320391 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.320391 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.320658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.320853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.321117 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.321585 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.322021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.322441 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.322698 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.322967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.323240 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.323490 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.323734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.external = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.323973 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.324278 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.324517 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.324751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.password = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.324991 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.token = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.326275 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.326275 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.326275 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.326275 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.326275 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.327091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.327091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.327091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.327541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.327541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.327826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.328242 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.328689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.329130 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.329653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.330124 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.330567 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.331140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.331515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.331785 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.332066 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.332320 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.332590 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.332837 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.333083 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.333361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.333626 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.333862 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.334117 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.334363 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.334622 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.335402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.335666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.335908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.336161 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.336405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.336658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.336908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.337148 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.337585 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.338775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.338775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.340819 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.340819 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.340819 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.340819 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.340819 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.340819 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.341882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.341882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.341882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.342204 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.342471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.342883 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.343248 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.343703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.344152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.344602 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.345059 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.345538 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.345997 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.346435 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.346819 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.347422 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.347796 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.348168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.348529 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.348904 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.349290 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.349653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.350012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.350363 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.350811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.351175 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.351534 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.351886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.352234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.352603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.352966 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.353329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.353680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.354153 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.354518 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.355055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.355476 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.355896 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.356270 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.356667 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.357154 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.357514 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.357877 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.358237 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.358597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.358941 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.359272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.359611 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.359953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.360294 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.360628 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.361007 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.361404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.361775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.362142 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.362501 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.362841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.363303 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.363746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.364190 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.364627 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.369199 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.369199 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.369199 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.369199 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.369199 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.369199 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.369199 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.369199 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.370165 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 16:27:44.370165 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 16:27:44.370390 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.370504 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] command line args: [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 16:27:44.370646 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.370834 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 16:27:44.370834 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ================================================================================ {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 16:27:44.371155 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.371288 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] admin_token = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.371456 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.371638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] config_dir = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.371638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.371880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.371994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] config_source = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.371994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] debug = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.372207 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.372329 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.372329 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.372593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.372708 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.372820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.372933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.373054 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.373168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.373298 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.373414 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.373414 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] log_config_append = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.373625 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.373755 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.373755 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] log_dir = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.373969 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.374089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] log_file = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.374089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.374310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.374430 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.374544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.374656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.374656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.374938 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.375045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.375045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.375234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.375338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.375440 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] role.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.375536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.375536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.375712 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] role.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.375815 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.375912 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.376013 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.376013 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.376194 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.376290 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.376394 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.376499 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.376499 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.376676 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.376676 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.376851 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.376851 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] publish_errors = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.377122 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.377219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.377353 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.384467 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.384467 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.384669 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.384730 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.384730 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.384847 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.384961 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] standard_threads = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.385042 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.385113 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.385113 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.385235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.385327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.385327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] use_journal = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.385470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.385541 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] use_json = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.385541 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] use_stderr = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.385676 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.385747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] use_syslog = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.385747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:27:44.385888 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.385960 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.385960 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.386081 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.386151 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.386229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.386305 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.386305 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.386435 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.386514 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.386514 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.386648 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.386721 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.386797 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.386868 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.386868 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.387013 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.387086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.387157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.387234 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.387234 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.387366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.387445 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.387445 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.387573 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.387643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.387643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.387764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.387849 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.387849 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.387990 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.388061 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.388131 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.388200 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.388200 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.388336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.388406 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.388406 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.388527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.388596 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.388674 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.388746 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.388746 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.388867 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.388937 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.389006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.389091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.389091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.389215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.389323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.389397 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.389467 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.389467 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.389609 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.389679 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.389748 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.389818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.389818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.389951 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.390022 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.390093 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.390161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.390161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.390287 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.390365 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.390365 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.390549 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.390625 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.390692 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.390757 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.390757 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.390979 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.391056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.391155 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.391279 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.391279 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.391496 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.391604 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.391604 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.391813 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.391935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.392043 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.392163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.392279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.392361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.392433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.392504 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.392574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.392655 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.392728 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.392799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.392869 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.392940 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.392940 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.393077 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.393145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.393215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.connection = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.393371 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.393463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.393624 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.393708 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.393863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.393945 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.394105 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.394186 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.394344 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.394436 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.394601 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.394681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.394837 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.394916 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.395067 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.395145 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.395304 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.395384 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.395541 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.395620 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.395810 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.395887 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.396047 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.396126 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.396300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.396399 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.396539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.396620 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.396778 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.396856 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.397011 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.397088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.397244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.397859 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.398027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.398107 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.398205 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 16:27:44.398415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.398500 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.398720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.398957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.399194 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.399431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.399665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.399901 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.400166 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.400409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.400654 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.400890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.401131 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.401394 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.401632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.401867 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.402099 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.402351 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.402562 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.402798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.403026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.403266 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.403513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.403766 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.404002 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.404261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.404523 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.404765 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.404996 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.external = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.405227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.405908 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.405908 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.406190 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.password = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.406281 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.token = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.406543 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.410828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.410828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.410828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.410828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.410828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.410828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.410828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.410828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.410828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.411697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.411697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.411697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.411697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.411697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.411697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.411697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.412305 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.412305 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.412305 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.412606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.412936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.413306 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.413616 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.414086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.414465 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.414915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.415289 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.421431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.421431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.421431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.421431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.421431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.421431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.421431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.421431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.421431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.422026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.422026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.422026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.422026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.422026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.422026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.422026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.422026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.422026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.422603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.422603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.422603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.422603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.422603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.422603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.422603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.422603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.422603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.423078 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.423078 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.423078 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.423078 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.423282 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.423378 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.423837 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.423837 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.424132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.424304 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.424551 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.424787 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.425033 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.425293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.425528 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.425765 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.425994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.426229 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.426464 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.426708 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.426945 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.427185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.427433 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.427680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.427910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.428139 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.428384 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.429159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.429430 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.429668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.429904 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.430132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.430374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.430635 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.430866 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.430947 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.431112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.431203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.431355 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.431439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.431599 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.431833 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.432061 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.432296 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.432529 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.432764 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.432992 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.433237 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.433504 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.433762 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.434023 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.434270 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.434558 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.434888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.435001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.435415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.435415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.435826 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.435929 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.436135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.436365 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.436620 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.436848 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.437095 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.437599 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.437599 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.438279 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.438279 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.438685 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.438881 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.439222 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.439653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.439981 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.440348 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.440574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.440773 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.441131 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.441541 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.441901 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.442264 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.442625 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.442981 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.443332 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] role.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.443693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] role.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.444038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.444469 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.444954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.445363 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.445735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.446103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.446470 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.446849 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.447216 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.447634 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.447995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.448355 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.448715 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.449082 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.449662 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.450007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.450365 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.450708 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.451052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.452548 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.452548 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.452548 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.452548 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.452548 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.453119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.453119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.453119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.453630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.453630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.453850 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.454047 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.454285 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.454785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.454785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] token.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.455033 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.455215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.457952 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.457952 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.457952 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.457952 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.457952 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.457952 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.457952 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.457952 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.457952 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.458964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.458964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.458964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.458964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.458964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.458964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.459597 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.connection = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.459597 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.459597 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.460469 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.460585 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.460741 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.460978 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.461214 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.461478 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.461726 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.461960 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.462204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.462441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.462690 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.462925 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.463168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.463400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.463639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.463872 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:27:44.464044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 16:27:44.474278 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.474533 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.492419 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.492725 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.492924 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.504495 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.524699 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.525008 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.534300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.574535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.593517 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.593902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.612893 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.613186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.665949 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.666219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.666348 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.666474 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.666623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.666746 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.666867 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.666986 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.667104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.667221 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.667354 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.667354 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.691532 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.691787 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.691928 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.692067 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.692187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.692304 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.692421 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.692536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.692662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.692779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.692894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.693011 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.693127 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.693127 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.705330 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.705595 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.718122 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.718436 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.718601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.718801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.719032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.719164 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.719285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.719402 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.719529 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.719646 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.719762 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.719877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.719992 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.719992 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:27:44.739744 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.740002 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 16:27:44.740271 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.740395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.740521 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 16:27:44.740663 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 16:27:44.740783 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.740899 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.741014 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.741753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 16:27:44.741888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.742007 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.742123 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.742238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.742412 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.742671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.753105 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.753408 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.753670 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.753843 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.753967 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.754133 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.754402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.754686 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.762225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.763037 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.765566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.765841 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.766116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.766392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.766526 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.766650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.766783 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.766905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.767025 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.767213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.767337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.767496 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.767623 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.767743 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.767862 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.768010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.768135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.768264 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.768409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.768683 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.768958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.769225 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.795224 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.796715 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.797053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.797359 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.798553 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.798838 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.802642 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.802917 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.803192 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.804720 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.804996 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.805295 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.810994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.811275 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.812653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.812941 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.815734 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.816136 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.816411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.816687 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.816957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.817228 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.817505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.817630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.817785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.817918 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.818186 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.818472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.818750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.819028 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.819335 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.819607 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.838937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.839233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.844016 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.847382 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.847826 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.847972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.848275 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.854051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.856786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.857813 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.861664 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.861967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.862256 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.862450 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.862587 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.862809 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.862933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.863088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.871345 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.875066 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.878889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.879284 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.879457 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.879726 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.880003 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.880278 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.883022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.883321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.883592 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.883855 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.892092 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.893863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.894139 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.897218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.897557 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.897837 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.898118 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.898397 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.899455 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.899758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.902405 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.902405 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.909058 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.910805 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.911069 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.912363 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.912662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.913526 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.913821 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.914106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.914410 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.914665 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.914796 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.915067 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.915352 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.915627 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.915893 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.930230 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.930517 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.930793 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.931064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.931343 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.931618 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.931885 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.933594 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.936932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.940317 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.941968 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.943599 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.943890 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.944206 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.949955 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.951677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.953235 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.953400 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.956559 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.956708 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.956991 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.957295 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.957574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.958175 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.959806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.960087 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.960369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.966954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.967245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.967637 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.967785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.969412 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.973034 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.973361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.973633 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.973899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.976544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.976838 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.977122 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.977426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.977703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.978029 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.978337 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.978696 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.978977 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.979249 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.979527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.979789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.980060 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.980317 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.983873 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.984171 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.984578 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.993165 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:27:44.993475 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.993751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.994020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.994290 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.994553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.994822 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.995083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.995362 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.995630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.995891 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.996144 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.996399 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:44.996655 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:27:45.020236 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55562d61d9c0 pid: 80498 (default app) May 26 16:27:45.023730 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9245ff-7120-4325-9afe-6ba0ee3239dc None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:45.024125 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9245ff-7120-4325-9afe-6ba0ee3239dc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:45.024502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9245ff-7120-4325-9afe-6ba0ee3239dc None None] PATH_INFO: `/v3` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:45.029074 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Thu May 26 16:27:45 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:45.035751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55562d61d9c0 pid: 80497 (default app) May 26 16:27:54.212701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0739e-6610-45bf-a18e-99017e070fd7 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:54.213208 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0739e-6610-45bf-a18e-99017e070fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:54.213353 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0739e-6610-45bf-a18e-99017e070fd7 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:54.214659 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:27:54.222521 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e9dda-0c72-465d-982d-ed139a773f11 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:54.223041 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e9dda-0c72-465d-982d-ed139a773f11 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:54.223125 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e9dda-0c72-465d-982d-ed139a773f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:54.292384 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: INFO dbcounter [None req-1f5e9dda-0c72-465d-982d-ed139a773f11 None None] Registered counter for database keystone May 26 16:27:54.314416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG oslo_db.sqlalchemy.engines [None req-1f5e9dda-0c72-465d-982d-ed139a773f11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:27:54.321343 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writer thread running {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:27:54.503051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG passlib.handlers.bcrypt [None req-1f5e9dda-0c72-465d-982d-ed139a773f11 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80497) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 16:27:54.503484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG passlib.handlers.bcrypt [None req-1f5e9dda-0c72-465d-982d-ed139a773f11 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80497) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 16:27:54.560943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1f5e9dda-0c72-465d-982d-ed139a773f11 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:54.562586 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1f5e9dda-0c72-465d-982d-ed139a773f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:54.746919 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1/3] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:27:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 528 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 16:27:54.938837 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0739e-6610-45bf-a18e-99017e070fd7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:55.009181 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: INFO dbcounter [None req-27f0739e-6610-45bf-a18e-99017e070fd7 None None] Registered counter for database keystone May 26 16:27:55.028773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG oslo_db.sqlalchemy.engines [None req-27f0739e-6610-45bf-a18e-99017e070fd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:27:55.035221 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writer thread running {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:27:55.158557 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0739e-6610-45bf-a18e-99017e070fd7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:55.162792 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40632295-6955-4b31-88b3-dd265faa19e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:55.163512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632295-6955-4b31-88b3-dd265faa19e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:55.163795 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632295-6955-4b31-88b3-dd265faa19e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:55.164147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632295-6955-4b31-88b3-dd265faa19e3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:55.172909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40632295-6955-4b31-88b3-dd265faa19e3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:55.228565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: WARNING keystone.common.rbac_enforcer.enforcer [None req-40632295-6955-4b31-88b3-dd265faa19e3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 16:27:55.229158 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40632295-6955-4b31-88b3-dd265faa19e3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:55.239604 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 3/4] 10.222.0.48 () {58 vars in 1324 bytes} [Thu May 26 16:27:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:27:55.246534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e9dda-0c72-465d-982d-ed139a773f11 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:55.261202 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e9dda-0c72-465d-982d-ed139a773f11 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:55.265606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4fbfa-e770-4567-acaa-0fd6af0e6d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:55.266758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4fbfa-e770-4567-acaa-0fd6af0e6d9b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:55.267038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4fbfa-e770-4567-acaa-0fd6af0e6d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:55.267314 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4fbfa-e770-4567-acaa-0fd6af0e6d9b admin admin] PATH_INFO: `/v3/projects/76a4e041bd164458a5b1a262dc443e9c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:55.268921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4fbfa-e770-4567-acaa-0fd6af0e6d9b admin admin] RBAC: Authorizing `identity:get_project(project_id=76a4e041bd164458a5b1a262dc443e9c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:55.323437 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c4a4fbfa-e770-4567-acaa-0fd6af0e6d9b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 16:27:55.323773 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4fbfa-e770-4567-acaa-0fd6af0e6d9b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:55.328536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 2/5] 10.222.0.48 () {56 vars in 1207 bytes} [Thu May 26 16:27:55 2022] GET /identity/v3/projects/76a4e041bd164458a5b1a262dc443e9c => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:57.549886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfb0f5-330a-4486-b836-374b31133d27 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:57.550401 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfb0f5-330a-4486-b836-374b31133d27 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:57.550491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfb0f5-330a-4486-b836-374b31133d27 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:57.554516 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 4/6] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:27:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:27:57.560415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe698b8-7372-4f4a-8416-2a8dc01693e0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:57.560838 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe698b8-7372-4f4a-8416-2a8dc01693e0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:57.560968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe698b8-7372-4f4a-8416-2a8dc01693e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:57.579920 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2fe698b8-7372-4f4a-8416-2a8dc01693e0 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:57.581455 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2fe698b8-7372-4f4a-8416-2a8dc01693e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:57.589933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 3/7] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:27:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 16:27:57.612551 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfb0f5-330a-4486-b836-374b31133d27 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:57.624858 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfb0f5-330a-4486-b836-374b31133d27 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:57.629142 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cccf88-23eb-4719-ac77-1d7a7b75b319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:57.629808 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cccf88-23eb-4719-ac77-1d7a7b75b319 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:57.630088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cccf88-23eb-4719-ac77-1d7a7b75b319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:57.630387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cccf88-23eb-4719-ac77-1d7a7b75b319 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:57.638902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cccf88-23eb-4719-ac77-1d7a7b75b319 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:57.640674 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cccf88-23eb-4719-ac77-1d7a7b75b319 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:57.650042 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 5/8] 10.222.0.48 () {58 vars in 1324 bytes} [Thu May 26 16:27:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:27:57.655628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe698b8-7372-4f4a-8416-2a8dc01693e0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:57.664763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe698b8-7372-4f4a-8416-2a8dc01693e0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:57.669132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0340443-4ed6-4dc0-a64d-293e3b9e079f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:57.670050 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0340443-4ed6-4dc0-a64d-293e3b9e079f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:57.676683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0340443-4ed6-4dc0-a64d-293e3b9e079f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:57.676683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0340443-4ed6-4dc0-a64d-293e3b9e079f admin admin] PATH_INFO: `/v3/users/ea68495bc01f41d2b0c2e34799485fee` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:57.676683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0340443-4ed6-4dc0-a64d-293e3b9e079f admin admin] RBAC: Authorizing `identity:get_user(user_id=ea68495bc01f41d2b0c2e34799485fee)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:57.676683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0340443-4ed6-4dc0-a64d-293e3b9e079f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:57.676683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 4/9] 10.222.0.48 () {56 vars in 1198 bytes} [Thu May 26 16:27:57 2022] GET /identity/v3/users/ea68495bc01f41d2b0c2e34799485fee => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:59.967820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32517c3-e930-486d-a0f0-c419387295c6 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:59.968343 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32517c3-e930-486d-a0f0-c419387295c6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:59.968425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32517c3-e930-486d-a0f0-c419387295c6 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:59.969756 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:27:59.975589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc87053-2468-4c2a-9929-6e3365bba4ac None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:59.975993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc87053-2468-4c2a-9929-6e3365bba4ac None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:59.976154 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc87053-2468-4c2a-9929-6e3365bba4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:59.993380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dbc87053-2468-4c2a-9929-6e3365bba4ac None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:59.995406 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dbc87053-2468-4c2a-9929-6e3365bba4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:00.032137 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320b3ac-8070-46c6-bac0-44ea0a167265 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:00.032413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320b3ac-8070-46c6-bac0-44ea0a167265 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:00.032689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320b3ac-8070-46c6-bac0-44ea0a167265 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:00.034108 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 7/11] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:28:00.040309 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59458fa-d330-4f32-ba5f-4c9aa2fa10ab None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:00.040741 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59458fa-d330-4f32-ba5f-4c9aa2fa10ab None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:00.041101 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59458fa-d330-4f32-ba5f-4c9aa2fa10ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:00.084825 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG passlib.handlers.bcrypt [None req-a59458fa-d330-4f32-ba5f-4c9aa2fa10ab None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80498) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 16:28:00.085246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG passlib.handlers.bcrypt [None req-a59458fa-d330-4f32-ba5f-4c9aa2fa10ab None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80498) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 16:28:00.092059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 5/12] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:00.116220 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc87053-2468-4c2a-9929-6e3365bba4ac None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:00.132482 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a59458fa-d330-4f32-ba5f-4c9aa2fa10ab None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:00.134130 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a59458fa-d330-4f32-ba5f-4c9aa2fa10ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:00.141412 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:00.224627 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc87053-2468-4c2a-9929-6e3365bba4ac None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:00.241751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 8/13] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:00.266574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59458fa-d330-4f32-ba5f-4c9aa2fa10ab None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:00.382336 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fc4c8-f5ea-487b-ab56-94b94b64cc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:00.383167 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fc4c8-f5ea-487b-ab56-94b94b64cc35 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:00.383444 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fc4c8-f5ea-487b-ab56-94b94b64cc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:00.383719 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fc4c8-f5ea-487b-ab56-94b94b64cc35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:00.400204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fc4c8-f5ea-487b-ab56-94b94b64cc35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:00.412030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-119fc4c8-f5ea-487b-ab56-94b94b64cc35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:00.412030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:00.412030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:00.412030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:00.412030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:00.412030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:00.412030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:00.412030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:00.412030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:00.412030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:00.412030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:00.412030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:00.412030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:00.412030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:00.412030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:00.412030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:00.413583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:00.413583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:00.413583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:00.413583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:00.413583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:00.413583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:00.413583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:00.413583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:00.413583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:00.413583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:00.413583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:00.413583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:28:00.413583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:00.413583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:00.413583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:00.413583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:00.414374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:00.414374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:00.414374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:00.414374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:00.414374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:00.414374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:00.414374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:00.414374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:00.414374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:00.414374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:00.414374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:00.414374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:28:00.414374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 6/14] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:28:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:00.421383 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fc4c8-f5ea-487b-ab56-94b94b64cc35 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:00.513747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:00.521526 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59458fa-d330-4f32-ba5f-4c9aa2fa10ab None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:00.524055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:00.533046 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fc4c8-f5ea-487b-ab56-94b94b64cc35 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:00.564957 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4c37d-dd85-48ef-81b5-7553749c494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:00.565909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4c37d-dd85-48ef-81b5-7553749c494a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:00.566190 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4c37d-dd85-48ef-81b5-7553749c494a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:00.566463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4c37d-dd85-48ef-81b5-7553749c494a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:00.569903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d5b7d-0a73-4801-aaac-3360df93900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:00.570567 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d5b7d-0a73-4801-aaac-3360df93900a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:00.570851 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d5b7d-0a73-4801-aaac-3360df93900a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:00.571132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d5b7d-0a73-4801-aaac-3360df93900a None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:00.571882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d5b7d-0a73-4801-aaac-3360df93900a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:00.572190 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d5b7d-0a73-4801-aaac-3360df93900a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:00.573612 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d5b7d-0a73-4801-aaac-3360df93900a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:00.585819 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 7/15] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:00.591456 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d5b7d-0a73-4801-aaac-3360df93900a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:00.639866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4c37d-dd85-48ef-81b5-7553749c494a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:00.641535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4c37d-dd85-48ef-81b5-7553749c494a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:00.701916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d5b7d-0a73-4801-aaac-3360df93900a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:00.738064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf12b4-2e2d-4688-8d0c-d8ace65deb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:00.738947 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf12b4-2e2d-4688-8d0c-d8ace65deb43 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:00.739223 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf12b4-2e2d-4688-8d0c-d8ace65deb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:00.739500 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf12b4-2e2d-4688-8d0c-d8ace65deb43 None admin] PATH_INFO: `/v3/users/ea68495bc01f41d2b0c2e34799485fee` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:00.741329 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf12b4-2e2d-4688-8d0c-d8ace65deb43 None admin] RBAC: Authorizing `identity:get_user(user_id=ea68495bc01f41d2b0c2e34799485fee)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:00.742798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf12b4-2e2d-4688-8d0c-d8ace65deb43 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:00.744404 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 8/16] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:00 2022] GET /identity/v3/users/ea68495bc01f41d2b0c2e34799485fee => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:00.749681 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf12b4-2e2d-4688-8d0c-d8ace65deb43 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:00.764187 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:00.776815 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 9/17] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:28:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:28:00.778020 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4c37d-dd85-48ef-81b5-7553749c494a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:00.781124 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:00.865064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf12b4-2e2d-4688-8d0c-d8ace65deb43 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:00.895256 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4c37d-dd85-48ef-81b5-7553749c494a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:00.898766 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac3749-7111-4c26-966f-958cddcc90ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:00.899565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac3749-7111-4c26-966f-958cddcc90ca None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:00.899854 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac3749-7111-4c26-966f-958cddcc90ca None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:00.900111 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac3749-7111-4c26-966f-958cddcc90ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:00.901316 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac3749-7111-4c26-966f-958cddcc90ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:00.902797 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac3749-7111-4c26-966f-958cddcc90ca None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:00.904377 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 9/18] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:28:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:00.910130 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac3749-7111-4c26-966f-958cddcc90ca None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:00.929032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb6b14-4f71-489f-b2cb-04b38ed09b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:00.929971 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb6b14-4f71-489f-b2cb-04b38ed09b1a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:00.930247 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb6b14-4f71-489f-b2cb-04b38ed09b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:00.930519 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb6b14-4f71-489f-b2cb-04b38ed09b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:00.949837 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb6b14-4f71-489f-b2cb-04b38ed09b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:00.951311 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb6b14-4f71-489f-b2cb-04b38ed09b1a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:00.972767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-3adb6b14-4f71-489f-b2cb-04b38ed09b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:00.972767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:00.972767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:00.972767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:00.972767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:00.972767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:00.972767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:00.972767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:00.972767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:00.972767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:00.972767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:00.972767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:00.972767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:00.972767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:00.972767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:00.974121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:00.974121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:00.974121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:00.974121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:00.974121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:00.974121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:00.974121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:00.974121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:00.974121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:28:00.974121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:00.974121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:00.974121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:00.974121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:00.974121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:00.974121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:00.974121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:00.974121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:00.975396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:00.975396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:00.975396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:00.975396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:28:00.975396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 10/19] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:28:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:00.982674 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb6b14-4f71-489f-b2cb-04b38ed09b1a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:00.994072 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:01.013992 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac3749-7111-4c26-966f-958cddcc90ca None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:01.047915 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:01.050066 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4379fc-b8f2-4698-8472-ccb0125c41aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:01.050732 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4379fc-b8f2-4698-8472-ccb0125c41aa None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:01.051018 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4379fc-b8f2-4698-8472-ccb0125c41aa None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:01.051297 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4379fc-b8f2-4698-8472-ccb0125c41aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:01.052130 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4379fc-b8f2-4698-8472-ccb0125c41aa None admin] RBAC: Adding query filter params (role.id=796e313fa8794ac885ccf6300d09332a, scope.domain.id=default, user.id=ea68495bc01f41d2b0c2e34799485fee) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:01.052443 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4379fc-b8f2-4698-8472-ccb0125c41aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:01.053929 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4379fc-b8f2-4698-8472-ccb0125c41aa None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:01.060736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 10/20] 10.222.0.48 () {56 vars in 1322 bytes} [Thu May 26 16:28:00 2022] GET /identity/v3/role_assignments?user.id=ea68495bc01f41d2b0c2e34799485fee&scope.domain.id=default&role.id=796e313fa8794ac885ccf6300d09332a => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:01.100334 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb6b14-4f71-489f-b2cb-04b38ed09b1a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:01.140014 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a70843-0c24-404e-a3a4-29d75183af28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:01.140697 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a70843-0c24-404e-a3a4-29d75183af28 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:01.140977 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a70843-0c24-404e-a3a4-29d75183af28 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:01.141249 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a70843-0c24-404e-a3a4-29d75183af28 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:01.142021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a70843-0c24-404e-a3a4-29d75183af28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:01.142322 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a70843-0c24-404e-a3a4-29d75183af28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:01.143743 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a70843-0c24-404e-a3a4-29d75183af28 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:01.163849 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 11/21] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:03.545668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f33be8-0569-4b0a-9997-a36cbb90b887 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:03.546682 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f33be8-0569-4b0a-9997-a36cbb90b887 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:03.547188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f33be8-0569-4b0a-9997-a36cbb90b887 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:03.548745 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 11/22] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:03.562975 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af063104-b132-4f3b-a101-17d223f7198f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:03.563464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af063104-b132-4f3b-a101-17d223f7198f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:03.563534 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af063104-b132-4f3b-a101-17d223f7198f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:03.586354 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-af063104-b132-4f3b-a101-17d223f7198f None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:03.587582 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-af063104-b132-4f3b-a101-17d223f7198f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:03.682881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 12/23] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:03.707058 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f33be8-0569-4b0a-9997-a36cbb90b887 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:03.866214 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f33be8-0569-4b0a-9997-a36cbb90b887 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:03.915256 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655519f0-fdb0-4803-9f93-aa1e12d23a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:03.916065 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655519f0-fdb0-4803-9f93-aa1e12d23a29 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:03.916350 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655519f0-fdb0-4803-9f93-aa1e12d23a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:03.916625 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655519f0-fdb0-4803-9f93-aa1e12d23a29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:03.934169 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655519f0-fdb0-4803-9f93-aa1e12d23a29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:03.941878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-655519f0-fdb0-4803-9f93-aa1e12d23a29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:03.941878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:03.941878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:03.941878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:03.941878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:03.941878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:03.941878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:03.941878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:03.941878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:03.941878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:03.941878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:03.941878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:03.941878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:03.941878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:03.941878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:03.941878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:03.942707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:03.942707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:03.942707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:03.942707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:03.942707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:03.942707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:03.942707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:03.942707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:03.942707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:03.942707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:03.942707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:03.942707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:28:03.942707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:03.942707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:03.942707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:03.942707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:03.944104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:03.944104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:03.944104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:03.944104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:03.944104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:03.944104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:03.944104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:03.944104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:03.944104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:03.944104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:03.944104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:03.944104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:28:03.944104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 12/24] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:28:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:03.951424 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af063104-b132-4f3b-a101-17d223f7198f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:04.041157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:04.141705 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af063104-b132-4f3b-a101-17d223f7198f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:04.188759 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826af4fb-8f34-4555-8e99-f7745fb3df99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:04.189508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826af4fb-8f34-4555-8e99-f7745fb3df99 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.189796 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826af4fb-8f34-4555-8e99-f7745fb3df99 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.190074 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826af4fb-8f34-4555-8e99-f7745fb3df99 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.190856 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826af4fb-8f34-4555-8e99-f7745fb3df99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:04.191164 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826af4fb-8f34-4555-8e99-f7745fb3df99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:04.192627 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826af4fb-8f34-4555-8e99-f7745fb3df99 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:04.211588 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 13/25] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:04.218155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655519f0-fdb0-4803-9f93-aa1e12d23a29 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:04.222505 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:04.369308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655519f0-fdb0-4803-9f93-aa1e12d23a29 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:04.419467 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed915f5-0d34-4fea-bc57-6d0a69de1550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:04.420282 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed915f5-0d34-4fea-bc57-6d0a69de1550 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.420566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed915f5-0d34-4fea-bc57-6d0a69de1550 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.420855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed915f5-0d34-4fea-bc57-6d0a69de1550 None admin] PATH_INFO: `/v3/users/ea68495bc01f41d2b0c2e34799485fee` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.422123 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed915f5-0d34-4fea-bc57-6d0a69de1550 None admin] RBAC: Authorizing `identity:get_user(user_id=ea68495bc01f41d2b0c2e34799485fee)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:04.423600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed915f5-0d34-4fea-bc57-6d0a69de1550 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:04.425595 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 13/26] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:04 2022] GET /identity/v3/users/ea68495bc01f41d2b0c2e34799485fee => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:04.431689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2e801-6e85-4d5e-960b-a122069d3d3c None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.431967 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed915f5-0d34-4fea-bc57-6d0a69de1550 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:04.432466 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2e801-6e85-4d5e-960b-a122069d3d3c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.432936 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2e801-6e85-4d5e-960b-a122069d3d3c None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.434583 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 14/27] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:04.440185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1091234-8e10-4084-b590-3b1a91d46306 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.440734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1091234-8e10-4084-b590-3b1a91d46306 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.441223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1091234-8e10-4084-b590-3b1a91d46306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.478338 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b1091234-8e10-4084-b590-3b1a91d46306 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:04.479562 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b1091234-8e10-4084-b590-3b1a91d46306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:04.575108 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:04.618070 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 15/28] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:04.620074 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecdbe4-edfc-46fb-9661-0c20892a1df0 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.620505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecdbe4-edfc-46fb-9661-0c20892a1df0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.620939 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecdbe4-edfc-46fb-9661-0c20892a1df0 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.631391 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 16/29] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:04 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:04.640955 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee465c-03a6-46bc-92b7-1960fb22ff00 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.641482 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee465c-03a6-46bc-92b7-1960fb22ff00 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.641901 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee465c-03a6-46bc-92b7-1960fb22ff00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.644165 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed915f5-0d34-4fea-bc57-6d0a69de1550 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:04.691201 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f7ee465c-03a6-46bc-92b7-1960fb22ff00 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:04.694789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f7ee465c-03a6-46bc-92b7-1960fb22ff00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:04.714278 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee4bc3-c320-41bd-ba0c-29fffe4cc99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:04.715511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee4bc3-c320-41bd-ba0c-29fffe4cc99c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.715987 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee4bc3-c320-41bd-ba0c-29fffe4cc99c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.716502 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee4bc3-c320-41bd-ba0c-29fffe4cc99c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.717995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee4bc3-c320-41bd-ba0c-29fffe4cc99c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:04.719793 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee4bc3-c320-41bd-ba0c-29fffe4cc99c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:04.721677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 14/30] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:28:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:04.722972 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee4bc3-c320-41bd-ba0c-29fffe4cc99c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:04.738602 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:04.786335 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 17/31] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 26 16:28:04.788386 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b3c99-a26d-47a2-9a3c-4bd3e2866620 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.788894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b3c99-a26d-47a2-9a3c-4bd3e2866620 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.789406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b3c99-a26d-47a2-9a3c-4bd3e2866620 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.790986 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 18/32] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:04.792154 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b3c99-a26d-47a2-9a3c-4bd3e2866620 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:04.861582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee4bc3-c320-41bd-ba0c-29fffe4cc99c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:04.899574 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ae185-650f-4ec7-aefc-61f53ff6aa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:04.900610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ae185-650f-4ec7-aefc-61f53ff6aa71 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.901035 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ae185-650f-4ec7-aefc-61f53ff6aa71 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.901549 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ae185-650f-4ec7-aefc-61f53ff6aa71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.911770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:04.914484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ae185-650f-4ec7-aefc-61f53ff6aa71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:04.916148 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ae185-650f-4ec7-aefc-61f53ff6aa71 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:04.931359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b3c99-a26d-47a2-9a3c-4bd3e2866620 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:04.937680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-cf2ae185-650f-4ec7-aefc-61f53ff6aa71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:04.937680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:04.937680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:04.937680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:04.937680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:04.937680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:04.937680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:04.937680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:04.937680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:04.937680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:04.937680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:04.937680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:04.937680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:04.937680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:04.937680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:04.938697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:04.938697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:04.938697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:04.938697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:04.938697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:04.938697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:04.938697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:04.938697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:04.938697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:28:04.938697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:04.938697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:04.938697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:04.938697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:04.938697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:04.938697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:04.938697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:04.938697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:04.939594 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:04.939594 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:04.939594 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:04.939594 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:28:04.939594 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 15/33] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:04.940606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c0aac-700a-4a70-9334-a7a737963d41 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.940893 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c0aac-700a-4a70-9334-a7a737963d41 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.941165 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c0aac-700a-4a70-9334-a7a737963d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.962522 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6b4c0aac-700a-4a70-9334-a7a737963d41 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:04.963717 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6b4c0aac-700a-4a70-9334-a7a737963d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:04.978848 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b78370-6adf-4185-a21f-10fbaa99b1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:04.980219 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b78370-6adf-4185-a21f-10fbaa99b1aa None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.980756 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b78370-6adf-4185-a21f-10fbaa99b1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.981235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b78370-6adf-4185-a21f-10fbaa99b1aa None admin] PATH_INFO: `/v3/domains/default/users/ea68495bc01f41d2b0c2e34799485fee/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.984020 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b78370-6adf-4185-a21f-10fbaa99b1aa None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ea68495bc01f41d2b0c2e34799485fee, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:04.985829 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b78370-6adf-4185-a21f-10fbaa99b1aa None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:05.037741 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 16/34] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:05.038425 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c0aac-700a-4a70-9334-a7a737963d41 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:05.161615 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c0aac-700a-4a70-9334-a7a737963d41 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:05.185461 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:05.188998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 19/35] 10.222.0.48 () {58 vars in 1361 bytes} [Thu May 26 16:28:04 2022] PUT /identity/v3/domains/default/users/ea68495bc01f41d2b0c2e34799485fee/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:05.190632 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b78370-6adf-4185-a21f-10fbaa99b1aa None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:05.210525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8fe661-a33e-481a-91b9-6a3ff47f656b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:05.212295 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fe661-a33e-481a-91b9-6a3ff47f656b None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:05.213142 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fe661-a33e-481a-91b9-6a3ff47f656b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:05.213636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fe661-a33e-481a-91b9-6a3ff47f656b None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:05.215022 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fe661-a33e-481a-91b9-6a3ff47f656b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:05.217652 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fe661-a33e-481a-91b9-6a3ff47f656b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:05.233479 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:05.328915 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b78370-6adf-4185-a21f-10fbaa99b1aa None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:05.376635 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466968ce-4fb4-4a94-a272-bef1ddbe6d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:05.377739 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466968ce-4fb4-4a94-a272-bef1ddbe6d38 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:05.378208 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466968ce-4fb4-4a94-a272-bef1ddbe6d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:05.378663 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466968ce-4fb4-4a94-a272-bef1ddbe6d38 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:05.379644 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466968ce-4fb4-4a94-a272-bef1ddbe6d38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:05.380132 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466968ce-4fb4-4a94-a272-bef1ddbe6d38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:05.382764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466968ce-4fb4-4a94-a272-bef1ddbe6d38 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:05.401756 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 20/36] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:05.402860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466968ce-4fb4-4a94-a272-bef1ddbe6d38 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:05.458898 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 17/37] 10.222.0.48 () {60 vars in 1131 bytes} [Thu May 26 16:28:05 2022] POST /identity/v3/roles => generated 225 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:05.460476 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc37c27-c539-46c2-970a-4547625c485c None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:05.460769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc37c27-c539-46c2-970a-4547625c485c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:05.461048 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc37c27-c539-46c2-970a-4547625c485c None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:05.462381 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 18/38] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:05.463112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc37c27-c539-46c2-970a-4547625c485c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:05.525447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:05.544154 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466968ce-4fb4-4a94-a272-bef1ddbe6d38 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:05.605399 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb33c53-e3a1-441f-8ad8-74338a3e9fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:05.606306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb33c53-e3a1-441f-8ad8-74338a3e9fcd None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:05.606599 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb33c53-e3a1-441f-8ad8-74338a3e9fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:05.606884 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb33c53-e3a1-441f-8ad8-74338a3e9fcd None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:05.607372 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc37c27-c539-46c2-970a-4547625c485c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:05.607801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb33c53-e3a1-441f-8ad8-74338a3e9fcd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:05.609455 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb33c53-e3a1-441f-8ad8-74338a3e9fcd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:05.649606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5f339-04ab-4aaa-929f-b7831dece4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:05.650558 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5f339-04ab-4aaa-929f-b7831dece4bc None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:05.650980 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5f339-04ab-4aaa-929f-b7831dece4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:05.651262 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5f339-04ab-4aaa-929f-b7831dece4bc None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:05.652003 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5f339-04ab-4aaa-929f-b7831dece4bc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:05.653822 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5f339-04ab-4aaa-929f-b7831dece4bc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:05.684175 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 21/39] 10.222.0.48 () {60 vars in 1131 bytes} [Thu May 26 16:28:05 2022] POST /identity/v3/roles => generated 219 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:05.685760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe16024-9df1-46c3-b697-bde13e77243c None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:05.686055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe16024-9df1-46c3-b697-bde13e77243c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:05.686346 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe16024-9df1-46c3-b697-bde13e77243c None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:05.687835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 22/40] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:05.689366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407028f-9b51-4982-a58e-04c773ea7020 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:05.689844 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407028f-9b51-4982-a58e-04c773ea7020 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:05.690234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407028f-9b51-4982-a58e-04c773ea7020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:05.711533 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6407028f-9b51-4982-a58e-04c773ea7020 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:05.713364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6407028f-9b51-4982-a58e-04c773ea7020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:05.773473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 19/41] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 16:28:05 2022] POST /identity/v3/projects => generated 301 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:05.773473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535a3e5-0c34-4dc8-b8a3-617f5b85d387 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:05.773473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535a3e5-0c34-4dc8-b8a3-617f5b85d387 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:05.773473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535a3e5-0c34-4dc8-b8a3-617f5b85d387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:05.827433 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d535a3e5-0c34-4dc8-b8a3-617f5b85d387 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:05.830250 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d535a3e5-0c34-4dc8-b8a3-617f5b85d387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:05.901048 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:05.915561 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 23/42] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:05.942470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407028f-9b51-4982-a58e-04c773ea7020 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:05.959775 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 20/43] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:05.998457 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535a3e5-0c34-4dc8-b8a3-617f5b85d387 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:06.042043 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:06.069352 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407028f-9b51-4982-a58e-04c773ea7020 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:06.122805 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45384d19-b92c-44c2-b405-04320b8ea1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:06.123412 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45384d19-b92c-44c2-b405-04320b8ea1a4 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:06.123698 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45384d19-b92c-44c2-b405-04320b8ea1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:06.123975 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45384d19-b92c-44c2-b405-04320b8ea1a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:06.124748 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45384d19-b92c-44c2-b405-04320b8ea1a4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:06.126183 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45384d19-b92c-44c2-b405-04320b8ea1a4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:06.166956 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535a3e5-0c34-4dc8-b8a3-617f5b85d387 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:06.201248 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 24/44] 10.222.0.48 () {60 vars in 1131 bytes} [Thu May 26 16:28:05 2022] POST /identity/v3/roles => generated 223 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:06.210964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5c9a6-4707-4dcd-a775-decd6305a91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:06.212217 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5c9a6-4707-4dcd-a775-decd6305a91a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:06.212716 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5c9a6-4707-4dcd-a775-decd6305a91a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:06.213200 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5c9a6-4707-4dcd-a775-decd6305a91a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:06.215242 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5c9a6-4707-4dcd-a775-decd6305a91a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:06.217301 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5c9a6-4707-4dcd-a775-decd6305a91a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:06.219545 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 21/45] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:28:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:06.228408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45384d19-b92c-44c2-b405-04320b8ea1a4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:06.354408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45384d19-b92c-44c2-b405-04320b8ea1a4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:06.395224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed416b54-cd94-420a-b7ed-3ae1ed6e8965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:06.395822 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed416b54-cd94-420a-b7ed-3ae1ed6e8965 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:06.396105 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed416b54-cd94-420a-b7ed-3ae1ed6e8965 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:06.396896 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed416b54-cd94-420a-b7ed-3ae1ed6e8965 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:06.397645 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed416b54-cd94-420a-b7ed-3ae1ed6e8965 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:06.399243 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed416b54-cd94-420a-b7ed-3ae1ed6e8965 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:06.408790 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:06.476029 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 25/46] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 16:28:06 2022] POST /identity/v3/projects => generated 312 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:07.797682 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98d1e5-139e-44f9-bce0-40bdc09ede9d None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:07.798359 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98d1e5-139e-44f9-bce0-40bdc09ede9d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:07.798817 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98d1e5-139e-44f9-bce0-40bdc09ede9d None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:07.801536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 22/47] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:07.810820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a085a6-3f36-47db-a9f7-4c1e490cad72 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:07.811538 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a085a6-3f36-47db-a9f7-4c1e490cad72 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:07.811752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a085a6-3f36-47db-a9f7-4c1e490cad72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:07.839006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-82a085a6-3f36-47db-a9f7-4c1e490cad72 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:07.840975 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-82a085a6-3f36-47db-a9f7-4c1e490cad72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:07.954810 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 26/48] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:07.984332 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98d1e5-139e-44f9-bce0-40bdc09ede9d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:08.030723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:08.123121 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98d1e5-139e-44f9-bce0-40bdc09ede9d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:08.158724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee410d8-ad04-40f2-ae7e-59af4b07055f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:08.159553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee410d8-ad04-40f2-ae7e-59af4b07055f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:08.159844 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee410d8-ad04-40f2-ae7e-59af4b07055f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:08.160125 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee410d8-ad04-40f2-ae7e-59af4b07055f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:08.171292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee410d8-ad04-40f2-ae7e-59af4b07055f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:08.180376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-4ee410d8-ad04-40f2-ae7e-59af4b07055f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:08.180376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:08.180376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:08.180376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:08.180376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:08.180376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:08.180376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:08.180376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:08.180376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:08.180376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:08.180376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:08.180376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:08.180376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:08.180376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:08.180376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:08.180376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:08.181758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:08.181758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:08.181758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:08.181758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:08.181758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:08.181758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:08.181758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:08.181758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:08.181758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:08.181758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:08.181758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:08.181758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:28:08.181758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:08.181758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:08.181758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:08.181758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:08.182576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:08.182576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:08.182576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:08.182576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:08.182576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:08.182576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:08.182576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:08.182576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:08.182576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:08.182576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:08.182576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:08.182576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:28:08.185590 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 23/49] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:28:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:08.188028 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a085a6-3f36-47db-a9f7-4c1e490cad72 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:08.293009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a085a6-3f36-47db-a9f7-4c1e490cad72 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:08.313637 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:08.329951 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7f3ab-6668-4a71-a5f8-6b8f6ff3fe3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:08.330637 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7f3ab-6668-4a71-a5f8-6b8f6ff3fe3a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:08.330968 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7f3ab-6668-4a71-a5f8-6b8f6ff3fe3a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:08.331308 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7f3ab-6668-4a71-a5f8-6b8f6ff3fe3a None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:08.332162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7f3ab-6668-4a71-a5f8-6b8f6ff3fe3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:08.332524 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7f3ab-6668-4a71-a5f8-6b8f6ff3fe3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:08.334772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7f3ab-6668-4a71-a5f8-6b8f6ff3fe3a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:08.343851 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 27/50] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:08.351686 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee410d8-ad04-40f2-ae7e-59af4b07055f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:08.453562 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:08.463778 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee410d8-ad04-40f2-ae7e-59af4b07055f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:08.501607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c08645-4374-494a-9c5e-ef4b351a9365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:08.502507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c08645-4374-494a-9c5e-ef4b351a9365 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:08.502796 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c08645-4374-494a-9c5e-ef4b351a9365 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:08.503075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c08645-4374-494a-9c5e-ef4b351a9365 None admin] PATH_INFO: `/v3/users/ea68495bc01f41d2b0c2e34799485fee` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:08.504306 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c08645-4374-494a-9c5e-ef4b351a9365 None admin] RBAC: Authorizing `identity:get_user(user_id=ea68495bc01f41d2b0c2e34799485fee)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:08.506004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c08645-4374-494a-9c5e-ef4b351a9365 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:08.507687 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 24/51] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:08 2022] GET /identity/v3/users/ea68495bc01f41d2b0c2e34799485fee => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:08.513451 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7f3ab-6668-4a71-a5f8-6b8f6ff3fe3a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:08.620003 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7f3ab-6668-4a71-a5f8-6b8f6ff3fe3a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:08.656697 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799e68d-4392-4a97-9d2b-7eb09e8b20e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:08.657552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799e68d-4392-4a97-9d2b-7eb09e8b20e2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:08.657834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799e68d-4392-4a97-9d2b-7eb09e8b20e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:08.658105 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799e68d-4392-4a97-9d2b-7eb09e8b20e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:08.659291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799e68d-4392-4a97-9d2b-7eb09e8b20e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:08.660764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799e68d-4392-4a97-9d2b-7eb09e8b20e2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:08.662572 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 28/52] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:28:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:08.668348 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c08645-4374-494a-9c5e-ef4b351a9365 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:08.793732 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c08645-4374-494a-9c5e-ef4b351a9365 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:08.828619 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8100a7-1519-40a3-a229-6a69b7dd5063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:08.829312 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8100a7-1519-40a3-a229-6a69b7dd5063 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:08.829585 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8100a7-1519-40a3-a229-6a69b7dd5063 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:08.829860 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8100a7-1519-40a3-a229-6a69b7dd5063 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:08.830696 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8100a7-1519-40a3-a229-6a69b7dd5063 None admin] RBAC: Adding query filter params (role.id=796e313fa8794ac885ccf6300d09332a, scope.domain.id=default, user.id=ea68495bc01f41d2b0c2e34799485fee) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:08.831008 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8100a7-1519-40a3-a229-6a69b7dd5063 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:08.832468 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8100a7-1519-40a3-a229-6a69b7dd5063 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:08.838757 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 25/53] 10.222.0.48 () {56 vars in 1322 bytes} [Thu May 26 16:28:08 2022] GET /identity/v3/role_assignments?user.id=ea68495bc01f41d2b0c2e34799485fee&scope.domain.id=default&role.id=796e313fa8794ac885ccf6300d09332a => generated 530 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:09.096435 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb94b4e-e2a0-48ee-9056-598acf8db56e None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:09.097334 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb94b4e-e2a0-48ee-9056-598acf8db56e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:09.097334 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb94b4e-e2a0-48ee-9056-598acf8db56e None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:09.098636 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 29/54] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:09.105121 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948e72e-08a7-4674-9622-7d6df8cd99a3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:09.105441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948e72e-08a7-4674-9622-7d6df8cd99a3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:09.105716 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948e72e-08a7-4674-9622-7d6df8cd99a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:09.122990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6948e72e-08a7-4674-9622-7d6df8cd99a3 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:09.124187 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6948e72e-08a7-4674-9622-7d6df8cd99a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:09.141837 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:09.190614 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 26/55] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:09.213800 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb94b4e-e2a0-48ee-9056-598acf8db56e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:09.266066 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:09.318225 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb94b4e-e2a0-48ee-9056-598acf8db56e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:09.353556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7090a73-3e2c-48f3-9f89-fde56cca456e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:09.354269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7090a73-3e2c-48f3-9f89-fde56cca456e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:09.354549 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7090a73-3e2c-48f3-9f89-fde56cca456e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:09.354822 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7090a73-3e2c-48f3-9f89-fde56cca456e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:09.355987 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7090a73-3e2c-48f3-9f89-fde56cca456e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:09.357455 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7090a73-3e2c-48f3-9f89-fde56cca456e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:09.359163 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 30/56] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:28:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:09.364760 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948e72e-08a7-4674-9622-7d6df8cd99a3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:09.466003 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948e72e-08a7-4674-9622-7d6df8cd99a3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:09.500301 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe9f2b-5053-4cf9-9202-1fb87b0d3cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:09.500968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe9f2b-5053-4cf9-9202-1fb87b0d3cc5 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:09.501284 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe9f2b-5053-4cf9-9202-1fb87b0d3cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:09.501571 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe9f2b-5053-4cf9-9202-1fb87b0d3cc5 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:09.502291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe9f2b-5053-4cf9-9202-1fb87b0d3cc5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:09.504581 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe9f2b-5053-4cf9-9202-1fb87b0d3cc5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:09.573908 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 27/57] 10.222.0.48 () {60 vars in 1140 bytes} [Thu May 26 16:28:09 2022] POST /identity/v3/projects => generated 298 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:11.835560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d395503-4705-4b2f-ba89-bf04629146f2 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:11.836257 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d395503-4705-4b2f-ba89-bf04629146f2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:11.836257 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d395503-4705-4b2f-ba89-bf04629146f2 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:11.837674 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 31/58] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:28:11.843175 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a298432-8354-452d-9175-5744a9502927 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:11.843623 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a298432-8354-452d-9175-5744a9502927 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:11.843718 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a298432-8354-452d-9175-5744a9502927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:11.855676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:11.861293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8a298432-8354-452d-9175-5744a9502927 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:11.866092 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8a298432-8354-452d-9175-5744a9502927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:11.929461 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 28/59] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:11.954373 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d395503-4705-4b2f-ba89-bf04629146f2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:12.063343 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d395503-4705-4b2f-ba89-bf04629146f2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:12.086063 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:12.103137 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aba261-9332-477e-a1d0-46eaa4c6475f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:12.103945 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aba261-9332-477e-a1d0-46eaa4c6475f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:12.104233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aba261-9332-477e-a1d0-46eaa4c6475f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:12.104510 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aba261-9332-477e-a1d0-46eaa4c6475f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:12.105746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aba261-9332-477e-a1d0-46eaa4c6475f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:12.107200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aba261-9332-477e-a1d0-46eaa4c6475f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:12.108839 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 32/60] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:28:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:12.114467 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a298432-8354-452d-9175-5744a9502927 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:12.213633 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a298432-8354-452d-9175-5744a9502927 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:12.250739 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fadcbb-de16-4125-98a3-a9568b5b0247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:12.251425 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fadcbb-de16-4125-98a3-a9568b5b0247 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:12.251711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fadcbb-de16-4125-98a3-a9568b5b0247 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:12.251993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fadcbb-de16-4125-98a3-a9568b5b0247 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:12.252711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fadcbb-de16-4125-98a3-a9568b5b0247 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:12.254214 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fadcbb-de16-4125-98a3-a9568b5b0247 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:12.266051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:12.384620 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 29/61] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 16:28:12 2022] POST /identity/v3/users => generated 275 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:15.806792 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e69e5-d050-4c38-9ef1-9be9d6e8a1f7 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:15.807805 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e69e5-d050-4c38-9ef1-9be9d6e8a1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:15.808307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e69e5-d050-4c38-9ef1-9be9d6e8a1f7 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:15.810125 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 33/62] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:15.816044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579359a2-f926-4852-a0a6-c73d15635eef None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:15.816979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579359a2-f926-4852-a0a6-c73d15635eef None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:15.817632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579359a2-f926-4852-a0a6-c73d15635eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:15.842633 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-579359a2-f926-4852-a0a6-c73d15635eef None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:15.844468 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-579359a2-f926-4852-a0a6-c73d15635eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:15.953223 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 30/63] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:15.989187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e69e5-d050-4c38-9ef1-9be9d6e8a1f7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:16.171036 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e69e5-d050-4c38-9ef1-9be9d6e8a1f7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:16.223810 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a65b5-08be-4881-9235-82bc3abf6754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:16.225178 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a65b5-08be-4881-9235-82bc3abf6754 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:16.225486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a65b5-08be-4881-9235-82bc3abf6754 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:16.225760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a65b5-08be-4881-9235-82bc3abf6754 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:16.233397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930a879-5c6c-44c8-bb64-6c6993b6aa34 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:16.233770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930a879-5c6c-44c8-bb64-6c6993b6aa34 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:16.233935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930a879-5c6c-44c8-bb64-6c6993b6aa34 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:16.235921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 31/64] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:16.241678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05516308-8392-4f6d-8eaf-76a76ad806ef None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:16.241957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05516308-8392-4f6d-8eaf-76a76ad806ef None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:16.242391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05516308-8392-4f6d-8eaf-76a76ad806ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:16.253759 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a65b5-08be-4881-9235-82bc3abf6754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:16.265010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6b8a65b5-08be-4881-9235-82bc3abf6754 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:16.265010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:16.265010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:16.265010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:16.265010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:16.265010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:16.265010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:16.265010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:16.265010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:16.265010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:16.265010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:16.265010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:16.265010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:16.265010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:16.265010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:16.265010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:16.266223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:16.266223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:16.266223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:16.266223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:16.266223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:16.266223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:16.266223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:16.266223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:16.266223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:16.266223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:16.266223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:16.266223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:28:16.266223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:16.266223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:16.266223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:16.266223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:16.267214 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:16.267214 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:16.267214 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:16.267214 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:16.267214 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:16.267214 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:16.267214 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:16.267214 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:16.267214 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:16.267214 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:16.267214 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:16.267214 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:28:16.267214 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 34/65] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:16.273725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a65b5-08be-4881-9235-82bc3abf6754 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:16.286281 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-05516308-8392-4f6d-8eaf-76a76ad806ef None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:16.288217 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-05516308-8392-4f6d-8eaf-76a76ad806ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:16.348910 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:16.427254 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 32/66] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:16.436490 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a65b5-08be-4881-9235-82bc3abf6754 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:16.458719 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05516308-8392-4f6d-8eaf-76a76ad806ef None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:16.511319 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1343a4-2dad-4f08-a917-448d8a0e27be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:16.512007 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1343a4-2dad-4f08-a917-448d8a0e27be None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:16.512351 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1343a4-2dad-4f08-a917-448d8a0e27be None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:16.512627 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1343a4-2dad-4f08-a917-448d8a0e27be None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:16.513414 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1343a4-2dad-4f08-a917-448d8a0e27be None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:16.513715 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1343a4-2dad-4f08-a917-448d8a0e27be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:16.515453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1343a4-2dad-4f08-a917-448d8a0e27be None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:16.524976 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 35/67] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:28:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:16.530872 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4c4b5-e919-4bc9-bda9-1b025bc3455e None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:16.531405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4c4b5-e919-4bc9-bda9-1b025bc3455e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:16.531839 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4c4b5-e919-4bc9-bda9-1b025bc3455e None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:16.533375 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 36/68] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:16.535247 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4c4b5-e919-4bc9-bda9-1b025bc3455e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:16.544541 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:16.602255 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05516308-8392-4f6d-8eaf-76a76ad806ef None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:16.640594 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d4174-2ec2-445c-9bbe-0298ae988df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:16.641452 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d4174-2ec2-445c-9bbe-0298ae988df0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:16.641739 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d4174-2ec2-445c-9bbe-0298ae988df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:16.642021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d4174-2ec2-445c-9bbe-0298ae988df0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:16.652787 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d4174-2ec2-445c-9bbe-0298ae988df0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:16.661096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-562d4174-2ec2-445c-9bbe-0298ae988df0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:16.661096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:16.661096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:16.661096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:16.661096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:16.661096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:16.661096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:16.661096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:16.661096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:16.661096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:16.661096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:16.661096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:16.661096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:16.661096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:16.661096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:16.661096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:16.662964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:16.662964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:16.662964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:16.662964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:16.662964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:16.662964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:16.662964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:16.662964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:16.662964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:16.662964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:16.662964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:16.662964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:28:16.662964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:16.662964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:16.662964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:16.662964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:16.663710 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:16.663710 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:16.663710 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:16.663710 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:16.663710 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:16.663710 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:16.663710 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:16.663710 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:16.663710 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:16.663710 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:16.663710 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:16.663710 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:28:16.663710 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 33/69] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 16:28:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:16.664347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab480166-cf4a-4a18-a6cf-67700afca8d2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:16.664926 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab480166-cf4a-4a18-a6cf-67700afca8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:16.664926 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab480166-cf4a-4a18-a6cf-67700afca8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:16.669855 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4c4b5-e919-4bc9-bda9-1b025bc3455e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:16.679544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:16.682012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ab480166-cf4a-4a18-a6cf-67700afca8d2 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:16.683214 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ab480166-cf4a-4a18-a6cf-67700afca8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:16.704916 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417222d-1e55-4e0b-832a-f0d4ec615183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:16.706064 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417222d-1e55-4e0b-832a-f0d4ec615183 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:16.706353 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417222d-1e55-4e0b-832a-f0d4ec615183 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:16.706629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417222d-1e55-4e0b-832a-f0d4ec615183 None admin] PATH_INFO: `/v3/users/4e70b03ce9684918961bd5fcc34afa71` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:16.727345 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417222d-1e55-4e0b-832a-f0d4ec615183 None admin] RBAC: Authorizing `identity:get_user(user_id=4e70b03ce9684918961bd5fcc34afa71)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:16.728812 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417222d-1e55-4e0b-832a-f0d4ec615183 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:16.735147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 37/70] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:16 2022] GET /identity/v3/users/4e70b03ce9684918961bd5fcc34afa71 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:16.735147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41019f-6944-48e2-8162-9b51bf458e64 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:16.735147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41019f-6944-48e2-8162-9b51bf458e64 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:16.735147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41019f-6944-48e2-8162-9b51bf458e64 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:16.735147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 38/71] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:16.739266 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3a556-41bc-436a-972d-8de5a7c62c20 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:16.739599 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3a556-41bc-436a-972d-8de5a7c62c20 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:16.739880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3a556-41bc-436a-972d-8de5a7c62c20 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:16.741252 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 39/72] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:16.741994 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3a556-41bc-436a-972d-8de5a7c62c20 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:16.759604 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 34/73] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:16.762350 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab480166-cf4a-4a18-a6cf-67700afca8d2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:16.813331 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:16.854561 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3a556-41bc-436a-972d-8de5a7c62c20 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:16.876458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab480166-cf4a-4a18-a6cf-67700afca8d2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:16.891721 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d126207-a513-42fe-92c1-822b0d8d7c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:16.892404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d126207-a513-42fe-92c1-822b0d8d7c95 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:16.892694 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d126207-a513-42fe-92c1-822b0d8d7c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:16.892970 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d126207-a513-42fe-92c1-822b0d8d7c95 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:16.893756 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d126207-a513-42fe-92c1-822b0d8d7c95 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:16.894093 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d126207-a513-42fe-92c1-822b0d8d7c95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:16.895475 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d126207-a513-42fe-92c1-822b0d8d7c95 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:16.904984 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 40/74] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:28:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:16.909595 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b86d5-6ec3-42c1-940b-eecb158ee617 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:16.909595 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b86d5-6ec3-42c1-940b-eecb158ee617 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:16.909595 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b86d5-6ec3-42c1-940b-eecb158ee617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:16.919597 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41994bc-a88a-4452-bd4a-e88bcce70404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:16.920260 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41994bc-a88a-4452-bd4a-e88bcce70404 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:16.920547 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41994bc-a88a-4452-bd4a-e88bcce70404 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:16.920823 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41994bc-a88a-4452-bd4a-e88bcce70404 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:16.923990 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-254b86d5-6ec3-42c1-940b-eecb158ee617 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:16.925186 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-254b86d5-6ec3-42c1-940b-eecb158ee617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:16.950334 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:16.993004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41994bc-a88a-4452-bd4a-e88bcce70404 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:16.994590 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41994bc-a88a-4452-bd4a-e88bcce70404 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:16.994698 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 41/75] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:16.995902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbba43-af21-4ccf-a316-c901e5887ca1 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:16.996197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbba43-af21-4ccf-a316-c901e5887ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:16.996478 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbba43-af21-4ccf-a316-c901e5887ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.023919 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0efbba43-af21-4ccf-a316-c901e5887ca1 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:17.025824 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0efbba43-af21-4ccf-a316-c901e5887ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:17.050425 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:17.098393 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 42/76] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:17.099298 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbba43-af21-4ccf-a316-c901e5887ca1 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:17.122653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 35/77] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:28:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:17.123427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41994bc-a88a-4452-bd4a-e88bcce70404 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:17.193412 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:17.205120 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbba43-af21-4ccf-a316-c901e5887ca1 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:17.228175 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41994bc-a88a-4452-bd4a-e88bcce70404 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:17.240373 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d5969-73c9-4f5c-a3ed-054b3ddd5cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:17.241166 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d5969-73c9-4f5c-a3ed-054b3ddd5cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.241476 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d5969-73c9-4f5c-a3ed-054b3ddd5cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.241750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d5969-73c9-4f5c-a3ed-054b3ddd5cb5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.242917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d5969-73c9-4f5c-a3ed-054b3ddd5cb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:17.244377 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d5969-73c9-4f5c-a3ed-054b3ddd5cb5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:17.246025 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 43/78] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:28:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:17.246774 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d5969-73c9-4f5c-a3ed-054b3ddd5cb5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:17.262331 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f56f3-ff3e-43d4-859f-0509c97a5488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:17.263207 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f56f3-ff3e-43d4-859f-0509c97a5488 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.263487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f56f3-ff3e-43d4-859f-0509c97a5488 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.263758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f56f3-ff3e-43d4-859f-0509c97a5488 None admin] PATH_INFO: `/v3/users/4e70b03ce9684918961bd5fcc34afa71` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.264929 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f56f3-ff3e-43d4-859f-0509c97a5488 None admin] RBAC: Authorizing `identity:get_user(user_id=4e70b03ce9684918961bd5fcc34afa71)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:17.266431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f56f3-ff3e-43d4-859f-0509c97a5488 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:17.268049 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 36/79] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:17 2022] GET /identity/v3/users/4e70b03ce9684918961bd5fcc34afa71 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:17.268794 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f56f3-ff3e-43d4-859f-0509c97a5488 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:17.282661 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:17.352531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d5969-73c9-4f5c-a3ed-054b3ddd5cb5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:17.369887 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f56f3-ff3e-43d4-859f-0509c97a5488 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:17.386395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf302137-27fa-46bd-821f-dedff582e82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:17.387126 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf302137-27fa-46bd-821f-dedff582e82c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.387409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf302137-27fa-46bd-821f-dedff582e82c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.387679 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf302137-27fa-46bd-821f-dedff582e82c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.397662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf302137-27fa-46bd-821f-dedff582e82c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:17.403821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a9b08-f2cc-45ee-ac27-00cb404f669c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:17.404616 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a9b08-f2cc-45ee-ac27-00cb404f669c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.404901 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a9b08-f2cc-45ee-ac27-00cb404f669c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.405175 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a9b08-f2cc-45ee-ac27-00cb404f669c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.405366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-bf302137-27fa-46bd-821f-dedff582e82c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:17.405366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:17.405366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:17.405366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:17.405366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:17.405366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:17.405366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:17.405366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:17.405366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:17.405366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:17.405366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:17.405366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:17.405366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:17.405366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:17.405366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:17.405366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:17.406232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:17.406232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:17.406232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:17.406232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:17.406232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:17.406232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:17.406232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:17.406232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:17.406232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:17.406232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:17.406232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:17.406232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:28:17.406232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:17.406232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:17.406232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:17.406232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:17.407227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:17.407227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:17.407227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:17.407227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:17.407227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:17.407227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:17.407227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:17.407227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:17.407227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:17.407227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:17.407227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:17.407227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:28:17.407227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 44/80] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:28:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:17.408099 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf302137-27fa-46bd-821f-dedff582e82c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:17.418263 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a9b08-f2cc-45ee-ac27-00cb404f669c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:17.426103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-618a9b08-f2cc-45ee-ac27-00cb404f669c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:17.426103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:17.426103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:17.426103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:17.426103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:17.426103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:17.426103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:17.426103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:17.426103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:17.426103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:17.426103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:17.426103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:17.426103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:17.426103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:17.426103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:17.426103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:17.427636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:17.427636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:17.427636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:17.427636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:17.427636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:17.427636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:17.427636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:17.427636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:17.427636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:17.427636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:17.427636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:17.427636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:28:17.427636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:17.427636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:17.427636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:17.427636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:17.428733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:17.428733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:17.428733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:17.428733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:17.428733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:17.428733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:17.428733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:17.428733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:17.428733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:17.428733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:17.428733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:17.428733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:28:17.428733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 37/81] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:17.429949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:17.430050 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a9b08-f2cc-45ee-ac27-00cb404f669c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:17.513347 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf302137-27fa-46bd-821f-dedff582e82c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:17.514316 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:17.546853 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a9b08-f2cc-45ee-ac27-00cb404f669c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:17.549388 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fcf73-846c-4d2a-9b0f-ffc37d9fb079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:17.550280 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fcf73-846c-4d2a-9b0f-ffc37d9fb079 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.550569 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fcf73-846c-4d2a-9b0f-ffc37d9fb079 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.550851 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fcf73-846c-4d2a-9b0f-ffc37d9fb079 None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.552594 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fcf73-846c-4d2a-9b0f-ffc37d9fb079 None admin] RBAC: Authorizing `identity:get_project(project_id=97a27564d6b5404fa22fe354151a49d1)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:17.554266 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fcf73-846c-4d2a-9b0f-ffc37d9fb079 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:17.556129 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 45/82] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:17 2022] GET /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:17.556129 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fcf73-846c-4d2a-9b0f-ffc37d9fb079 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:17.588510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09f0d5-8b11-4532-8c6b-73b29dfcf822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:17.589188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09f0d5-8b11-4532-8c6b-73b29dfcf822 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.589503 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09f0d5-8b11-4532-8c6b-73b29dfcf822 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.589785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09f0d5-8b11-4532-8c6b-73b29dfcf822 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.590499 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09f0d5-8b11-4532-8c6b-73b29dfcf822 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:17.591951 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09f0d5-8b11-4532-8c6b-73b29dfcf822 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:17.644101 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:17.659678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fcf73-846c-4d2a-9b0f-ffc37d9fb079 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:17.675276 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 38/83] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 16:28:17 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:17.676186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09f0d5-8b11-4532-8c6b-73b29dfcf822 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:17.700709 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e868f-103b-4c2c-b6de-bbd26f27b86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:17.701435 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e868f-103b-4c2c-b6de-bbd26f27b86c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.701797 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e868f-103b-4c2c-b6de-bbd26f27b86c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.702084 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e868f-103b-4c2c-b6de-bbd26f27b86c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.788670 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e868f-103b-4c2c-b6de-bbd26f27b86c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:17.790435 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e868f-103b-4c2c-b6de-bbd26f27b86c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:17.808884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09f0d5-8b11-4532-8c6b-73b29dfcf822 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:17.842128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:17.852386 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2069e81-95a4-43bb-8574-115e2ef0e4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:17.853171 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2069e81-95a4-43bb-8574-115e2ef0e4ec None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.853490 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2069e81-95a4-43bb-8574-115e2ef0e4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.853811 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2069e81-95a4-43bb-8574-115e2ef0e4ec None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.856102 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2069e81-95a4-43bb-8574-115e2ef0e4ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:17.856102 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2069e81-95a4-43bb-8574-115e2ef0e4ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:17.856672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2069e81-95a4-43bb-8574-115e2ef0e4ec None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:17.867768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 39/84] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:17.873552 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2069e81-95a4-43bb-8574-115e2ef0e4ec None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:17.892564 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:17.905371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 46/85] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:28:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:17.906082 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e868f-103b-4c2c-b6de-bbd26f27b86c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:18.002127 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2069e81-95a4-43bb-8574-115e2ef0e4ec None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:18.042583 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e868f-103b-4c2c-b6de-bbd26f27b86c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:18.048761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0355eb-1b13-4cf6-8817-1dc0ccfe797f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:18.049496 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0355eb-1b13-4cf6-8817-1dc0ccfe797f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:18.049788 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0355eb-1b13-4cf6-8817-1dc0ccfe797f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:18.050067 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0355eb-1b13-4cf6-8817-1dc0ccfe797f None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:18.051437 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0355eb-1b13-4cf6-8817-1dc0ccfe797f None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:18.051749 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0355eb-1b13-4cf6-8817-1dc0ccfe797f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:18.054260 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0355eb-1b13-4cf6-8817-1dc0ccfe797f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:18.067133 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 40/86] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:28:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:18.068135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0355eb-1b13-4cf6-8817-1dc0ccfe797f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:18.093384 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b6dc6-d433-4a12-a1db-39dbf420cd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:18.094063 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b6dc6-d433-4a12-a1db-39dbf420cd6d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:18.094352 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b6dc6-d433-4a12-a1db-39dbf420cd6d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:18.094667 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b6dc6-d433-4a12-a1db-39dbf420cd6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:18.095597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b6dc6-d433-4a12-a1db-39dbf420cd6d None admin] RBAC: Adding query filter params (role.id=cdbaa8196c574e32a331e8d4faee1a7e, scope.project.id=97a27564d6b5404fa22fe354151a49d1, user.id=4e70b03ce9684918961bd5fcc34afa71) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:18.095916 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b6dc6-d433-4a12-a1db-39dbf420cd6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:18.097665 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b6dc6-d433-4a12-a1db-39dbf420cd6d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:18.107881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 47/87] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:28:17 2022] GET /identity/v3/role_assignments?user.id=4e70b03ce9684918961bd5fcc34afa71&scope.project.id=97a27564d6b5404fa22fe354151a49d1&role.id=cdbaa8196c574e32a331e8d4faee1a7e => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:18.108776 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b6dc6-d433-4a12-a1db-39dbf420cd6d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:18.132282 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:18.206601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:18.252392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0355eb-1b13-4cf6-8817-1dc0ccfe797f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:18.268774 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b6dc6-d433-4a12-a1db-39dbf420cd6d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:18.320299 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7b614-bceb-41af-ac89-2d8f87fcfb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:18.321217 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7b614-bceb-41af-ac89-2d8f87fcfb29 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:18.321530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7b614-bceb-41af-ac89-2d8f87fcfb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:18.321813 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7b614-bceb-41af-ac89-2d8f87fcfb29 None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:18.323133 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df158b-baaa-464b-8ec2-3979b0c00674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:18.324104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df158b-baaa-464b-8ec2-3979b0c00674 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:18.324371 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df158b-baaa-464b-8ec2-3979b0c00674 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:18.324752 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df158b-baaa-464b-8ec2-3979b0c00674 None admin] PATH_INFO: `/v3/users/ea68495bc01f41d2b0c2e34799485fee` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:18.327101 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df158b-baaa-464b-8ec2-3979b0c00674 None admin] RBAC: Authorizing `identity:get_user(user_id=ea68495bc01f41d2b0c2e34799485fee)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:18.327543 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7b614-bceb-41af-ac89-2d8f87fcfb29 None admin] RBAC: Authorizing `identity:get_project(project_id=97a27564d6b5404fa22fe354151a49d1)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:18.329049 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7b614-bceb-41af-ac89-2d8f87fcfb29 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:18.330746 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df158b-baaa-464b-8ec2-3979b0c00674 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:18.335154 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 48/88] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:18 2022] GET /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:18.335620 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 41/89] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:18 2022] GET /identity/v3/users/ea68495bc01f41d2b0c2e34799485fee => generated 247 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:18.336428 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7b614-bceb-41af-ac89-2d8f87fcfb29 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:18.339176 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df158b-baaa-464b-8ec2-3979b0c00674 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:18.535500 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df158b-baaa-464b-8ec2-3979b0c00674 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:18.538312 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7b614-bceb-41af-ac89-2d8f87fcfb29 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:18.556399 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:18.581617 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:18.585020 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906d493-d022-4c97-87a6-e495628283a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:18.585947 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906d493-d022-4c97-87a6-e495628283a3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:18.586260 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906d493-d022-4c97-87a6-e495628283a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:18.586564 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906d493-d022-4c97-87a6-e495628283a3 None admin] PATH_INFO: `/v3/users/4e70b03ce9684918961bd5fcc34afa71` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:18.588484 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906d493-d022-4c97-87a6-e495628283a3 None admin] RBAC: Authorizing `identity:get_user(user_id=4e70b03ce9684918961bd5fcc34afa71)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:18.590002 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906d493-d022-4c97-87a6-e495628283a3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:18.592474 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de1344-b915-4d2e-a933-5051ea4492e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:18.593147 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de1344-b915-4d2e-a933-5051ea4492e0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:18.593457 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de1344-b915-4d2e-a933-5051ea4492e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:18.593738 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de1344-b915-4d2e-a933-5051ea4492e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:18.604911 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 49/90] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:18 2022] GET /identity/v3/users/4e70b03ce9684918961bd5fcc34afa71 => generated 275 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:18.605948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906d493-d022-4c97-87a6-e495628283a3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:18.730581 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de1344-b915-4d2e-a933-5051ea4492e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:18.734556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de1344-b915-4d2e-a933-5051ea4492e0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:18.818200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906d493-d022-4c97-87a6-e495628283a3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:18.861036 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01d3f0-e16e-4aff-9461-2891a5aaecd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:18.861740 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01d3f0-e16e-4aff-9461-2891a5aaecd5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:18.862027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01d3f0-e16e-4aff-9461-2891a5aaecd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:18.862302 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01d3f0-e16e-4aff-9461-2891a5aaecd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:18.863136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01d3f0-e16e-4aff-9461-2891a5aaecd5 None admin] RBAC: Adding query filter params (role.id=c8d1d9031cfc4ef8a0e62f6bfd7ff691, scope.project.id=97a27564d6b5404fa22fe354151a49d1, user.id=4e70b03ce9684918961bd5fcc34afa71) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:18.863450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01d3f0-e16e-4aff-9461-2891a5aaecd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:18.865475 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01d3f0-e16e-4aff-9461-2891a5aaecd5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:18.871647 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 50/91] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:28:18 2022] GET /identity/v3/role_assignments?user.id=4e70b03ce9684918961bd5fcc34afa71&scope.project.id=97a27564d6b5404fa22fe354151a49d1&role.id=c8d1d9031cfc4ef8a0e62f6bfd7ff691 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:18.872389 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01d3f0-e16e-4aff-9461-2891a5aaecd5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:18.960449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 42/92] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:28:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:18.965906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de1344-b915-4d2e-a933-5051ea4492e0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:18.977623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:19.021714 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:19.115955 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01d3f0-e16e-4aff-9461-2891a5aaecd5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:19.180217 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3800d-f244-4f59-a9be-46aeedb107d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:19.181383 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3800d-f244-4f59-a9be-46aeedb107d6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:19.181893 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3800d-f244-4f59-a9be-46aeedb107d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:19.182359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3800d-f244-4f59-a9be-46aeedb107d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:19.221038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de1344-b915-4d2e-a933-5051ea4492e0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:19.309156 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3800d-f244-4f59-a9be-46aeedb107d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:19.311841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3800d-f244-4f59-a9be-46aeedb107d6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:19.334541 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16e933-32ce-4887-9da1-e0fc9ae23710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:19.335852 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16e933-32ce-4887-9da1-e0fc9ae23710 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:19.336315 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16e933-32ce-4887-9da1-e0fc9ae23710 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:19.336786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16e933-32ce-4887-9da1-e0fc9ae23710 None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:19.342469 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16e933-32ce-4887-9da1-e0fc9ae23710 None admin] RBAC: Authorizing `identity:get_project(project_id=97a27564d6b5404fa22fe354151a49d1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:19.345068 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16e933-32ce-4887-9da1-e0fc9ae23710 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:19.348448 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 43/93] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:18 2022] GET /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1 => generated 298 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:19.358858 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16e933-32ce-4887-9da1-e0fc9ae23710 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:19.405660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:19.514279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 51/94] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:28:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:19.533734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3800d-f244-4f59-a9be-46aeedb107d6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:19.654038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:19.657656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16e933-32ce-4887-9da1-e0fc9ae23710 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:19.699203 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c501c-d454-4804-b6cb-018854f489de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:19.700249 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c501c-d454-4804-b6cb-018854f489de None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:19.700740 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c501c-d454-4804-b6cb-018854f489de None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:19.701226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c501c-d454-4804-b6cb-018854f489de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:19.702288 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c501c-d454-4804-b6cb-018854f489de None admin] RBAC: Adding query filter params (role.id=796e313fa8794ac885ccf6300d09332a, scope.project.id=97a27564d6b5404fa22fe354151a49d1, user.id=ea68495bc01f41d2b0c2e34799485fee) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:19.702818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c501c-d454-4804-b6cb-018854f489de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:19.704634 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c501c-d454-4804-b6cb-018854f489de None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:19.711415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 44/95] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:28:19 2022] GET /identity/v3/role_assignments?user.id=ea68495bc01f41d2b0c2e34799485fee&scope.project.id=97a27564d6b5404fa22fe354151a49d1&role.id=796e313fa8794ac885ccf6300d09332a => generated 259 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:19.774889 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3800d-f244-4f59-a9be-46aeedb107d6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:19.860911 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e103a-243c-4395-8270-5563025ac7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:19.862578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e103a-243c-4395-8270-5563025ac7be None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:19.863088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e103a-243c-4395-8270-5563025ac7be None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:19.863604 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e103a-243c-4395-8270-5563025ac7be None admin] PATH_INFO: `/v3/projects/d4f78c6be1b54c81b4fac96fbdef8f78` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:19.870809 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e103a-243c-4395-8270-5563025ac7be None admin] RBAC: Authorizing `identity:get_project(project_id=d4f78c6be1b54c81b4fac96fbdef8f78)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:19.873667 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e103a-243c-4395-8270-5563025ac7be None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:19.877152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 52/96] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:19 2022] GET /identity/v3/projects/d4f78c6be1b54c81b4fac96fbdef8f78 => generated 312 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:19.884053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c501c-d454-4804-b6cb-018854f489de None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:20.055822 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c501c-d454-4804-b6cb-018854f489de None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:20.109047 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3c45b-aefe-4dc8-aa24-555936ccf597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:20.110113 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3c45b-aefe-4dc8-aa24-555936ccf597 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:20.110625 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3c45b-aefe-4dc8-aa24-555936ccf597 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:20.111107 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3c45b-aefe-4dc8-aa24-555936ccf597 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:20.112140 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3c45b-aefe-4dc8-aa24-555936ccf597 None admin] RBAC: Adding query filter params (role.id=cdbaa8196c574e32a331e8d4faee1a7e, scope.project.id=d4f78c6be1b54c81b4fac96fbdef8f78, user.id=4e70b03ce9684918961bd5fcc34afa71) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:20.112656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3c45b-aefe-4dc8-aa24-555936ccf597 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:20.114375 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3c45b-aefe-4dc8-aa24-555936ccf597 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:20.122115 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 45/97] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:28:19 2022] GET /identity/v3/role_assignments?user.id=4e70b03ce9684918961bd5fcc34afa71&scope.project.id=d4f78c6be1b54c81b4fac96fbdef8f78&role.id=cdbaa8196c574e32a331e8d4faee1a7e => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:21.455344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809f2cf-d015-42c3-baea-131a47d2d2e6 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.456708 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809f2cf-d015-42c3-baea-131a47d2d2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.457457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809f2cf-d015-42c3-baea-131a47d2d2e6 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.460046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 53/98] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:21.467159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2e222-2cec-4c8a-952f-546ee52c7b9c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.468462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2e222-2cec-4c8a-952f-546ee52c7b9c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.469122 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2e222-2cec-4c8a-952f-546ee52c7b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.509385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a5e2e222-2cec-4c8a-952f-546ee52c7b9c None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:21.511872 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a5e2e222-2cec-4c8a-952f-546ee52c7b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:21.537850 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:21.661326 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ba0cd-8ae3-4691-a6cc-eaaa7c03ccbc None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.661565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 46/99] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:21.662413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ba0cd-8ae3-4691-a6cc-eaaa7c03ccbc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.663138 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ba0cd-8ae3-4691-a6cc-eaaa7c03ccbc None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.666531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 54/100] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:21.675558 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8b241-f66e-4347-9882-006540747986 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.676462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8b241-f66e-4347-9882-006540747986 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.677293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8b241-f66e-4347-9882-006540747986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.696936 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ba0cd-8ae3-4691-a6cc-eaaa7c03ccbc None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:21.706828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b4c8b241-f66e-4347-9882-006540747986 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:21.709339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b4c8b241-f66e-4347-9882-006540747986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:21.739574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:21.884382 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 47/101] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:21.886165 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730de09a-8ad6-42cc-8b36-9f602e8f317c None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.886673 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730de09a-8ad6-42cc-8b36-9f602e8f317c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.887186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730de09a-8ad6-42cc-8b36-9f602e8f317c None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.888670 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 48/102] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:21.894389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c82c84-09e8-4c7d-90a0-6619d45cd7f1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.894950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c82c84-09e8-4c7d-90a0-6619d45cd7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.895451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c82c84-09e8-4c7d-90a0-6619d45cd7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.914667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a0c82c84-09e8-4c7d-90a0-6619d45cd7f1 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:21.916227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a0c82c84-09e8-4c7d-90a0-6619d45cd7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:21.997041 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 49/103] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:21.998258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c82c84-09e8-4c7d-90a0-6619d45cd7f1 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:22.006843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:22.082349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ba0cd-8ae3-4691-a6cc-eaaa7c03ccbc None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:22.155368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c82c84-09e8-4c7d-90a0-6619d45cd7f1 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:22.197974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ba1da-7751-4041-b6eb-26395f33f29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:22.200194 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ba1da-7751-4041-b6eb-26395f33f29a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:22.200804 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ba1da-7751-4041-b6eb-26395f33f29a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:22.201409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ba1da-7751-4041-b6eb-26395f33f29a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:22.215682 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ba1da-7751-4041-b6eb-26395f33f29a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:22.224629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-1b2ba1da-7751-4041-b6eb-26395f33f29a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:22.224629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:22.224629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:22.224629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:22.224629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:22.224629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:22.224629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:22.224629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:22.224629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:22.224629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:22.224629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:22.224629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:22.224629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:22.224629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:22.224629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:22.224629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:22.225565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:22.225565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:22.225565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:22.225565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:22.225565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:22.225565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:22.225565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:22.225565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:22.225565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:22.225565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:22.225565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:22.225565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:28:22.225565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:22.225565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:22.225565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:22.225565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:22.226340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:22.226340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:22.226340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:22.226340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:22.226340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:22.226340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:22.226340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:22.226340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:22.226340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:22.226340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:22.226340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:22.226340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:28:22.228835 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 50/104] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:22.234239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ba1da-7751-4041-b6eb-26395f33f29a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:22.237981 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732ca17-abfd-4df0-8836-9f4f362cc943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:22.238804 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732ca17-abfd-4df0-8836-9f4f362cc943 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:22.239090 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732ca17-abfd-4df0-8836-9f4f362cc943 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:22.239366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732ca17-abfd-4df0-8836-9f4f362cc943 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:22.240878 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732ca17-abfd-4df0-8836-9f4f362cc943 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:22.243461 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732ca17-abfd-4df0-8836-9f4f362cc943 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:22.245681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 55/105] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:28:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 550 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:22.246809 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732ca17-abfd-4df0-8836-9f4f362cc943 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:22.313502 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:22.363174 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ba1da-7751-4041-b6eb-26395f33f29a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:22.410018 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbe09e-dc83-4dc6-ba52-2f261e33275e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:22.411847 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbe09e-dc83-4dc6-ba52-2f261e33275e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:22.412371 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbe09e-dc83-4dc6-ba52-2f261e33275e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:22.413437 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbe09e-dc83-4dc6-ba52-2f261e33275e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:22.427583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbe09e-dc83-4dc6-ba52-2f261e33275e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:22.438015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-2dcbe09e-dc83-4dc6-ba52-2f261e33275e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:22.438015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:22.438015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:22.438015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:22.438015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:22.438015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:22.438015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:22.438015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:22.438015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:22.438015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:22.438015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:22.438015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:22.438015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:22.438015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:22.438015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:22.438015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:22.438943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:22.438943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:22.438943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:22.438943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:22.438943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:22.438943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:22.438943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:22.438943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:22.438943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:22.438943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:22.438943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:22.438943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:28:22.438943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:22.438943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:22.438943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:22.438943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:22.439727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:22.439727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:22.439727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:22.439727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:22.439727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:22.439727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:22.439727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:22.439727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:22.439727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:22.439727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:22.439727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:22.439727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:28:22.441916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 51/106] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:22.443183 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbe09e-dc83-4dc6-ba52-2f261e33275e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:22.487648 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:22.543303 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732ca17-abfd-4df0-8836-9f4f362cc943 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:22.572433 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbe09e-dc83-4dc6-ba52-2f261e33275e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:22.605707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:22.613763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a5128-a553-44ff-919d-f80247677864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:22.625574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a5128-a553-44ff-919d-f80247677864 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:22.625574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a5128-a553-44ff-919d-f80247677864 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:22.625574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a5128-a553-44ff-919d-f80247677864 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:22.625574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a5128-a553-44ff-919d-f80247677864 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:22.625574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a5128-a553-44ff-919d-f80247677864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:22.625574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a5128-a553-44ff-919d-f80247677864 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:22.626391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682993f-7b9f-419a-b89d-8624ebb60b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:22.626391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682993f-7b9f-419a-b89d-8624ebb60b17 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:22.626391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682993f-7b9f-419a-b89d-8624ebb60b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:22.626391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682993f-7b9f-419a-b89d-8624ebb60b17 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:22.626906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682993f-7b9f-419a-b89d-8624ebb60b17 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:22.629211 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682993f-7b9f-419a-b89d-8624ebb60b17 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:22.629917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 56/107] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:28:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:22.631595 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a5128-a553-44ff-919d-f80247677864 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:22.757025 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 52/108] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 16:28:22 2022] POST /identity/v3/projects => generated 302 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:22.757751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682993f-7b9f-419a-b89d-8624ebb60b17 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:22.787718 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a5128-a553-44ff-919d-f80247677864 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:22.834045 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac5589-b59a-4792-ae6f-503461270d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:22.835081 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac5589-b59a-4792-ae6f-503461270d3b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:22.835597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac5589-b59a-4792-ae6f-503461270d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:22.836078 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac5589-b59a-4792-ae6f-503461270d3b None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:22.838084 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac5589-b59a-4792-ae6f-503461270d3b None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:22.838752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac5589-b59a-4792-ae6f-503461270d3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:22.840482 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac5589-b59a-4792-ae6f-503461270d3b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:22.853425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 57/109] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:28:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:22.855594 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa7239-4c87-4609-8b93-4c3dd597397a None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:22.856124 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa7239-4c87-4609-8b93-4c3dd597397a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:22.856607 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa7239-4c87-4609-8b93-4c3dd597397a None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:22.858330 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 58/110] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:22.867389 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d09a4-303d-4c04-9839-fe669e826a21 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:22.868039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d09a4-303d-4c04-9839-fe669e826a21 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:22.868524 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d09a4-303d-4c04-9839-fe669e826a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:22.907498 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-874d09a4-303d-4c04-9839-fe669e826a21 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:22.908733 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-874d09a4-303d-4c04-9839-fe669e826a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:22.918609 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:22.972202 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682993f-7b9f-419a-b89d-8624ebb60b17 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:23.017683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dded5-f62e-4143-ab74-6cf42c08782d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:23.019576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dded5-f62e-4143-ab74-6cf42c08782d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:23.020100 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dded5-f62e-4143-ab74-6cf42c08782d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:23.021635 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dded5-f62e-4143-ab74-6cf42c08782d None admin] PATH_INFO: `/v3/users/6bd075a634f14ed0a0d81d19b7cc42bc` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:23.039874 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952dded5-f62e-4143-ab74-6cf42c08782d None admin] RBAC: Authorizing `identity:get_user(user_id=6bd075a634f14ed0a0d81d19b7cc42bc)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:23.041753 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952dded5-f62e-4143-ab74-6cf42c08782d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:23.044347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 53/111] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:22 2022] GET /identity/v3/users/6bd075a634f14ed0a0d81d19b7cc42bc => generated 289 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:23.045520 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dded5-f62e-4143-ab74-6cf42c08782d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:23.093505 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:23.097384 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 59/112] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:23.098329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d09a4-303d-4c04-9839-fe669e826a21 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:23.183829 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dded5-f62e-4143-ab74-6cf42c08782d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:23.222557 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde70ec3-e261-40ef-9761-6f2f680b71d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:23.224504 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde70ec3-e261-40ef-9761-6f2f680b71d8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:23.224993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde70ec3-e261-40ef-9761-6f2f680b71d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:23.225513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde70ec3-e261-40ef-9761-6f2f680b71d8 None admin] PATH_INFO: `/v3/users/4e70b03ce9684918961bd5fcc34afa71` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:23.227145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde70ec3-e261-40ef-9761-6f2f680b71d8 None admin] RBAC: Authorizing `identity:get_user(user_id=4e70b03ce9684918961bd5fcc34afa71)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:23.228937 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde70ec3-e261-40ef-9761-6f2f680b71d8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:23.231053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 54/113] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:23 2022] GET /identity/v3/users/4e70b03ce9684918961bd5fcc34afa71 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:23.232038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde70ec3-e261-40ef-9761-6f2f680b71d8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:23.244976 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d09a4-303d-4c04-9839-fe669e826a21 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:23.297104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86d978-cd59-421b-b2c2-40f1db1e1d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:23.298442 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86d978-cd59-421b-b2c2-40f1db1e1d13 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:23.298932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86d978-cd59-421b-b2c2-40f1db1e1d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:23.299614 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86d978-cd59-421b-b2c2-40f1db1e1d13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:23.311594 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:23.369343 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde70ec3-e261-40ef-9761-6f2f680b71d8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:23.371864 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:23.420066 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e652373-8537-442f-966e-c7bbfd2acd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:23.421486 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e652373-8537-442f-966e-c7bbfd2acd9a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:23.421752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86d978-cd59-421b-b2c2-40f1db1e1d13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:23.422122 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e652373-8537-442f-966e-c7bbfd2acd9a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:23.422547 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e652373-8537-442f-966e-c7bbfd2acd9a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:23.424865 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86d978-cd59-421b-b2c2-40f1db1e1d13 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:23.438007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e652373-8537-442f-966e-c7bbfd2acd9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:23.450317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-5e652373-8537-442f-966e-c7bbfd2acd9a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:23.450317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:23.450317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:23.450317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:23.450317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:23.450317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:23.450317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:23.450317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:23.450317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:23.450317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:23.450317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:23.450317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:23.450317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:23.450317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:23.450317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:23.450317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:23.451415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:23.451415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:23.451415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:23.451415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:23.451415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:23.451415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:23.451415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:23.451415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:23.451415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:23.451415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:23.451415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:23.451415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:28:23.451415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:23.451415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:23.451415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:23.451415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:23.452389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:23.452389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:23.452389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:23.452389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:23.452389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:23.452389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:23.452389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:23.452389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:23.452389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:23.452389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:23.452389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:23.452389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:28:23.455142 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 55/114] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 16:28:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:23.456353 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e652373-8537-442f-966e-c7bbfd2acd9a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:23.550001 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 60/115] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:28:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:23.551615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245e16f-a6e5-4095-b6ee-17239726323c None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:23.552628 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245e16f-a6e5-4095-b6ee-17239726323c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:23.552921 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245e16f-a6e5-4095-b6ee-17239726323c None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:23.554349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 61/116] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:23.559043 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245e16f-a6e5-4095-b6ee-17239726323c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:23.576603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e652373-8537-442f-966e-c7bbfd2acd9a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:23.610984 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:23.638239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf14fbc-9c2e-48f0-9b34-2dd6a4906a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:23.638239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf14fbc-9c2e-48f0-9b34-2dd6a4906a31 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:23.638239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf14fbc-9c2e-48f0-9b34-2dd6a4906a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:23.638239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf14fbc-9c2e-48f0-9b34-2dd6a4906a31 None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:23.638819 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf14fbc-9c2e-48f0-9b34-2dd6a4906a31 None admin] RBAC: Authorizing `identity:get_project(project_id=97a27564d6b5404fa22fe354151a49d1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:23.638819 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf14fbc-9c2e-48f0-9b34-2dd6a4906a31 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:23.638819 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 56/117] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:23 2022] GET /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:23.638819 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3de623-d7a0-4505-aa3f-7051f7c954ad None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:23.638819 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3de623-d7a0-4505-aa3f-7051f7c954ad None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:23.638819 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3de623-d7a0-4505-aa3f-7051f7c954ad None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:23.641905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 57/118] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:23 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:23.642793 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3de623-d7a0-4505-aa3f-7051f7c954ad None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:23.676324 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:23.701227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245e16f-a6e5-4095-b6ee-17239726323c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:23.746396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892303ab-522a-417b-8f38-297ec225cf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:23.747285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892303ab-522a-417b-8f38-297ec225cf29 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:23.747440 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892303ab-522a-417b-8f38-297ec225cf29 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:23.747704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892303ab-522a-417b-8f38-297ec225cf29 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:23.748368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892303ab-522a-417b-8f38-297ec225cf29 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:23.748674 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892303ab-522a-417b-8f38-297ec225cf29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:23.750090 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892303ab-522a-417b-8f38-297ec225cf29 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:23.759353 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 62/119] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:28:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:23.764866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d009faa-8ed4-4ee1-bfa0-c9011215854f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:23.765200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d009faa-8ed4-4ee1-bfa0-c9011215854f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:23.765502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d009faa-8ed4-4ee1-bfa0-c9011215854f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:23.769857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3de623-d7a0-4505-aa3f-7051f7c954ad None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:23.783328 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8d009faa-8ed4-4ee1-bfa0-c9011215854f None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:23.784521 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8d009faa-8ed4-4ee1-bfa0-c9011215854f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:23.817353 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800a9c0-470a-4a7d-807c-c4e4e55a7efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:23.819281 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800a9c0-470a-4a7d-807c-c4e4e55a7efe None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:23.819914 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800a9c0-470a-4a7d-807c-c4e4e55a7efe None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:23.820404 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800a9c0-470a-4a7d-807c-c4e4e55a7efe None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:23.828096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800a9c0-470a-4a7d-807c-c4e4e55a7efe None admin] RBAC: Authorizing `identity:get_project(project_id=97a27564d6b5404fa22fe354151a49d1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:23.830684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800a9c0-470a-4a7d-807c-c4e4e55a7efe None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:23.841569 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 58/120] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:23 2022] GET /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:23.842719 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800a9c0-470a-4a7d-807c-c4e4e55a7efe None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:23.862626 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 63/121] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:23.874743 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ef1f8-3f0b-4649-b882-d36d805fccbb None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:23.875113 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ef1f8-3f0b-4649-b882-d36d805fccbb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:23.875578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ef1f8-3f0b-4649-b882-d36d805fccbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:23.897666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d94ef1f8-3f0b-4649-b882-d36d805fccbb None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:23.898936 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d94ef1f8-3f0b-4649-b882-d36d805fccbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:23.930519 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:23.970247 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:23.977889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800a9c0-470a-4a7d-807c-c4e4e55a7efe None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:23.979693 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 64/122] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:23.983127 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ef1f8-3f0b-4649-b882-d36d805fccbb None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:24.029565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c9304-9f54-44ac-891a-ae717b46bc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:24.030638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c9304-9f54-44ac-891a-ae717b46bc38 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:24.031024 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c9304-9f54-44ac-891a-ae717b46bc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:24.031403 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c9304-9f54-44ac-891a-ae717b46bc38 None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1/users/4e70b03ce9684918961bd5fcc34afa71/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:24.033548 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c9304-9f54-44ac-891a-ae717b46bc38 None admin] RBAC: Authorizing `identity:create_grant(project_id=97a27564d6b5404fa22fe354151a49d1, user_id=4e70b03ce9684918961bd5fcc34afa71, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:24.035129 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c9304-9f54-44ac-891a-ae717b46bc38 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:24.099066 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ef1f8-3f0b-4649-b882-d36d805fccbb None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:24.105609 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 59/123] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:28:23 2022] PUT /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1/users/4e70b03ce9684918961bd5fcc34afa71/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:24.105609 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c9304-9f54-44ac-891a-ae717b46bc38 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:24.157886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3fc75-6a48-4bb2-8931-5690c5c9e9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:24.158681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3fc75-6a48-4bb2-8931-5690c5c9e9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:24.158967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3fc75-6a48-4bb2-8931-5690c5c9e9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:24.159247 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3fc75-6a48-4bb2-8931-5690c5c9e9b4 None admin] PATH_INFO: `/v3/users/4e70b03ce9684918961bd5fcc34afa71` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:24.160635 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3fc75-6a48-4bb2-8931-5690c5c9e9b4 None admin] RBAC: Authorizing `identity:get_user(user_id=4e70b03ce9684918961bd5fcc34afa71)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:24.162294 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3fc75-6a48-4bb2-8931-5690c5c9e9b4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:24.164518 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 65/124] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:23 2022] GET /identity/v3/users/4e70b03ce9684918961bd5fcc34afa71 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:24.165178 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3fc75-6a48-4bb2-8931-5690c5c9e9b4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:24.206963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:24.300539 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c9304-9f54-44ac-891a-ae717b46bc38 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:24.308551 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3fc75-6a48-4bb2-8931-5690c5c9e9b4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:24.355300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff8d2c-f2c4-4a33-b946-cf694340a94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:24.355650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff8d2c-f2c4-4a33-b946-cf694340a94c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:24.355958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff8d2c-f2c4-4a33-b946-cf694340a94c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:24.356141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff8d2c-f2c4-4a33-b946-cf694340a94c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:24.375057 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff8d2c-f2c4-4a33-b946-cf694340a94c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:24.382730 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a82650-7b8d-480f-b13b-f60945601910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:24.383739 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a82650-7b8d-480f-b13b-f60945601910 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:24.384208 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a82650-7b8d-480f-b13b-f60945601910 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:24.384664 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a82650-7b8d-480f-b13b-f60945601910 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:24.385775 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a82650-7b8d-480f-b13b-f60945601910 None admin] RBAC: Adding query filter params (role.id=ab11da387f674277a602ab6e1e7e5b44, scope.project.id=97a27564d6b5404fa22fe354151a49d1, user.id=6bd075a634f14ed0a0d81d19b7cc42bc) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:24.390876 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a82650-7b8d-480f-b13b-f60945601910 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:24.390876 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a82650-7b8d-480f-b13b-f60945601910 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:24.391408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6fff8d2c-f2c4-4a33-b946-cf694340a94c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:24.391408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:24.391408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:24.391408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:24.391408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:24.391408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:24.391408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:24.391408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:24.391408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:24.391408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:24.391408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:24.391408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:24.391408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:24.391408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:24.391408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:24.391408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:24.392953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:24.392953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:24.392953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:24.392953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:24.392953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:24.392953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:24.392953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:24.392953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:24.392953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:24.392953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:24.392953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:24.392953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:28:24.392953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:24.392953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:24.392953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:24.392953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:24.396050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:24.396050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:24.396050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:24.396050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:24.396050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:24.396050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:24.396050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:24.396050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:24.396050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:24.396050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:24.396050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:24.396050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:28:24.396050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 66/125] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:28:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:24.397308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 60/126] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:28:24 2022] GET /identity/v3/role_assignments?user.id=6bd075a634f14ed0a0d81d19b7cc42bc&scope.project.id=97a27564d6b5404fa22fe354151a49d1&role.id=ab11da387f674277a602ab6e1e7e5b44 => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:24.400342 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff8d2c-f2c4-4a33-b946-cf694340a94c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:24.400582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a82650-7b8d-480f-b13b-f60945601910 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:24.447512 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:24.584230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:24.586674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a82650-7b8d-480f-b13b-f60945601910 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:24.607950 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff8d2c-f2c4-4a33-b946-cf694340a94c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:24.625432 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec91199-46f1-4353-ba80-50f5ec52002e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:24.626319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec91199-46f1-4353-ba80-50f5ec52002e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:24.626601 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec91199-46f1-4353-ba80-50f5ec52002e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:24.626899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec91199-46f1-4353-ba80-50f5ec52002e None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:24.628150 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec91199-46f1-4353-ba80-50f5ec52002e None admin] RBAC: Authorizing `identity:get_project(project_id=97a27564d6b5404fa22fe354151a49d1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:24.629740 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec91199-46f1-4353-ba80-50f5ec52002e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:24.637774 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 61/127] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:24 2022] GET /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:24.638998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec91199-46f1-4353-ba80-50f5ec52002e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:24.688629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad29ac1-2f0e-44cb-9c13-3d2f104c6bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:24.689683 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad29ac1-2f0e-44cb-9c13-3d2f104c6bfe None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:24.691334 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad29ac1-2f0e-44cb-9c13-3d2f104c6bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:24.691737 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad29ac1-2f0e-44cb-9c13-3d2f104c6bfe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:24.714556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad29ac1-2f0e-44cb-9c13-3d2f104c6bfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:24.737933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-cad29ac1-2f0e-44cb-9c13-3d2f104c6bfe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:24.737933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:24.737933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:24.737933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:24.737933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:24.737933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:24.737933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:24.737933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:24.737933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:24.737933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:24.737933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:24.737933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:24.737933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:24.737933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:24.737933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:24.737933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:24.739949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:24.739949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:24.739949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:24.739949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:24.739949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:24.739949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:24.739949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:24.739949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:24.739949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:24.739949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:24.739949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:24.739949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:28:24.739949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:24.739949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:24.739949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:24.739949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:24.741786 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:24.741786 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:24.741786 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:24.741786 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:24.741786 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:24.741786 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:24.741786 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:24.741786 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:24.741786 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:24.741786 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:24.741786 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:24.741786 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:28:24.744219 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 67/128] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:24.745546 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad29ac1-2f0e-44cb-9c13-3d2f104c6bfe None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:24.797963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:24.814347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec91199-46f1-4353-ba80-50f5ec52002e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:24.877583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a01d75-df27-4f02-8db4-15e43a5049b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:24.878998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a01d75-df27-4f02-8db4-15e43a5049b3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:24.879698 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a01d75-df27-4f02-8db4-15e43a5049b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:24.880464 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a01d75-df27-4f02-8db4-15e43a5049b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:24.882229 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a01d75-df27-4f02-8db4-15e43a5049b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:24.882978 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a01d75-df27-4f02-8db4-15e43a5049b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:24.885783 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a01d75-df27-4f02-8db4-15e43a5049b3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:24.912306 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 62/129] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:24.915339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a01d75-df27-4f02-8db4-15e43a5049b3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:24.978103 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad29ac1-2f0e-44cb-9c13-3d2f104c6bfe None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:25.046212 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d1fd1-5f84-49c8-84b8-02a2e8b83ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:25.047298 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d1fd1-5f84-49c8-84b8-02a2e8b83ff0 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.047686 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d1fd1-5f84-49c8-84b8-02a2e8b83ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.048064 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d1fd1-5f84-49c8-84b8-02a2e8b83ff0 None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1/users/4e70b03ce9684918961bd5fcc34afa71/roles/c8d1d9031cfc4ef8a0e62f6bfd7ff691` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.050570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d1fd1-5f84-49c8-84b8-02a2e8b83ff0 None admin] RBAC: Authorizing `identity:create_grant(project_id=97a27564d6b5404fa22fe354151a49d1, user_id=4e70b03ce9684918961bd5fcc34afa71, role_id=c8d1d9031cfc4ef8a0e62f6bfd7ff691)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:25.060564 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d1fd1-5f84-49c8-84b8-02a2e8b83ff0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:25.063955 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a01d75-df27-4f02-8db4-15e43a5049b3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:25.102480 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22034112-0863-40be-8f5d-8cb98af27f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:25.103407 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22034112-0863-40be-8f5d-8cb98af27f93 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.130799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22034112-0863-40be-8f5d-8cb98af27f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.130799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22034112-0863-40be-8f5d-8cb98af27f93 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.130799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22034112-0863-40be-8f5d-8cb98af27f93 None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:25.130799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22034112-0863-40be-8f5d-8cb98af27f93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:25.130799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22034112-0863-40be-8f5d-8cb98af27f93 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:25.130799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 63/130] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:28:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:25.131465 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22034112-0863-40be-8f5d-8cb98af27f93 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:25.134821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:25.183318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 68/131] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:28:24 2022] PUT /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1/users/4e70b03ce9684918961bd5fcc34afa71/roles/c8d1d9031cfc4ef8a0e62f6bfd7ff691 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:25.183901 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d1fd1-5f84-49c8-84b8-02a2e8b83ff0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:25.213847 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:25.233573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22034112-0863-40be-8f5d-8cb98af27f93 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:25.279130 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf75bc-c263-469e-948e-a4905d460768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:25.280039 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf75bc-c263-469e-948e-a4905d460768 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.280304 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf75bc-c263-469e-948e-a4905d460768 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.280579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf75bc-c263-469e-948e-a4905d460768 None admin] PATH_INFO: `/v3/users/ea68495bc01f41d2b0c2e34799485fee` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.281963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf75bc-c263-469e-948e-a4905d460768 None admin] RBAC: Authorizing `identity:get_user(user_id=ea68495bc01f41d2b0c2e34799485fee)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:25.283642 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf75bc-c263-469e-948e-a4905d460768 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:25.285847 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 64/132] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:25 2022] GET /identity/v3/users/ea68495bc01f41d2b0c2e34799485fee => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:25.294868 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf75bc-c263-469e-948e-a4905d460768 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:25.455128 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d1fd1-5f84-49c8-84b8-02a2e8b83ff0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:25.484650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:25.501023 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf75bc-c263-469e-948e-a4905d460768 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:25.541877 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f0506-db4f-480d-bd51-40c750bef03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:25.542894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f0506-db4f-480d-bd51-40c750bef03a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.543316 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f0506-db4f-480d-bd51-40c750bef03a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.543600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f0506-db4f-480d-bd51-40c750bef03a None admin] PATH_INFO: `/v3/users/4e70b03ce9684918961bd5fcc34afa71` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.544342 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6c8bb-7782-4299-9fad-6e80f268d8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:25.544858 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f0506-db4f-480d-bd51-40c750bef03a None admin] RBAC: Authorizing `identity:get_user(user_id=4e70b03ce9684918961bd5fcc34afa71)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:25.545383 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6c8bb-7782-4299-9fad-6e80f268d8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.545675 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6c8bb-7782-4299-9fad-6e80f268d8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.545963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6c8bb-7782-4299-9fad-6e80f268d8c9 None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.546380 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f0506-db4f-480d-bd51-40c750bef03a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:25.547663 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6c8bb-7782-4299-9fad-6e80f268d8c9 None admin] RBAC: Authorizing `identity:get_project(project_id=97a27564d6b5404fa22fe354151a49d1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:25.548429 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 69/133] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:25 2022] GET /identity/v3/users/4e70b03ce9684918961bd5fcc34afa71 => generated 275 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:25.550218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6c8bb-7782-4299-9fad-6e80f268d8c9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:25.553329 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 65/134] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:25 2022] GET /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:25.554283 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f0506-db4f-480d-bd51-40c750bef03a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:25.561986 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6c8bb-7782-4299-9fad-6e80f268d8c9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:25.692956 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6c8bb-7782-4299-9fad-6e80f268d8c9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:25.735907 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743c0f5-16ad-4e1b-971b-e84f0e4b047e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:25.736737 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743c0f5-16ad-4e1b-971b-e84f0e4b047e None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.737025 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743c0f5-16ad-4e1b-971b-e84f0e4b047e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.737353 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743c0f5-16ad-4e1b-971b-e84f0e4b047e None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1/users/ea68495bc01f41d2b0c2e34799485fee/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.739937 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743c0f5-16ad-4e1b-971b-e84f0e4b047e None admin] RBAC: Authorizing `identity:create_grant(project_id=97a27564d6b5404fa22fe354151a49d1, user_id=ea68495bc01f41d2b0c2e34799485fee, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:25.741480 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743c0f5-16ad-4e1b-971b-e84f0e4b047e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:25.741593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:25.774419 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f0506-db4f-480d-bd51-40c750bef03a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:25.820173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c074be-ac6c-44cb-b5b9-0719c25bc749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:25.821172 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c074be-ac6c-44cb-b5b9-0719c25bc749 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.821499 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c074be-ac6c-44cb-b5b9-0719c25bc749 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.822275 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c074be-ac6c-44cb-b5b9-0719c25bc749 None admin] PATH_INFO: `/v3/projects/d4f78c6be1b54c81b4fac96fbdef8f78` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.824092 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c074be-ac6c-44cb-b5b9-0719c25bc749 None admin] RBAC: Authorizing `identity:get_project(project_id=d4f78c6be1b54c81b4fac96fbdef8f78)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:25.825832 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c074be-ac6c-44cb-b5b9-0719c25bc749 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:25.828086 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 70/135] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:25 2022] GET /identity/v3/projects/d4f78c6be1b54c81b4fac96fbdef8f78 => generated 312 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:25.834549 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c074be-ac6c-44cb-b5b9-0719c25bc749 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:25.897711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 66/136] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:28:25 2022] PUT /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1/users/ea68495bc01f41d2b0c2e34799485fee/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:25.900016 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707f0bd-2278-4c2b-b626-1c907aae5a8a None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.900441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707f0bd-2278-4c2b-b626-1c907aae5a8a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.900969 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707f0bd-2278-4c2b-b626-1c907aae5a8a None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.902673 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 67/137] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:25.910285 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcfb81-490c-461e-9460-f4d517f24a1d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.911193 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcfb81-490c-461e-9460-f4d517f24a1d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.911587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcfb81-490c-461e-9460-f4d517f24a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.935606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8edcfb81-490c-461e-9460-f4d517f24a1d None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:25.937936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8edcfb81-490c-461e-9460-f4d517f24a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:25.941532 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:25.986483 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c074be-ac6c-44cb-b5b9-0719c25bc749 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:26.027891 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 68/138] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:26.062021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcfb81-490c-461e-9460-f4d517f24a1d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:26.069743 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147c959-35d9-4359-b791-e24be000413a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:26.070913 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147c959-35d9-4359-b791-e24be000413a None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:26.071347 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147c959-35d9-4359-b791-e24be000413a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:26.071771 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147c959-35d9-4359-b791-e24be000413a None admin] PATH_INFO: `/v3/projects/d4f78c6be1b54c81b4fac96fbdef8f78/users/4e70b03ce9684918961bd5fcc34afa71/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:26.074495 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147c959-35d9-4359-b791-e24be000413a None admin] RBAC: Authorizing `identity:create_grant(project_id=d4f78c6be1b54c81b4fac96fbdef8f78, user_id=4e70b03ce9684918961bd5fcc34afa71, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:26.076173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147c959-35d9-4359-b791-e24be000413a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:26.158980 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 71/139] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:28:25 2022] PUT /identity/v3/projects/d4f78c6be1b54c81b4fac96fbdef8f78/users/4e70b03ce9684918961bd5fcc34afa71/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:26.219282 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcfb81-490c-461e-9460-f4d517f24a1d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:26.270904 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a7ac5-b2b6-4bde-8d2d-650391f82fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:26.271893 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a7ac5-b2b6-4bde-8d2d-650391f82fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:26.272180 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a7ac5-b2b6-4bde-8d2d-650391f82fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:26.272457 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a7ac5-b2b6-4bde-8d2d-650391f82fc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:26.273746 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a7ac5-b2b6-4bde-8d2d-650391f82fc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:26.275251 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a7ac5-b2b6-4bde-8d2d-650391f82fc2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:26.276934 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 69/140] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:28:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:26.283149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147c959-35d9-4359-b791-e24be000413a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:26.288118 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:26.411572 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147c959-35d9-4359-b791-e24be000413a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:26.452100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6bc64-d6c5-4df4-ab52-cfbf0d97635d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:26.452800 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6bc64-d6c5-4df4-ab52-cfbf0d97635d None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:26.453091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6bc64-d6c5-4df4-ab52-cfbf0d97635d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:26.453407 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6bc64-d6c5-4df4-ab52-cfbf0d97635d None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:26.454229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6bc64-d6c5-4df4-ab52-cfbf0d97635d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:26.455782 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6bc64-d6c5-4df4-ab52-cfbf0d97635d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:26.560532 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 72/141] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 16:28:26 2022] POST /identity/v3/users => generated 283 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:27.580297 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d01490-d3f9-4307-8544-e422149f9ce0 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:27.580803 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d01490-d3f9-4307-8544-e422149f9ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:27.581290 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d01490-d3f9-4307-8544-e422149f9ce0 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:27.584723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 70/142] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:27.590544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bc945-5afa-4778-a648-9f62afc6b4ee None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:27.591410 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bc945-5afa-4778-a648-9f62afc6b4ee None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:27.591846 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bc945-5afa-4778-a648-9f62afc6b4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:27.612851 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-db1bc945-5afa-4778-a648-9f62afc6b4ee None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:27.614390 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-db1bc945-5afa-4778-a648-9f62afc6b4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:27.681799 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:27.694621 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 73/143] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:27.730479 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d01490-d3f9-4307-8544-e422149f9ce0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:27.742576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:27.844938 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d01490-d3f9-4307-8544-e422149f9ce0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:27.894793 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f09d83-710f-400b-afe6-586be2558b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:27.895644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f09d83-710f-400b-afe6-586be2558b4a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:27.895927 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f09d83-710f-400b-afe6-586be2558b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:27.896201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f09d83-710f-400b-afe6-586be2558b4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:27.911455 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f09d83-710f-400b-afe6-586be2558b4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:27.919397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-56f09d83-710f-400b-afe6-586be2558b4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:27.919397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:27.919397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:27.919397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:27.919397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:27.919397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:27.919397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:27.919397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:27.919397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:27.919397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:27.919397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:27.919397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:27.919397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:27.919397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:27.919397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:27.919397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:27.920218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:27.920218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:27.920218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:27.920218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:27.920218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:27.920218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:27.920218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:27.920218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:27.920218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:27.920218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:27.920218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:27.920218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:28:27.920218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:27.920218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:27.920218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:27.920218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:27.921021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:27.921021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:27.921021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:27.921021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:27.921021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:27.921021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:27.921021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:27.921021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:27.921021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:27.921021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:27.921021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:27.921021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:28:27.921021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 71/144] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:27.927253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bc945-5afa-4778-a648-9f62afc6b4ee None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:28.002462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4a384-3c45-453b-9f9f-b3340d34da09 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.002806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4a384-3c45-453b-9f9f-b3340d34da09 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.003017 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4a384-3c45-453b-9f9f-b3340d34da09 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.004395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 72/145] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:28:28.018986 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0528cd-e0db-4b98-a900-8cbfb18aa05a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.019285 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0528cd-e0db-4b98-a900-8cbfb18aa05a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.019536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0528cd-e0db-4b98-a900-8cbfb18aa05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.046692 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-da0528cd-e0db-4b98-a900-8cbfb18aa05a None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:28.047913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-da0528cd-e0db-4b98-a900-8cbfb18aa05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:28.090025 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bc945-5afa-4778-a648-9f62afc6b4ee None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:28.162164 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02dc62-34ff-4992-a9a4-ea72df40e70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:28.162788 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02dc62-34ff-4992-a9a4-ea72df40e70f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.163076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02dc62-34ff-4992-a9a4-ea72df40e70f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.163356 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02dc62-34ff-4992-a9a4-ea72df40e70f None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.164609 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02dc62-34ff-4992-a9a4-ea72df40e70f None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:28.165086 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02dc62-34ff-4992-a9a4-ea72df40e70f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:28.166660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02dc62-34ff-4992-a9a4-ea72df40e70f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:28.175946 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 74/146] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:28:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:28.182224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02dc62-34ff-4992-a9a4-ea72df40e70f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:28.215963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:28.227936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 73/147] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:28.256746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:28.274428 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0528cd-e0db-4b98-a900-8cbfb18aa05a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:28.309537 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02dc62-34ff-4992-a9a4-ea72df40e70f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:28.362168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837dbf49-9235-4cbf-8215-2a372dc37030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:28.363116 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837dbf49-9235-4cbf-8215-2a372dc37030 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.363402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837dbf49-9235-4cbf-8215-2a372dc37030 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.363684 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837dbf49-9235-4cbf-8215-2a372dc37030 None admin] PATH_INFO: `/v3/users/4e70b03ce9684918961bd5fcc34afa71` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.365212 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837dbf49-9235-4cbf-8215-2a372dc37030 None admin] RBAC: Authorizing `identity:get_user(user_id=4e70b03ce9684918961bd5fcc34afa71)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:28.366742 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837dbf49-9235-4cbf-8215-2a372dc37030 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:28.368730 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 75/148] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:28 2022] GET /identity/v3/users/4e70b03ce9684918961bd5fcc34afa71 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:28.374298 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837dbf49-9235-4cbf-8215-2a372dc37030 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:28.533783 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837dbf49-9235-4cbf-8215-2a372dc37030 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:28.579343 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0528cd-e0db-4b98-a900-8cbfb18aa05a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:28.580035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:28.603852 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759a355-837b-4857-9748-ac15a5d277b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:28.604632 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759a355-837b-4857-9748-ac15a5d277b6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.604868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759a355-837b-4857-9748-ac15a5d277b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.605143 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759a355-837b-4857-9748-ac15a5d277b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.659291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340f201-bef6-4633-8a99-4d4ad38f9729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:28.660271 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340f201-bef6-4633-8a99-4d4ad38f9729 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.660561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340f201-bef6-4633-8a99-4d4ad38f9729 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.660837 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340f201-bef6-4633-8a99-4d4ad38f9729 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.683145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340f201-bef6-4633-8a99-4d4ad38f9729 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:28.696593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-a340f201-bef6-4633-8a99-4d4ad38f9729 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:28.696593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:28.696593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:28.696593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:28.696593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:28.696593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:28.696593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:28.696593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:28.696593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:28.696593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:28.696593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:28.696593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:28.696593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:28.696593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:28.696593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:28.696593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:28.697736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:28.697736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:28.697736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:28.697736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:28.697736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:28.697736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:28.697736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:28.697736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:28.697736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:28.697736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:28.697736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:28.697736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:28:28.697736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:28.697736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:28.697736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:28.697736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:28.698644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:28.698644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:28.698644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:28.698644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:28.698644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:28.698644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:28.698644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:28.698644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:28.698644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:28.698644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:28.698644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:28.698644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:28:28.701088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 74/149] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:28.707135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340f201-bef6-4633-8a99-4d4ad38f9729 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:28.765279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759a355-837b-4857-9748-ac15a5d277b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:28.771448 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759a355-837b-4857-9748-ac15a5d277b6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:28.813732 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:28.914012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340f201-bef6-4633-8a99-4d4ad38f9729 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:28.960230 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422ecf9-ed78-4631-b38a-045a64ef2248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:28.961369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422ecf9-ed78-4631-b38a-045a64ef2248 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.961878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422ecf9-ed78-4631-b38a-045a64ef2248 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.962358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422ecf9-ed78-4631-b38a-045a64ef2248 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.963308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422ecf9-ed78-4631-b38a-045a64ef2248 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:28.963810 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422ecf9-ed78-4631-b38a-045a64ef2248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:28.964729 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 76/150] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:28:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:28:28.965834 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422ecf9-ed78-4631-b38a-045a64ef2248 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:28.966640 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddacc13-34d6-4c4e-8189-e76f35b2f09a None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.967137 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddacc13-34d6-4c4e-8189-e76f35b2f09a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.967724 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddacc13-34d6-4c4e-8189-e76f35b2f09a None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.969688 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 77/151] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:28.970639 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddacc13-34d6-4c4e-8189-e76f35b2f09a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:28.983915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 75/152] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:28:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:28.985491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773f4ce-0fe0-4c75-ba55-a01e4838772f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.985941 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773f4ce-0fe0-4c75-ba55-a01e4838772f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.986369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773f4ce-0fe0-4c75-ba55-a01e4838772f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:29.011847 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:29.018317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b773f4ce-0fe0-4c75-ba55-a01e4838772f None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:29.019777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b773f4ce-0fe0-4c75-ba55-a01e4838772f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:29.126603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddacc13-34d6-4c4e-8189-e76f35b2f09a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:29.159319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 76/153] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:29.160546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773f4ce-0fe0-4c75-ba55-a01e4838772f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:29.183089 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10f98d-e854-4cdb-87fb-eb814cd26e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:29.184525 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10f98d-e854-4cdb-87fb-eb814cd26e01 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:29.185019 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10f98d-e854-4cdb-87fb-eb814cd26e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:29.185552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10f98d-e854-4cdb-87fb-eb814cd26e01 None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:29.187035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10f98d-e854-4cdb-87fb-eb814cd26e01 None admin] RBAC: Authorizing `identity:get_project(project_id=97a27564d6b5404fa22fe354151a49d1)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:29.188719 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10f98d-e854-4cdb-87fb-eb814cd26e01 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:29.191175 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 78/154] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:28 2022] GET /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:29.197174 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10f98d-e854-4cdb-87fb-eb814cd26e01 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:29.254721 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:29.341299 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773f4ce-0fe0-4c75-ba55-a01e4838772f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:29.385740 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:29.424748 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10f98d-e854-4cdb-87fb-eb814cd26e01 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:29.429850 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8c421-2e93-4c03-a9dd-8c8e1ce8146b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:29.429850 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8c421-2e93-4c03-a9dd-8c8e1ce8146b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:29.429850 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8c421-2e93-4c03-a9dd-8c8e1ce8146b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:29.429850 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8c421-2e93-4c03-a9dd-8c8e1ce8146b None admin] PATH_INFO: `/v3/users/6bd075a634f14ed0a0d81d19b7cc42bc` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:29.434098 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8c421-2e93-4c03-a9dd-8c8e1ce8146b None admin] RBAC: Authorizing `identity:get_user(user_id=6bd075a634f14ed0a0d81d19b7cc42bc)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:29.435610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8c421-2e93-4c03-a9dd-8c8e1ce8146b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:29.437364 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 77/155] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:29 2022] GET /identity/v3/users/6bd075a634f14ed0a0d81d19b7cc42bc => generated 289 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:29.438324 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8c421-2e93-4c03-a9dd-8c8e1ce8146b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:29.518042 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900c49f-28ec-4823-8e18-3945cb2fd73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:29.519132 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900c49f-28ec-4823-8e18-3945cb2fd73a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:29.519617 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900c49f-28ec-4823-8e18-3945cb2fd73a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:29.520107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900c49f-28ec-4823-8e18-3945cb2fd73a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:29.521705 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900c49f-28ec-4823-8e18-3945cb2fd73a None admin] RBAC: Adding query filter params (role.id=cdbaa8196c574e32a331e8d4faee1a7e, scope.project.id=97a27564d6b5404fa22fe354151a49d1, user.id=4e70b03ce9684918961bd5fcc34afa71) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:29.522289 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900c49f-28ec-4823-8e18-3945cb2fd73a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:29.523965 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900c49f-28ec-4823-8e18-3945cb2fd73a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:29.530846 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 79/156] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:28:29 2022] GET /identity/v3/role_assignments?user.id=4e70b03ce9684918961bd5fcc34afa71&scope.project.id=97a27564d6b5404fa22fe354151a49d1&role.id=cdbaa8196c574e32a331e8d4faee1a7e => generated 608 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:29.537463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900c49f-28ec-4823-8e18-3945cb2fd73a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:29.673921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8c421-2e93-4c03-a9dd-8c8e1ce8146b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:29.720814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:29.729116 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900c49f-28ec-4823-8e18-3945cb2fd73a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:29.772885 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e81490-41c3-4bd3-a63a-01c9169bf25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:29.774016 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e81490-41c3-4bd3-a63a-01c9169bf25b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:29.774613 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e81490-41c3-4bd3-a63a-01c9169bf25b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:29.775119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e81490-41c3-4bd3-a63a-01c9169bf25b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:29.794992 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f863c1-6ba4-4ab5-aa41-9deecfb68bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:29.795893 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f863c1-6ba4-4ab5-aa41-9deecfb68bea None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:29.796170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f863c1-6ba4-4ab5-aa41-9deecfb68bea None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:29.796444 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f863c1-6ba4-4ab5-aa41-9deecfb68bea None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:29.798107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f863c1-6ba4-4ab5-aa41-9deecfb68bea None admin] RBAC: Authorizing `identity:get_project(project_id=97a27564d6b5404fa22fe354151a49d1)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:29.799637 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f863c1-6ba4-4ab5-aa41-9deecfb68bea None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:29.806129 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e81490-41c3-4bd3-a63a-01c9169bf25b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:29.809650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 80/157] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:29 2022] GET /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1 => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:29.814924 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840d5dd-4fc7-417a-b81b-41f18111ffa7 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:29.815276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840d5dd-4fc7-417a-b81b-41f18111ffa7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:29.815487 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840d5dd-4fc7-417a-b81b-41f18111ffa7 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:29.816966 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 81/158] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:29.819372 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840d5dd-4fc7-417a-b81b-41f18111ffa7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:29.820939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-61e81490-41c3-4bd3-a63a-01c9169bf25b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:29.820939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:29.820939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:29.820939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:29.820939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:29.820939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:29.820939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:29.820939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:29.820939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:29.820939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:29.820939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:29.820939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:29.820939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:29.820939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:29.820939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:29.820939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:29.821846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:29.821846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:29.821846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:29.821846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:29.821846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:29.821846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:29.821846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:29.821846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:29.821846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:29.821846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:29.821846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:29.821846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:28:29.821846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:29.821846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:29.821846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:29.821846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:29.822672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:29.822672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:29.822672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:29.822672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:29.822672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:29.822672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:29.822672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:29.822672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:29.822672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:29.822672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:29.822672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:29.822672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:28:29.824622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 78/159] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 16:28:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:29.826164 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64f33e-9309-46aa-8c2e-47b5bbbb9c22 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:29.828462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64f33e-9309-46aa-8c2e-47b5bbbb9c22 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:29.828873 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64f33e-9309-46aa-8c2e-47b5bbbb9c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:29.873510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-be64f33e-9309-46aa-8c2e-47b5bbbb9c22 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:29.874890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-be64f33e-9309-46aa-8c2e-47b5bbbb9c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:29.875879 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:30.014053 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840d5dd-4fc7-417a-b81b-41f18111ffa7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:30.037339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 79/160] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:30.038232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64f33e-9309-46aa-8c2e-47b5bbbb9c22 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:30.089487 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32484efb-0076-4e23-8b5f-b7992a96e009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:30.090399 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32484efb-0076-4e23-8b5f-b7992a96e009 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:30.090685 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32484efb-0076-4e23-8b5f-b7992a96e009 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:30.091064 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32484efb-0076-4e23-8b5f-b7992a96e009 None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1/users/6bd075a634f14ed0a0d81d19b7cc42bc/roles/ab11da387f674277a602ab6e1e7e5b44` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:30.098993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32484efb-0076-4e23-8b5f-b7992a96e009 None admin] RBAC: Authorizing `identity:create_grant(project_id=97a27564d6b5404fa22fe354151a49d1, user_id=6bd075a634f14ed0a0d81d19b7cc42bc, role_id=ab11da387f674277a602ab6e1e7e5b44)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:30.100489 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32484efb-0076-4e23-8b5f-b7992a96e009 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:30.161778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 82/161] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:28:29 2022] PUT /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1/users/6bd075a634f14ed0a0d81d19b7cc42bc/roles/ab11da387f674277a602ab6e1e7e5b44 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:30.163802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32484efb-0076-4e23-8b5f-b7992a96e009 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:30.294209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64f33e-9309-46aa-8c2e-47b5bbbb9c22 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:30.299506 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:30.316290 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:30.334078 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32484efb-0076-4e23-8b5f-b7992a96e009 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:30.384018 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e6a04-c6fd-4b6d-ac40-11b4d1ed1329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:30.384944 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e6a04-c6fd-4b6d-ac40-11b4d1ed1329 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:30.385235 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e6a04-c6fd-4b6d-ac40-11b4d1ed1329 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:30.385545 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e6a04-c6fd-4b6d-ac40-11b4d1ed1329 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:30.386333 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e6a04-c6fd-4b6d-ac40-11b4d1ed1329 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:30.386645 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e6a04-c6fd-4b6d-ac40-11b4d1ed1329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:30.388124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e6a04-c6fd-4b6d-ac40-11b4d1ed1329 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:30.390743 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1889a0-0963-498e-aaf5-a91b3c358b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:30.391597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1889a0-0963-498e-aaf5-a91b3c358b36 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:30.391868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1889a0-0963-498e-aaf5-a91b3c358b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:30.392145 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1889a0-0963-498e-aaf5-a91b3c358b36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:30.405472 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 80/162] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:28:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:30.411497 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1889a0-0963-498e-aaf5-a91b3c358b36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:30.411697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e6a04-c6fd-4b6d-ac40-11b4d1ed1329 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:30.422820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-9f1889a0-0963-498e-aaf5-a91b3c358b36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:30.422820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:30.422820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:30.422820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:30.422820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:30.422820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:30.422820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:30.422820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:30.422820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:30.422820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:30.422820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:30.422820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:30.422820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:30.422820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:30.422820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:30.422820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:30.423746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:30.423746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:30.423746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:30.423746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:30.423746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:30.423746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:30.423746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:30.423746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:30.423746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:30.423746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:30.423746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:30.423746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:28:30.423746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:30.423746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:30.423746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:30.423746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:30.424598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:30.424598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:30.424598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:30.424598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:30.424598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:30.424598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:30.424598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:30.424598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:30.424598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:30.424598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:30.424598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:30.424598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:28:30.424598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 83/163] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:28:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:30.438476 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1889a0-0963-498e-aaf5-a91b3c358b36 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:30.610965 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1889a0-0963-498e-aaf5-a91b3c358b36 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:30.660394 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946512c-b2f6-4514-8b3c-6a9421b9ed00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:30.662386 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946512c-b2f6-4514-8b3c-6a9421b9ed00 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:30.664419 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946512c-b2f6-4514-8b3c-6a9421b9ed00 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:30.664974 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946512c-b2f6-4514-8b3c-6a9421b9ed00 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:30.666875 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946512c-b2f6-4514-8b3c-6a9421b9ed00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:30.670864 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946512c-b2f6-4514-8b3c-6a9421b9ed00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:30.672715 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946512c-b2f6-4514-8b3c-6a9421b9ed00 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:30.691560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 84/164] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:30.693118 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618282b-7442-4289-aa8b-367cbf7c589e None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:30.693480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618282b-7442-4289-aa8b-367cbf7c589e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:30.693771 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618282b-7442-4289-aa8b-367cbf7c589e None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:30.695329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 85/165] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:30.698839 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618282b-7442-4289-aa8b-367cbf7c589e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:30.704640 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:30.709823 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e6a04-c6fd-4b6d-ac40-11b4d1ed1329 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:30.826507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a3010-a52c-4de6-8f38-ceadf16f2bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:30.828004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a3010-a52c-4de6-8f38-ceadf16f2bcc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:30.828473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a3010-a52c-4de6-8f38-ceadf16f2bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:30.828944 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a3010-a52c-4de6-8f38-ceadf16f2bcc None admin] PATH_INFO: `/v3/users/4e70b03ce9684918961bd5fcc34afa71` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:30.834773 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a3010-a52c-4de6-8f38-ceadf16f2bcc None admin] RBAC: Authorizing `identity:get_user(user_id=4e70b03ce9684918961bd5fcc34afa71)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:30.837463 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a3010-a52c-4de6-8f38-ceadf16f2bcc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:30.845843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 81/166] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:30 2022] GET /identity/v3/users/4e70b03ce9684918961bd5fcc34afa71 => generated 275 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:30.848490 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45663507-e516-4795-b189-75263c88a52b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:30.849568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45663507-e516-4795-b189-75263c88a52b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:30.850015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45663507-e516-4795-b189-75263c88a52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:30.907012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-45663507-e516-4795-b189-75263c88a52b None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:30.908603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-45663507-e516-4795-b189-75263c88a52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:30.966435 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618282b-7442-4289-aa8b-367cbf7c589e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:31.008576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:31.086541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e900b-6957-4122-9ec1-e605b416fee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:31.088087 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e900b-6957-4122-9ec1-e605b416fee5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:31.088758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e900b-6957-4122-9ec1-e605b416fee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:31.089373 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e900b-6957-4122-9ec1-e605b416fee5 None admin] PATH_INFO: `/v3/users/ea68495bc01f41d2b0c2e34799485fee` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:31.095025 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e900b-6957-4122-9ec1-e605b416fee5 None admin] RBAC: Authorizing `identity:get_user(user_id=ea68495bc01f41d2b0c2e34799485fee)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:31.097608 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e900b-6957-4122-9ec1-e605b416fee5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:31.109304 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 86/167] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:30 2022] GET /identity/v3/users/ea68495bc01f41d2b0c2e34799485fee => generated 247 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:31.111225 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e900b-6957-4122-9ec1-e605b416fee5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:31.144963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 82/168] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:31.146352 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45663507-e516-4795-b189-75263c88a52b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:31.361662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:31.393166 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45663507-e516-4795-b189-75263c88a52b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:31.426031 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e900b-6957-4122-9ec1-e605b416fee5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:31.451119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53ac2e-f308-4031-9b48-b6d0895068b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:31.451788 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53ac2e-f308-4031-9b48-b6d0895068b3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:31.452075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53ac2e-f308-4031-9b48-b6d0895068b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:31.452350 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53ac2e-f308-4031-9b48-b6d0895068b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:31.492692 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d82e7-85c4-47bd-bd9b-7596f54997c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:31.493992 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d82e7-85c4-47bd-bd9b-7596f54997c2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:31.495610 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d82e7-85c4-47bd-bd9b-7596f54997c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:31.497409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d82e7-85c4-47bd-bd9b-7596f54997c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:31.551108 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:31.660129 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53ac2e-f308-4031-9b48-b6d0895068b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:31.662341 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53ac2e-f308-4031-9b48-b6d0895068b3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:31.688377 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d82e7-85c4-47bd-bd9b-7596f54997c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:31.690192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d82e7-85c4-47bd-bd9b-7596f54997c2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:31.789793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:31.826433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 87/169] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:28:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:31.827601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d82e7-85c4-47bd-bd9b-7596f54997c2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:31.961656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 83/170] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:28:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 816 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:31.962876 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53ac2e-f308-4031-9b48-b6d0895068b3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:31.969448 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d82e7-85c4-47bd-bd9b-7596f54997c2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:32.027882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f881e3-88a0-4ff2-af81-99969b05f3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:32.029658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f881e3-88a0-4ff2-af81-99969b05f3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:32.030386 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f881e3-88a0-4ff2-af81-99969b05f3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:32.031062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f881e3-88a0-4ff2-af81-99969b05f3f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:32.052990 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f881e3-88a0-4ff2-af81-99969b05f3f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:32.067349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a2f881e3-88a0-4ff2-af81-99969b05f3f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:32.067349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:32.067349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:32.067349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:32.067349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:32.067349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:32.067349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:32.067349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:32.067349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:32.067349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:32.067349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:32.067349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:32.067349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:32.067349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:32.067349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:32.067349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:32.068982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:32.068982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:32.068982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:32.068982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:32.068982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:32.068982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:32.068982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:32.068982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:32.068982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:32.068982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:32.068982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:32.068982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:28:32.068982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:32.068982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:32.068982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:32.068982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:32.070327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:32.070327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:32.070327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:32.070327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:32.070327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:32.070327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:32.070327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:32.070327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:32.070327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:32.070327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:32.070327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:32.070327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:28:32.073213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 88/171] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:32.074627 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f881e3-88a0-4ff2-af81-99969b05f3f8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:32.152191 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:32.195681 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:32.266698 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53ac2e-f308-4031-9b48-b6d0895068b3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:32.336362 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357d851-3c83-4ee4-9da5-01ce8d903294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:32.338098 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357d851-3c83-4ee4-9da5-01ce8d903294 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:32.339005 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357d851-3c83-4ee4-9da5-01ce8d903294 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:32.339299 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357d851-3c83-4ee4-9da5-01ce8d903294 None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:32.342066 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357d851-3c83-4ee4-9da5-01ce8d903294 None admin] RBAC: Authorizing `identity:get_project(project_id=97a27564d6b5404fa22fe354151a49d1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:32.344079 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357d851-3c83-4ee4-9da5-01ce8d903294 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:32.344262 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f881e3-88a0-4ff2-af81-99969b05f3f8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:32.346506 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 84/172] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:31 2022] GET /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1 => generated 298 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:32.349712 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357d851-3c83-4ee4-9da5-01ce8d903294 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:32.417247 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a7d19-1abf-4c12-afb5-e7557ba02159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:32.418286 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a7d19-1abf-4c12-afb5-e7557ba02159 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:32.418569 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a7d19-1abf-4c12-afb5-e7557ba02159 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:32.418851 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a7d19-1abf-4c12-afb5-e7557ba02159 None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:32.420192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a7d19-1abf-4c12-afb5-e7557ba02159 None admin] RBAC: Authorizing `identity:get_project(project_id=97a27564d6b5404fa22fe354151a49d1)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:32.422250 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a7d19-1abf-4c12-afb5-e7557ba02159 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:32.425644 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 89/173] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:32 2022] GET /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1 => generated 298 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:32.427857 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b03b43-2b1c-48bc-93e1-c55f7036a08b None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:32.428409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b03b43-2b1c-48bc-93e1-c55f7036a08b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:32.428837 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b03b43-2b1c-48bc-93e1-c55f7036a08b None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:32.431690 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 90/174] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:32.433310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d769be-04cc-423c-bc92-fd8e2af57c68 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:32.437733 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d769be-04cc-423c-bc92-fd8e2af57c68 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:32.437733 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d769be-04cc-423c-bc92-fd8e2af57c68 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:32.437733 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 91/175] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:32.437733 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d769be-04cc-423c-bc92-fd8e2af57c68 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:32.529602 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357d851-3c83-4ee4-9da5-01ce8d903294 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:32.570619 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31272c15-5598-4b2d-8089-9911360afb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:32.571879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31272c15-5598-4b2d-8089-9911360afb06 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:32.572381 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31272c15-5598-4b2d-8089-9911360afb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:32.572709 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31272c15-5598-4b2d-8089-9911360afb06 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:32.573573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31272c15-5598-4b2d-8089-9911360afb06 None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:32.573902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31272c15-5598-4b2d-8089-9911360afb06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:32.576059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31272c15-5598-4b2d-8089-9911360afb06 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:32.580100 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:32.595576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 85/176] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:28:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:32.595576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31272c15-5598-4b2d-8089-9911360afb06 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:32.605582 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:32.612044 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d769be-04cc-423c-bc92-fd8e2af57c68 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:32.664189 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239e9cf-bab7-4433-943a-384fc48696d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:32.666064 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239e9cf-bab7-4433-943a-384fc48696d1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:32.667295 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239e9cf-bab7-4433-943a-384fc48696d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:32.667797 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239e9cf-bab7-4433-943a-384fc48696d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:32.669447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239e9cf-bab7-4433-943a-384fc48696d1 None admin] RBAC: Adding query filter params (role.id=c8d1d9031cfc4ef8a0e62f6bfd7ff691, scope.project.id=97a27564d6b5404fa22fe354151a49d1, user.id=4e70b03ce9684918961bd5fcc34afa71) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:32.670005 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239e9cf-bab7-4433-943a-384fc48696d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:32.672791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239e9cf-bab7-4433-943a-384fc48696d1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:32.684443 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 92/177] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:28:32 2022] GET /identity/v3/role_assignments?user.id=4e70b03ce9684918961bd5fcc34afa71&scope.project.id=97a27564d6b5404fa22fe354151a49d1&role.id=c8d1d9031cfc4ef8a0e62f6bfd7ff691 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:32.685885 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ec830-3dc4-4806-82b4-e292a8f67d0c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:32.686173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ec830-3dc4-4806-82b4-e292a8f67d0c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:32.686983 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ec830-3dc4-4806-82b4-e292a8f67d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:32.715170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-735ec830-3dc4-4806-82b4-e292a8f67d0c None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:32.717677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-735ec830-3dc4-4806-82b4-e292a8f67d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:32.781817 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31272c15-5598-4b2d-8089-9911360afb06 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:32.849102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 93/178] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:32.850688 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023f9c0-3562-4acd-9226-e36cce9ebf9c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:32.850985 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023f9c0-3562-4acd-9226-e36cce9ebf9c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:32.851300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023f9c0-3562-4acd-9226-e36cce9ebf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:32.863091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a773a-b166-4a6f-8b80-59bdbf01c557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:32.865075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a773a-b166-4a6f-8b80-59bdbf01c557 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:32.865075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a773a-b166-4a6f-8b80-59bdbf01c557 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:32.865381 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a773a-b166-4a6f-8b80-59bdbf01c557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:32.866637 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a773a-b166-4a6f-8b80-59bdbf01c557 None admin] RBAC: Adding query filter params (role.id=796e313fa8794ac885ccf6300d09332a, scope.project.id=97a27564d6b5404fa22fe354151a49d1, user.id=ea68495bc01f41d2b0c2e34799485fee) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:32.867366 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a773a-b166-4a6f-8b80-59bdbf01c557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:32.870096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a773a-b166-4a6f-8b80-59bdbf01c557 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:32.881541 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 86/179] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:28:32 2022] GET /identity/v3/role_assignments?user.id=ea68495bc01f41d2b0c2e34799485fee&scope.project.id=97a27564d6b5404fa22fe354151a49d1&role.id=796e313fa8794ac885ccf6300d09332a => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:32.883420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0045af-6c43-41e6-9393-b1687a34d287 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:32.883911 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0045af-6c43-41e6-9393-b1687a34d287 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:32.884331 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0045af-6c43-41e6-9393-b1687a34d287 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:32.887020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 87/180] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:32.887592 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d023f9c0-3562-4acd-9226-e36cce9ebf9c None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:32.888515 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0045af-6c43-41e6-9393-b1687a34d287 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:32.890597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d023f9c0-3562-4acd-9226-e36cce9ebf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:33.027823 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:33.043691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 94/181] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:33.043691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023f9c0-3562-4acd-9226-e36cce9ebf9c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:33.095642 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0045af-6c43-41e6-9393-b1687a34d287 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:33.095838 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:33.149450 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b3744-eaaf-4edb-9bf4-9a6218ed47df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:33.151741 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b3744-eaaf-4edb-9bf4-9a6218ed47df None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:33.152252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b3744-eaaf-4edb-9bf4-9a6218ed47df None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:33.152724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b3744-eaaf-4edb-9bf4-9a6218ed47df None admin] PATH_INFO: `/v3/users/4e70b03ce9684918961bd5fcc34afa71` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:33.154442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b3744-eaaf-4edb-9bf4-9a6218ed47df None admin] RBAC: Authorizing `identity:get_user(user_id=4e70b03ce9684918961bd5fcc34afa71)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:33.156889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b3744-eaaf-4edb-9bf4-9a6218ed47df None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:33.159199 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 88/182] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:32 2022] GET /identity/v3/users/4e70b03ce9684918961bd5fcc34afa71 => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:33.162079 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44039ac3-14ab-4195-8ed0-d796213e8ff6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:33.162661 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44039ac3-14ab-4195-8ed0-d796213e8ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:33.163136 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44039ac3-14ab-4195-8ed0-d796213e8ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:33.193514 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-44039ac3-14ab-4195-8ed0-d796213e8ff6 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:33.196858 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-44039ac3-14ab-4195-8ed0-d796213e8ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:33.208576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023f9c0-3562-4acd-9226-e36cce9ebf9c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:33.264848 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f4378-92eb-47e3-bf20-e6651b955f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:33.266071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f4378-92eb-47e3-bf20-e6651b955f5b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:33.266668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f4378-92eb-47e3-bf20-e6651b955f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:33.266668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f4378-92eb-47e3-bf20-e6651b955f5b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:33.288643 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f4378-92eb-47e3-bf20-e6651b955f5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:33.309368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d24f4378-92eb-47e3-bf20-e6651b955f5b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:33.309368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:33.309368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:33.309368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:33.309368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:33.309368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:33.309368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:33.309368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:33.309368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:33.309368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:33.309368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:33.309368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:33.309368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:33.309368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:33.309368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:33.309368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:33.310369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:33.310369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:33.310369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:33.310369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:33.310369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:33.310369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:33.310369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:33.310369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:33.310369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:33.310369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:33.310369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:33.310369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:28:33.310369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:33.310369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:33.310369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:33.310369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:33.311522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:33.311522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:33.311522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:33.311522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:33.311522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:33.311522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:33.311522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:33.311522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:33.311522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:33.311522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:33.311522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:33.311522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:28:33.311522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 95/183] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 16:28:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:33.311522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f4378-92eb-47e3-bf20-e6651b955f5b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:33.322805 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 89/184] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:33.323912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44039ac3-14ab-4195-8ed0-d796213e8ff6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:33.439294 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:33.484891 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:33.502824 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44039ac3-14ab-4195-8ed0-d796213e8ff6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:33.510654 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f4378-92eb-47e3-bf20-e6651b955f5b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:33.566633 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302d99a-b972-4c8f-be3b-b2cc4f34b75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:33.567692 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302d99a-b972-4c8f-be3b-b2cc4f34b75d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:33.568314 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302d99a-b972-4c8f-be3b-b2cc4f34b75d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:33.568710 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302d99a-b972-4c8f-be3b-b2cc4f34b75d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:33.573236 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7379875-6884-4b9d-8793-c372cc1a1af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:33.574642 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7379875-6884-4b9d-8793-c372cc1a1af0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:33.575104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7379875-6884-4b9d-8793-c372cc1a1af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:33.575465 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7379875-6884-4b9d-8793-c372cc1a1af0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:33.593544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7379875-6884-4b9d-8793-c372cc1a1af0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:33.608460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e7379875-6884-4b9d-8793-c372cc1a1af0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:33.608460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:33.608460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:33.608460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:33.608460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:33.608460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:33.608460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:33.608460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:33.608460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:33.608460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:33.608460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:33.608460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:33.608460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:33.608460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:33.608460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:33.608460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:33.610481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:33.610481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:33.610481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:33.610481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:33.610481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:33.610481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:33.610481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:33.610481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:33.610481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:33.610481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:33.610481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:33.610481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:28:33.610481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:33.610481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:33.610481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:33.610481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:33.611453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:33.611453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:33.611453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:33.611453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:33.611453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:33.611453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:33.611453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:33.611453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:33.611453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:33.611453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:33.611453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:33.611453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:28:33.611453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 96/185] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:28:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:33.612954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7379875-6884-4b9d-8793-c372cc1a1af0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:33.684161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302d99a-b972-4c8f-be3b-b2cc4f34b75d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:33.685711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302d99a-b972-4c8f-be3b-b2cc4f34b75d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:33.771460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7379875-6884-4b9d-8793-c372cc1a1af0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:33.792288 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:33.841073 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda329e-ea2a-4e29-af42-1dfe531d3fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:33.841742 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda329e-ea2a-4e29-af42-1dfe531d3fed None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:33.842025 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda329e-ea2a-4e29-af42-1dfe531d3fed None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:33.842388 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda329e-ea2a-4e29-af42-1dfe531d3fed None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:33.843308 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda329e-ea2a-4e29-af42-1dfe531d3fed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:33.843772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda329e-ea2a-4e29-af42-1dfe531d3fed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:33.845558 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda329e-ea2a-4e29-af42-1dfe531d3fed None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:33.858358 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 97/186] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:28:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:33.860172 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda329e-ea2a-4e29-af42-1dfe531d3fed None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:33.864356 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 90/187] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:28:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:33.865767 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302d99a-b972-4c8f-be3b-b2cc4f34b75d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:33.874233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:34.011446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda329e-ea2a-4e29-af42-1dfe531d3fed None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:34.019095 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302d99a-b972-4c8f-be3b-b2cc4f34b75d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:34.075980 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f210d00-b22b-4302-99af-80abe67eb079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:34.076953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f210d00-b22b-4302-99af-80abe67eb079 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.077379 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f210d00-b22b-4302-99af-80abe67eb079 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.077666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f210d00-b22b-4302-99af-80abe67eb079 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.079145 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f210d00-b22b-4302-99af-80abe67eb079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:34.080928 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f210d00-b22b-4302-99af-80abe67eb079 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:34.082366 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb592f0-efd0-4b70-8bbe-6142bf9c2ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:34.083603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 98/188] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:28:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:34.089705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb592f0-efd0-4b70-8bbe-6142bf9c2ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.089705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb592f0-efd0-4b70-8bbe-6142bf9c2ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.090047 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f210d00-b22b-4302-99af-80abe67eb079 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:34.090205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb592f0-efd0-4b70-8bbe-6142bf9c2ca7 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.090205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb592f0-efd0-4b70-8bbe-6142bf9c2ca7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:34.090205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb592f0-efd0-4b70-8bbe-6142bf9c2ca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:34.090205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb592f0-efd0-4b70-8bbe-6142bf9c2ca7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:34.102243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 91/189] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:34.103760 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb592f0-efd0-4b70-8bbe-6142bf9c2ca7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:34.144284 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:34.185566 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:34.219230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f210d00-b22b-4302-99af-80abe67eb079 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:34.257436 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb592f0-efd0-4b70-8bbe-6142bf9c2ca7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:34.267441 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3734f9-e667-40e0-a9fc-1855d5f07f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:34.269019 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3734f9-e667-40e0-a9fc-1855d5f07f86 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.269553 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3734f9-e667-40e0-a9fc-1855d5f07f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.270040 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3734f9-e667-40e0-a9fc-1855d5f07f86 None admin] PATH_INFO: `/v3/users/f324b1a60e9240e89b1e8cadd19cdaaa` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.286933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3734f9-e667-40e0-a9fc-1855d5f07f86 None admin] RBAC: Authorizing `identity:get_user(user_id=f324b1a60e9240e89b1e8cadd19cdaaa)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:34.289555 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3734f9-e667-40e0-a9fc-1855d5f07f86 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:34.293167 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 99/190] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:34 2022] GET /identity/v3/users/f324b1a60e9240e89b1e8cadd19cdaaa => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:34.293167 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3734f9-e667-40e0-a9fc-1855d5f07f86 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:34.306794 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd97c1a-989a-4aba-8c63-0a94293b6686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:34.307678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd97c1a-989a-4aba-8c63-0a94293b6686 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.308020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd97c1a-989a-4aba-8c63-0a94293b6686 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.308292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd97c1a-989a-4aba-8c63-0a94293b6686 None admin] PATH_INFO: `/v3/projects/d4f78c6be1b54c81b4fac96fbdef8f78` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.309750 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd97c1a-989a-4aba-8c63-0a94293b6686 None admin] RBAC: Authorizing `identity:get_project(project_id=d4f78c6be1b54c81b4fac96fbdef8f78)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:34.311383 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd97c1a-989a-4aba-8c63-0a94293b6686 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:34.313128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 92/191] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:34 2022] GET /identity/v3/projects/d4f78c6be1b54c81b4fac96fbdef8f78 => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:34.315961 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd97c1a-989a-4aba-8c63-0a94293b6686 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:34.422556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3734f9-e667-40e0-a9fc-1855d5f07f86 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:34.439161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:34.453856 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd97c1a-989a-4aba-8c63-0a94293b6686 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:34.456084 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:34.466228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa915c50-4617-4e1f-bddc-8849e53879de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:34.474995 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa915c50-4617-4e1f-bddc-8849e53879de None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.474995 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa915c50-4617-4e1f-bddc-8849e53879de None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.474995 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa915c50-4617-4e1f-bddc-8849e53879de None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.474995 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa915c50-4617-4e1f-bddc-8849e53879de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:34.474995 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa915c50-4617-4e1f-bddc-8849e53879de None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:34.493918 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14f680-02b8-437b-a45c-97e437d3136f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:34.494800 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14f680-02b8-437b-a45c-97e437d3136f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.495089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14f680-02b8-437b-a45c-97e437d3136f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.495504 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14f680-02b8-437b-a45c-97e437d3136f None admin] PATH_INFO: `/v3/users/f324b1a60e9240e89b1e8cadd19cdaaa` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.496730 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14f680-02b8-437b-a45c-97e437d3136f None admin] RBAC: Authorizing `identity:get_user(user_id=f324b1a60e9240e89b1e8cadd19cdaaa)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:34.498227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14f680-02b8-437b-a45c-97e437d3136f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:34.499893 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 93/192] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:34 2022] GET /identity/v3/users/f324b1a60e9240e89b1e8cadd19cdaaa => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:34.501123 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186431da-5c92-4301-afbc-9d7857fc24db None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.501431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186431da-5c92-4301-afbc-9d7857fc24db None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.501708 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186431da-5c92-4301-afbc-9d7857fc24db None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.502974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 94/193] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:34.503681 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186431da-5c92-4301-afbc-9d7857fc24db None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:34.624896 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186431da-5c92-4301-afbc-9d7857fc24db None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:34.659165 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 100/194] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 16:28:34 2022] POST /identity/v3/users => generated 297 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:34.664697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b843d4-9c21-46b1-8d39-87e4e76a97bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:34.665491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b843d4-9c21-46b1-8d39-87e4e76a97bc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.665779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b843d4-9c21-46b1-8d39-87e4e76a97bc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.666102 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b843d4-9c21-46b1-8d39-87e4e76a97bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.674666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa915c50-4617-4e1f-bddc-8849e53879de None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:34.705916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:34.765854 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b843d4-9c21-46b1-8d39-87e4e76a97bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:34.767382 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b843d4-9c21-46b1-8d39-87e4e76a97bc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:34.874099 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa915c50-4617-4e1f-bddc-8849e53879de None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:34.927436 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e412b55-11da-4b35-90c2-afb05b3ca7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:34.928024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e412b55-11da-4b35-90c2-afb05b3ca7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.928303 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e412b55-11da-4b35-90c2-afb05b3ca7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.928605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e412b55-11da-4b35-90c2-afb05b3ca7a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.929542 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e412b55-11da-4b35-90c2-afb05b3ca7a8 None admin] RBAC: Adding query filter params (role.id=cdbaa8196c574e32a331e8d4faee1a7e, scope.project.id=d4f78c6be1b54c81b4fac96fbdef8f78, user.id=4e70b03ce9684918961bd5fcc34afa71) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:34.929863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e412b55-11da-4b35-90c2-afb05b3ca7a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:34.931354 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e412b55-11da-4b35-90c2-afb05b3ca7a8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:34.948365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 101/195] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:28:34 2022] GET /identity/v3/role_assignments?user.id=4e70b03ce9684918961bd5fcc34afa71&scope.project.id=d4f78c6be1b54c81b4fac96fbdef8f78&role.id=cdbaa8196c574e32a331e8d4faee1a7e => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:34.948365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e412b55-11da-4b35-90c2-afb05b3ca7a8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:34.949444 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 95/196] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:28:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:34.951434 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc01256-9d3a-494f-8c90-f3e5d5e86804 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.951867 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc01256-9d3a-494f-8c90-f3e5d5e86804 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.952280 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc01256-9d3a-494f-8c90-f3e5d5e86804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.980132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8bc01256-9d3a-494f-8c90-f3e5d5e86804 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:34.982682 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8bc01256-9d3a-494f-8c90-f3e5d5e86804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:35.039329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:35.061082 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:35.106199 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 96/197] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:35.107191 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc01256-9d3a-494f-8c90-f3e5d5e86804 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:35.135445 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e412b55-11da-4b35-90c2-afb05b3ca7a8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:35.201015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4dcbf-a132-46f4-abb1-651dbe720c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:35.201611 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4dcbf-a132-46f4-abb1-651dbe720c3b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:35.201895 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4dcbf-a132-46f4-abb1-651dbe720c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:35.202177 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4dcbf-a132-46f4-abb1-651dbe720c3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:35.293476 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc01256-9d3a-494f-8c90-f3e5d5e86804 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:35.315575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4dcbf-a132-46f4-abb1-651dbe720c3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:35.318999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4dcbf-a132-46f4-abb1-651dbe720c3b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:35.352200 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f919b-3711-47a9-83c3-eafde5ced879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:35.353779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f919b-3711-47a9-83c3-eafde5ced879 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:35.355009 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f919b-3711-47a9-83c3-eafde5ced879 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:35.355811 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f919b-3711-47a9-83c3-eafde5ced879 None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:35.358715 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f919b-3711-47a9-83c3-eafde5ced879 None admin] RBAC: Authorizing `identity:get_project(project_id=30b0d97406c64a4d8830d98d414453ed)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:35.361320 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f919b-3711-47a9-83c3-eafde5ced879 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:35.365719 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 97/198] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:35 2022] GET /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:35.366793 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f919b-3711-47a9-83c3-eafde5ced879 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:35.391370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:35.465903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:35.475706 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 102/199] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:28:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:35.477009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4dcbf-a132-46f4-abb1-651dbe720c3b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:35.562980 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f919b-3711-47a9-83c3-eafde5ced879 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:35.616817 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97071b89-4595-4414-9bcd-c55e0615ee4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:35.617725 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97071b89-4595-4414-9bcd-c55e0615ee4e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:35.618051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97071b89-4595-4414-9bcd-c55e0615ee4e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:35.618321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97071b89-4595-4414-9bcd-c55e0615ee4e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:35.622388 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4dcbf-a132-46f4-abb1-651dbe720c3b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:35.633862 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97071b89-4595-4414-9bcd-c55e0615ee4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:35.644705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-97071b89-4595-4414-9bcd-c55e0615ee4e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:35.644705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:35.644705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:35.644705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:35.644705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:35.644705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:35.644705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:35.644705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:35.644705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:35.644705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:35.644705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:35.644705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:35.644705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:35.644705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:35.644705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:35.644705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:35.645722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:35.645722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:35.645722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:35.645722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:35.645722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:35.645722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:35.645722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:35.645722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:35.645722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:35.645722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:35.645722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:35.645722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:28:35.645722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:35.645722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:35.645722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:35.645722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:35.646531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:35.646531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:35.646531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:35.646531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:35.646531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:35.646531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:35.646531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:35.646531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:35.646531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:35.646531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:35.646531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:35.646531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:28:35.648728 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 98/200] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:35.653430 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97071b89-4595-4414-9bcd-c55e0615ee4e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:35.678293 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdedd3-7ead-4834-9e0c-5c07aa15cb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:35.679325 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdedd3-7ead-4834-9e0c-5c07aa15cb58 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:35.679857 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdedd3-7ead-4834-9e0c-5c07aa15cb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:35.680454 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdedd3-7ead-4834-9e0c-5c07aa15cb58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:35.681728 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdedd3-7ead-4834-9e0c-5c07aa15cb58 None admin] RBAC: Adding query filter params (role.id=c8d1d9031cfc4ef8a0e62f6bfd7ff691, scope.project.id=30b0d97406c64a4d8830d98d414453ed, user.id=f324b1a60e9240e89b1e8cadd19cdaaa) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:35.682309 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdedd3-7ead-4834-9e0c-5c07aa15cb58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:35.684358 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdedd3-7ead-4834-9e0c-5c07aa15cb58 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:35.693310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 103/201] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:28:35 2022] GET /identity/v3/role_assignments?user.id=f324b1a60e9240e89b1e8cadd19cdaaa&scope.project.id=30b0d97406c64a4d8830d98d414453ed&role.id=c8d1d9031cfc4ef8a0e62f6bfd7ff691 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:35.694589 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdedd3-7ead-4834-9e0c-5c07aa15cb58 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:35.727180 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:35.855399 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97071b89-4595-4414-9bcd-c55e0615ee4e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:35.897887 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdedd3-7ead-4834-9e0c-5c07aa15cb58 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:35.898797 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:35.951209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ec0e3-6728-4ad9-b963-b4e49b318c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:35.953434 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ec0e3-6728-4ad9-b963-b4e49b318c55 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:35.954193 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ec0e3-6728-4ad9-b963-b4e49b318c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:35.954932 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ec0e3-6728-4ad9-b963-b4e49b318c55 None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:35.957504 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ec0e3-6728-4ad9-b963-b4e49b318c55 None admin] RBAC: Authorizing `identity:get_project(project_id=30b0d97406c64a4d8830d98d414453ed)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:35.960707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ec0e3-6728-4ad9-b963-b4e49b318c55 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:35.966952 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 99/202] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:35 2022] GET /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed => generated 302 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:35.978951 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ec0e3-6728-4ad9-b963-b4e49b318c55 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:35.996152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36990619-ee0e-4604-96d2-a83af9faba38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:35.997143 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36990619-ee0e-4604-96d2-a83af9faba38 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:35.998827 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36990619-ee0e-4604-96d2-a83af9faba38 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:35.999142 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36990619-ee0e-4604-96d2-a83af9faba38 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:35.999945 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36990619-ee0e-4604-96d2-a83af9faba38 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:36.000255 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36990619-ee0e-4604-96d2-a83af9faba38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:36.002412 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36990619-ee0e-4604-96d2-a83af9faba38 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:36.016621 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 104/203] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:28:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:36.025529 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36990619-ee0e-4604-96d2-a83af9faba38 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:36.219021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:36.227407 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ec0e3-6728-4ad9-b963-b4e49b318c55 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:36.269016 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36990619-ee0e-4604-96d2-a83af9faba38 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:36.295996 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539fc76-f396-4d96-a7c9-ef2288b22607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:36.297146 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539fc76-f396-4d96-a7c9-ef2288b22607 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:36.297554 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539fc76-f396-4d96-a7c9-ef2288b22607 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:36.297836 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539fc76-f396-4d96-a7c9-ef2288b22607 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:36.298712 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539fc76-f396-4d96-a7c9-ef2288b22607 None admin] RBAC: Adding query filter params (role.id=796e313fa8794ac885ccf6300d09332a, scope.project.id=30b0d97406c64a4d8830d98d414453ed, user.id=f324b1a60e9240e89b1e8cadd19cdaaa) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:36.299017 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539fc76-f396-4d96-a7c9-ef2288b22607 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:36.300565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539fc76-f396-4d96-a7c9-ef2288b22607 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:36.314821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 100/204] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:28:35 2022] GET /identity/v3/role_assignments?user.id=f324b1a60e9240e89b1e8cadd19cdaaa&scope.project.id=30b0d97406c64a4d8830d98d414453ed&role.id=796e313fa8794ac885ccf6300d09332a => generated 259 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:36.331026 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0097890-92a9-4f9a-8647-1202bd5e2247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:36.332563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0097890-92a9-4f9a-8647-1202bd5e2247 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:36.333044 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0097890-92a9-4f9a-8647-1202bd5e2247 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:36.333489 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0097890-92a9-4f9a-8647-1202bd5e2247 None admin] PATH_INFO: `/v3/users/6bd075a634f14ed0a0d81d19b7cc42bc` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:36.334766 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0097890-92a9-4f9a-8647-1202bd5e2247 None admin] RBAC: Authorizing `identity:get_user(user_id=6bd075a634f14ed0a0d81d19b7cc42bc)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:36.336294 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0097890-92a9-4f9a-8647-1202bd5e2247 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:36.338447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 105/205] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:36 2022] GET /identity/v3/users/6bd075a634f14ed0a0d81d19b7cc42bc => generated 289 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:36.344441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539fc76-f396-4d96-a7c9-ef2288b22607 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:36.406204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:36.475492 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539fc76-f396-4d96-a7c9-ef2288b22607 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:36.532857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fe4ff-4a31-4d60-a223-3f8df71d48f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:36.533762 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fe4ff-4a31-4d60-a223-3f8df71d48f2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:36.534173 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fe4ff-4a31-4d60-a223-3f8df71d48f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:36.534561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fe4ff-4a31-4d60-a223-3f8df71d48f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:36.638377 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fe4ff-4a31-4d60-a223-3f8df71d48f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:36.640504 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fe4ff-4a31-4d60-a223-3f8df71d48f2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:36.709781 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:36.774154 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 101/206] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:28:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:28:36.780399 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0097890-92a9-4f9a-8647-1202bd5e2247 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:36.936281 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0097890-92a9-4f9a-8647-1202bd5e2247 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:36.989814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529d007-f8ca-494e-80f4-32c4611ad0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:36.990831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529d007-f8ca-494e-80f4-32c4611ad0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:36.991123 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529d007-f8ca-494e-80f4-32c4611ad0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:36.991394 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529d007-f8ca-494e-80f4-32c4611ad0b4 None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:36.997190 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529d007-f8ca-494e-80f4-32c4611ad0b4 None admin] RBAC: Authorizing `identity:get_project(project_id=97a27564d6b5404fa22fe354151a49d1)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:36.999217 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529d007-f8ca-494e-80f4-32c4611ad0b4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:37.001885 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 106/207] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:36 2022] GET /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:37.009748 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fe4ff-4a31-4d60-a223-3f8df71d48f2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:37.194359 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fe4ff-4a31-4d60-a223-3f8df71d48f2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:37.243977 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db97c8-84ca-43fd-a605-3b3481b52808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:37.245070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db97c8-84ca-43fd-a605-3b3481b52808 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:37.245553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db97c8-84ca-43fd-a605-3b3481b52808 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:37.245997 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db97c8-84ca-43fd-a605-3b3481b52808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:37.247307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db97c8-84ca-43fd-a605-3b3481b52808 None admin] RBAC: Adding query filter params (role.id=ab11da387f674277a602ab6e1e7e5b44, scope.project.id=97a27564d6b5404fa22fe354151a49d1, user.id=6bd075a634f14ed0a0d81d19b7cc42bc) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:37.247751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db97c8-84ca-43fd-a605-3b3481b52808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:37.249877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db97c8-84ca-43fd-a605-3b3481b52808 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:37.257948 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 102/208] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:28:37 2022] GET /identity/v3/role_assignments?user.id=6bd075a634f14ed0a0d81d19b7cc42bc&scope.project.id=97a27564d6b5404fa22fe354151a49d1&role.id=ab11da387f674277a602ab6e1e7e5b44 => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:38.042555 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5fce9-852f-449d-842b-181dd8551b28 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:38.044018 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5fce9-852f-449d-842b-181dd8551b28 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:38.044744 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5fce9-852f-449d-842b-181dd8551b28 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:38.046717 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 107/209] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:38.053846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890aa33-6a6a-4d49-8ac8-dda4780d9eae None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:38.054572 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890aa33-6a6a-4d49-8ac8-dda4780d9eae None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:38.055107 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890aa33-6a6a-4d49-8ac8-dda4780d9eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:38.058511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c45d14-d325-4c22-9dbe-ed6ab8750d88 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:38.059076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c45d14-d325-4c22-9dbe-ed6ab8750d88 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:38.059559 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c45d14-d325-4c22-9dbe-ed6ab8750d88 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:38.061729 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 108/210] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:38.075731 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49ae03-09c7-4f1d-a733-90775457aa5a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:38.075731 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49ae03-09c7-4f1d-a733-90775457aa5a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:38.075731 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49ae03-09c7-4f1d-a733-90775457aa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:38.092188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2890aa33-6a6a-4d49-8ac8-dda4780d9eae None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:38.094652 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2890aa33-6a6a-4d49-8ac8-dda4780d9eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:38.107107 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:38.125157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1c49ae03-09c7-4f1d-a733-90775457aa5a None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:38.127623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1c49ae03-09c7-4f1d-a733-90775457aa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:38.146810 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:38.238454 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 103/211] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:38.275004 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 109/212] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:38.285812 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890aa33-6a6a-4d49-8ac8-dda4780d9eae None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:38.302757 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49ae03-09c7-4f1d-a733-90775457aa5a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:38.462238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890aa33-6a6a-4d49-8ac8-dda4780d9eae None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:38.466990 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49ae03-09c7-4f1d-a733-90775457aa5a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:38.525947 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95173298-56b5-46d1-be13-95dcd64b9409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:38.527222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95173298-56b5-46d1-be13-95dcd64b9409 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:38.527731 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95173298-56b5-46d1-be13-95dcd64b9409 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:38.528211 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95173298-56b5-46d1-be13-95dcd64b9409 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:38.528549 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ec980-abd8-4439-9abd-031d6f0e4460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:38.529706 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ec980-abd8-4439-9abd-031d6f0e4460 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:38.530003 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ec980-abd8-4439-9abd-031d6f0e4460 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:38.530282 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ec980-abd8-4439-9abd-031d6f0e4460 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:38.531986 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ec980-abd8-4439-9abd-031d6f0e4460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:38.534000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ec980-abd8-4439-9abd-031d6f0e4460 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:38.535740 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 104/213] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:28:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:38.541972 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ec980-abd8-4439-9abd-031d6f0e4460 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:38.547448 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95173298-56b5-46d1-be13-95dcd64b9409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:38.556408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-95173298-56b5-46d1-be13-95dcd64b9409 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:38.556408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:38.556408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:38.556408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:38.556408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:38.556408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:38.556408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:38.556408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:38.556408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:38.556408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:38.556408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:38.556408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:38.556408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:38.556408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:38.556408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:38.556408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:38.557450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:38.557450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:38.557450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:38.557450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:38.557450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:38.557450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:38.557450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:38.557450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:38.557450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:38.557450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:38.557450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:38.557450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:28:38.557450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:38.557450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:38.557450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:38.557450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:38.558452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:38.558452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:38.558452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:38.558452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:38.558452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:38.558452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:38.558452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:38.558452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:38.558452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:38.558452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:38.558452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:38.558452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:28:38.559190 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:38.565494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 110/214] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:38.567739 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95173298-56b5-46d1-be13-95dcd64b9409 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:38.571004 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:38.701869 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ec980-abd8-4439-9abd-031d6f0e4460 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:38.718525 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95173298-56b5-46d1-be13-95dcd64b9409 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:38.757607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a86c7-2c6d-4e76-bf95-1041fc9b085b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:38.758513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a86c7-2c6d-4e76-bf95-1041fc9b085b None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:38.758907 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a86c7-2c6d-4e76-bf95-1041fc9b085b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:38.759284 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a86c7-2c6d-4e76-bf95-1041fc9b085b None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:38.760234 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a86c7-2c6d-4e76-bf95-1041fc9b085b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:38.761882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a86c7-2c6d-4e76-bf95-1041fc9b085b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:38.773914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641a4e4-591d-4c1b-940c-87f7b8094b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:38.775278 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641a4e4-591d-4c1b-940c-87f7b8094b80 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:38.776198 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641a4e4-591d-4c1b-940c-87f7b8094b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:38.776689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641a4e4-591d-4c1b-940c-87f7b8094b80 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:38.777785 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641a4e4-591d-4c1b-940c-87f7b8094b80 None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:38.778091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641a4e4-591d-4c1b-940c-87f7b8094b80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:38.779818 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641a4e4-591d-4c1b-940c-87f7b8094b80 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:38.789346 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 111/215] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:28:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:38.796707 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641a4e4-591d-4c1b-940c-87f7b8094b80 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:38.875931 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:38.905714 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 105/216] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 16:28:38 2022] POST /identity/v3/users => generated 297 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:28:38.939665 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641a4e4-591d-4c1b-940c-87f7b8094b80 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:38.989929 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8346999-e474-42e4-b8a7-514932b619a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:38.991100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8346999-e474-42e4-b8a7-514932b619a7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:38.991395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8346999-e474-42e4-b8a7-514932b619a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:38.991651 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8346999-e474-42e4-b8a7-514932b619a7 None admin] PATH_INFO: `/v3/users/3a2989d9132e4f63957940c6efd5784f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:39.010403 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8346999-e474-42e4-b8a7-514932b619a7 None admin] RBAC: Authorizing `identity:get_user(user_id=3a2989d9132e4f63957940c6efd5784f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:39.011932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8346999-e474-42e4-b8a7-514932b619a7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:39.014021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 112/217] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:38 2022] GET /identity/v3/users/3a2989d9132e4f63957940c6efd5784f => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:39.020314 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a86c7-2c6d-4e76-bf95-1041fc9b085b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:39.123770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:39.175823 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a86c7-2c6d-4e76-bf95-1041fc9b085b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:39.225243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f7e6d-ecdf-4fb5-973c-e64373b57722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:39.226138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f7e6d-ecdf-4fb5-973c-e64373b57722 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:39.226467 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f7e6d-ecdf-4fb5-973c-e64373b57722 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:39.226773 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f7e6d-ecdf-4fb5-973c-e64373b57722 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:39.235093 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9623bac-4f6b-4ac1-887c-c53ffc746c7a None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:39.235590 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9623bac-4f6b-4ac1-887c-c53ffc746c7a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:39.235663 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9623bac-4f6b-4ac1-887c-c53ffc746c7a None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:39.237031 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 113/218] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:39.244104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa21248-7980-4199-9afb-fb47ffd6ab7f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:39.244492 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa21248-7980-4199-9afb-fb47ffd6ab7f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:39.244849 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa21248-7980-4199-9afb-fb47ffd6ab7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:39.267463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8fa21248-7980-4199-9afb-fb47ffd6ab7f None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:39.270515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8fa21248-7980-4199-9afb-fb47ffd6ab7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:39.347884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f7e6d-ecdf-4fb5-973c-e64373b57722 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:39.351281 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f7e6d-ecdf-4fb5-973c-e64373b57722 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:39.381965 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 114/219] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:39.417082 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa21248-7980-4199-9afb-fb47ffd6ab7f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:39.452206 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:39.499985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 106/220] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:28:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:28:39.505728 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:39.506295 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f7e6d-ecdf-4fb5-973c-e64373b57722 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:39.573090 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa21248-7980-4199-9afb-fb47ffd6ab7f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:39.620878 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646caea-34e7-4a20-8223-00a459473c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:39.621743 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646caea-34e7-4a20-8223-00a459473c90 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:39.622029 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646caea-34e7-4a20-8223-00a459473c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:39.622307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646caea-34e7-4a20-8223-00a459473c90 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:39.624098 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f7e6d-ecdf-4fb5-973c-e64373b57722 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:39.636208 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646caea-34e7-4a20-8223-00a459473c90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:39.646024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a646caea-34e7-4a20-8223-00a459473c90 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:39.646024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:39.646024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:39.646024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:39.646024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:39.646024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:39.646024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:39.646024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:39.646024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:39.646024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:39.646024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:39.646024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:39.646024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:39.646024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:39.646024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:39.646024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:39.647554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:39.647554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:39.647554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:39.647554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:39.647554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:39.647554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:39.647554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:39.647554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:39.647554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:39.647554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:39.647554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:39.647554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:28:39.647554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:39.647554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:39.647554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:39.647554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:39.648910 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:39.648910 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:39.648910 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:39.648910 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:39.648910 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:39.648910 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:39.648910 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:39.648910 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:39.648910 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:39.648910 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:39.648910 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:39.648910 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:28:39.648910 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 115/221] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 16:28:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:39.650001 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b2a5a-fbf4-4349-8cb4-e427ade600cb None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:39.650001 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b2a5a-fbf4-4349-8cb4-e427ade600cb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:39.650196 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b2a5a-fbf4-4349-8cb4-e427ade600cb None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:39.653313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 116/222] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:39.655368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b2a5a-fbf4-4349-8cb4-e427ade600cb None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:39.671263 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbda5d0-17bc-489d-849f-5ea2d3fb98b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:39.672155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbda5d0-17bc-489d-849f-5ea2d3fb98b4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:39.672415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbda5d0-17bc-489d-849f-5ea2d3fb98b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:39.672683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbda5d0-17bc-489d-849f-5ea2d3fb98b4 None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:39.673990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbda5d0-17bc-489d-849f-5ea2d3fb98b4 None admin] RBAC: Authorizing `identity:get_project(project_id=30b0d97406c64a4d8830d98d414453ed)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:39.675477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbda5d0-17bc-489d-849f-5ea2d3fb98b4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:39.682541 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 107/223] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:39 2022] GET /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:39.684045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a645f-4de0-4c6b-9c4a-fce17e624793 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:39.684335 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a645f-4de0-4c6b-9c4a-fce17e624793 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:39.684611 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a645f-4de0-4c6b-9c4a-fce17e624793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:39.703996 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-537a645f-4de0-4c6b-9c4a-fce17e624793 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:39.705201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-537a645f-4de0-4c6b-9c4a-fce17e624793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:39.737060 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:39.789109 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 108/224] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:39.789945 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b2a5a-fbf4-4349-8cb4-e427ade600cb None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:39.790068 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a645f-4de0-4c6b-9c4a-fce17e624793 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:39.806620 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:39.835540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67dfb4-47cd-46dd-92d5-60a3e88931db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:39.836527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67dfb4-47cd-46dd-92d5-60a3e88931db None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:39.836960 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67dfb4-47cd-46dd-92d5-60a3e88931db None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:39.837432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67dfb4-47cd-46dd-92d5-60a3e88931db None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:39.838588 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67dfb4-47cd-46dd-92d5-60a3e88931db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:39.839054 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67dfb4-47cd-46dd-92d5-60a3e88931db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:39.840739 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67dfb4-47cd-46dd-92d5-60a3e88931db None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:39.853007 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 117/225] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:28:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:39.854238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67dfb4-47cd-46dd-92d5-60a3e88931db None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:39.917506 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a645f-4de0-4c6b-9c4a-fce17e624793 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:39.974634 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c552b-355e-4dae-bbe3-5f54f0f1ae43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:39.975752 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c552b-355e-4dae-bbe3-5f54f0f1ae43 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:39.976246 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c552b-355e-4dae-bbe3-5f54f0f1ae43 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:39.976864 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c552b-355e-4dae-bbe3-5f54f0f1ae43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:39.978789 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c552b-355e-4dae-bbe3-5f54f0f1ae43 None admin] RBAC: Adding query filter params (role.id=cdbaa8196c574e32a331e8d4faee1a7e, scope.project.id=30b0d97406c64a4d8830d98d414453ed, user.id=3a2989d9132e4f63957940c6efd5784f) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:39.979659 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c552b-355e-4dae-bbe3-5f54f0f1ae43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:39.982643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c552b-355e-4dae-bbe3-5f54f0f1ae43 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:39.993341 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 109/226] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:28:39 2022] GET /identity/v3/role_assignments?user.id=3a2989d9132e4f63957940c6efd5784f&scope.project.id=30b0d97406c64a4d8830d98d414453ed&role.id=cdbaa8196c574e32a331e8d4faee1a7e => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:39.995511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c552b-355e-4dae-bbe3-5f54f0f1ae43 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:40.000075 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67dfb4-47cd-46dd-92d5-60a3e88931db None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:40.079984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:40.092949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb073b18-00a1-409f-97e1-3ff9d18c984b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:40.093821 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb073b18-00a1-409f-97e1-3ff9d18c984b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:40.094106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb073b18-00a1-409f-97e1-3ff9d18c984b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:40.094381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb073b18-00a1-409f-97e1-3ff9d18c984b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:40.124347 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb073b18-00a1-409f-97e1-3ff9d18c984b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:40.141613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-bb073b18-00a1-409f-97e1-3ff9d18c984b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:40.141613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:40.141613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:40.141613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:40.141613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:40.141613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:40.141613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:40.141613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:40.141613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:40.141613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:40.141613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:40.141613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:40.141613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:40.141613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:40.141613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:40.141613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:40.143079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:40.143079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:40.143079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:40.143079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:40.143079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:40.143079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:40.143079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:40.143079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:40.143079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:40.143079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:40.143079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:40.143079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:28:40.143079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:40.143079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:40.143079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:40.143079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:40.144395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:40.144395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:40.144395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:40.144395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:40.144395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:40.144395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:40.144395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:40.144395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:40.144395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:40.144395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:40.144395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:40.144395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:28:40.145586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 118/227] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:28:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:40.154136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb073b18-00a1-409f-97e1-3ff9d18c984b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:40.241802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:40.250534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c552b-355e-4dae-bbe3-5f54f0f1ae43 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:40.315719 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d8073-c183-48b1-83ec-5b50de7de08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:40.316589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d8073-c183-48b1-83ec-5b50de7de08d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:40.316905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d8073-c183-48b1-83ec-5b50de7de08d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:40.317177 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d8073-c183-48b1-83ec-5b50de7de08d None admin] PATH_INFO: `/v3/users/f324b1a60e9240e89b1e8cadd19cdaaa` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:40.320490 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d8073-c183-48b1-83ec-5b50de7de08d None admin] RBAC: Authorizing `identity:get_user(user_id=f324b1a60e9240e89b1e8cadd19cdaaa)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:40.321992 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d8073-c183-48b1-83ec-5b50de7de08d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:40.323700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 110/228] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:39 2022] GET /identity/v3/users/f324b1a60e9240e89b1e8cadd19cdaaa => generated 283 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:40.330921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d8073-c183-48b1-83ec-5b50de7de08d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:40.392235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb073b18-00a1-409f-97e1-3ff9d18c984b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:40.462367 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0dd3d-54a6-4ef2-8d45-0c9c77d5252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:40.463670 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0dd3d-54a6-4ef2-8d45-0c9c77d5252d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:40.464204 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0dd3d-54a6-4ef2-8d45-0c9c77d5252d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:40.464759 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0dd3d-54a6-4ef2-8d45-0c9c77d5252d None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:40.465757 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0dd3d-54a6-4ef2-8d45-0c9c77d5252d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:40.466722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0dd3d-54a6-4ef2-8d45-0c9c77d5252d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:40.468623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0dd3d-54a6-4ef2-8d45-0c9c77d5252d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:40.480871 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 119/229] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:40.490591 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0dd3d-54a6-4ef2-8d45-0c9c77d5252d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:40.526961 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d8073-c183-48b1-83ec-5b50de7de08d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:40.529690 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:40.576171 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6c381-682e-4190-aadf-5363246e5853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:40.577197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6c381-682e-4190-aadf-5363246e5853 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:40.577714 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6c381-682e-4190-aadf-5363246e5853 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:40.578202 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6c381-682e-4190-aadf-5363246e5853 None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:40.580440 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6c381-682e-4190-aadf-5363246e5853 None admin] RBAC: Authorizing `identity:get_project(project_id=30b0d97406c64a4d8830d98d414453ed)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:40.581953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6c381-682e-4190-aadf-5363246e5853 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:40.584752 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 111/230] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:40 2022] GET /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:40.590830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6c381-682e-4190-aadf-5363246e5853 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:40.714658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0dd3d-54a6-4ef2-8d45-0c9c77d5252d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:40.716628 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:40.750060 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6c381-682e-4190-aadf-5363246e5853 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:40.760617 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97941d3-81e1-43db-9fcb-ca9c740f3a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:40.761629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97941d3-81e1-43db-9fcb-ca9c740f3a98 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:40.761906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97941d3-81e1-43db-9fcb-ca9c740f3a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:40.762318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97941d3-81e1-43db-9fcb-ca9c740f3a98 None admin] PATH_INFO: `/v3/users/f324b1a60e9240e89b1e8cadd19cdaaa` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:40.769059 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97941d3-81e1-43db-9fcb-ca9c740f3a98 None admin] RBAC: Authorizing `identity:get_user(user_id=f324b1a60e9240e89b1e8cadd19cdaaa)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:40.771393 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97941d3-81e1-43db-9fcb-ca9c740f3a98 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:40.774867 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 120/231] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:40 2022] GET /identity/v3/users/f324b1a60e9240e89b1e8cadd19cdaaa => generated 283 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:40.792219 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97941d3-81e1-43db-9fcb-ca9c740f3a98 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:40.796919 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513a580-684f-4584-ad46-7db4c28e2e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:40.797870 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513a580-684f-4584-ad46-7db4c28e2e58 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:40.798152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513a580-684f-4584-ad46-7db4c28e2e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:40.798430 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513a580-684f-4584-ad46-7db4c28e2e58 None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed/users/f324b1a60e9240e89b1e8cadd19cdaaa/roles/c8d1d9031cfc4ef8a0e62f6bfd7ff691` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:40.801630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513a580-684f-4584-ad46-7db4c28e2e58 None admin] RBAC: Authorizing `identity:create_grant(project_id=30b0d97406c64a4d8830d98d414453ed, user_id=f324b1a60e9240e89b1e8cadd19cdaaa, role_id=c8d1d9031cfc4ef8a0e62f6bfd7ff691)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:40.803124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513a580-684f-4584-ad46-7db4c28e2e58 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:40.927299 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97941d3-81e1-43db-9fcb-ca9c740f3a98 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:40.930044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 112/232] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:28:40 2022] PUT /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed/users/f324b1a60e9240e89b1e8cadd19cdaaa/roles/c8d1d9031cfc4ef8a0e62f6bfd7ff691 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:28:40.974141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c685dad-9ede-4d2c-9912-92943cea0681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:40.975465 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c685dad-9ede-4d2c-9912-92943cea0681 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:40.975999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c685dad-9ede-4d2c-9912-92943cea0681 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:40.976292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c685dad-9ede-4d2c-9912-92943cea0681 None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:40.977805 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c685dad-9ede-4d2c-9912-92943cea0681 None admin] RBAC: Authorizing `identity:get_project(project_id=30b0d97406c64a4d8830d98d414453ed)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:40.979373 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c685dad-9ede-4d2c-9912-92943cea0681 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:40.981696 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 121/233] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:40 2022] GET /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:40.988020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513a580-684f-4584-ad46-7db4c28e2e58 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:41.028631 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:41.159839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513a580-684f-4584-ad46-7db4c28e2e58 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:41.214179 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9bd16-a481-46bb-a2ca-55ad95ca25ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:41.215138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9bd16-a481-46bb-a2ca-55ad95ca25ff None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:41.215441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9bd16-a481-46bb-a2ca-55ad95ca25ff None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:41.215747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9bd16-a481-46bb-a2ca-55ad95ca25ff None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed/users/f324b1a60e9240e89b1e8cadd19cdaaa/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:41.218672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9bd16-a481-46bb-a2ca-55ad95ca25ff None admin] RBAC: Authorizing `identity:create_grant(project_id=30b0d97406c64a4d8830d98d414453ed, user_id=f324b1a60e9240e89b1e8cadd19cdaaa, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:41.220160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9bd16-a481-46bb-a2ca-55ad95ca25ff None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:41.400944 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 113/234] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:28:40 2022] PUT /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed/users/f324b1a60e9240e89b1e8cadd19cdaaa/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:41.901980 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1d1e1-3594-4ae8-9255-dfdc76774783 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:41.902530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1d1e1-3594-4ae8-9255-dfdc76774783 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:41.902530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1d1e1-3594-4ae8-9255-dfdc76774783 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:41.903955 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 122/235] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:41.909577 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653d5d9-04b6-4cb7-9edd-cd4bc924c063 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:41.910355 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653d5d9-04b6-4cb7-9edd-cd4bc924c063 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:41.911334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653d5d9-04b6-4cb7-9edd-cd4bc924c063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:41.934260 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e653d5d9-04b6-4cb7-9edd-cd4bc924c063 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:41.935896 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e653d5d9-04b6-4cb7-9edd-cd4bc924c063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:41.950756 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054add7b-b755-44b1-bc9b-e2ecbff87033 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:41.951328 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054add7b-b755-44b1-bc9b-e2ecbff87033 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:41.951608 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054add7b-b755-44b1-bc9b-e2ecbff87033 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:41.953311 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 123/236] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:41.964934 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b4357-dfef-4c2a-b86f-0eb7603ba22e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:41.965551 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b4357-dfef-4c2a-b86f-0eb7603ba22e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:41.966024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b4357-dfef-4c2a-b86f-0eb7603ba22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:41.988630 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9f0b4357-dfef-4c2a-b86f-0eb7603ba22e None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:41.990493 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9f0b4357-dfef-4c2a-b86f-0eb7603ba22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:42.049960 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:42.068026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 114/237] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:42.116113 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 124/238] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:42.123463 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653d5d9-04b6-4cb7-9edd-cd4bc924c063 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:42.141014 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:42.149399 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b4357-dfef-4c2a-b86f-0eb7603ba22e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:42.315496 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653d5d9-04b6-4cb7-9edd-cd4bc924c063 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:42.350735 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b4357-dfef-4c2a-b86f-0eb7603ba22e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:42.397897 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7ff93-ca02-4d4d-8dc8-7e74678bb76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:42.401744 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7ff93-ca02-4d4d-8dc8-7e74678bb76b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:42.401744 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7ff93-ca02-4d4d-8dc8-7e74678bb76b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:42.401744 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7ff93-ca02-4d4d-8dc8-7e74678bb76b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:42.401744 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7ff93-ca02-4d4d-8dc8-7e74678bb76b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:42.403963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7ff93-ca02-4d4d-8dc8-7e74678bb76b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:42.406128 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 125/239] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:28:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:42.411002 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97f77d-5e48-4449-a0cd-de4c353efb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:42.412169 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97f77d-5e48-4449-a0cd-de4c353efb68 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:42.412653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97f77d-5e48-4449-a0cd-de4c353efb68 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:42.413118 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97f77d-5e48-4449-a0cd-de4c353efb68 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:42.415506 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7ff93-ca02-4d4d-8dc8-7e74678bb76b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:42.438601 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97f77d-5e48-4449-a0cd-de4c353efb68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:42.447128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-cc97f77d-5e48-4449-a0cd-de4c353efb68 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:42.447128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:42.447128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:42.447128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:42.447128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:42.447128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:42.447128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:42.447128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:42.447128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:42.447128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:42.447128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:42.447128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:42.447128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:42.447128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:42.447128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:42.447128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:42.471021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:42.471021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:42.471021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:42.471021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:42.471021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:42.471021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:42.471021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:42.471021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:42.471021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:42.471021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:42.471021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:42.471021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:28:42.471021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:42.471021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:42.471021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:42.471021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:42.472138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:42.472138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:42.472138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:42.472138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:42.472138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:42.472138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:42.472138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:42.472138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:42.472138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:42.472138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:42.472138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:42.472138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:28:42.472138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 115/240] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:42.472138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97f77d-5e48-4449-a0cd-de4c353efb68 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:42.483319 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:42.609844 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:42.630068 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7ff93-ca02-4d4d-8dc8-7e74678bb76b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:42.658923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97f77d-5e48-4449-a0cd-de4c353efb68 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:42.680840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb425c9-b5e0-4fad-8a09-eba27b801f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:42.681686 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb425c9-b5e0-4fad-8a09-eba27b801f1e None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:42.681985 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb425c9-b5e0-4fad-8a09-eba27b801f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:42.682261 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb425c9-b5e0-4fad-8a09-eba27b801f1e None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:42.682983 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb425c9-b5e0-4fad-8a09-eba27b801f1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:42.684575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb425c9-b5e0-4fad-8a09-eba27b801f1e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:42.698791 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb425c6-d9bb-427a-bd61-77d53220b00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:42.699818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb425c6-d9bb-427a-bd61-77d53220b00f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:42.700330 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb425c6-d9bb-427a-bd61-77d53220b00f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:42.700811 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb425c6-d9bb-427a-bd61-77d53220b00f None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:42.701888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb425c6-d9bb-427a-bd61-77d53220b00f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:42.702401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb425c6-d9bb-427a-bd61-77d53220b00f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:42.704035 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb425c6-d9bb-427a-bd61-77d53220b00f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:42.714175 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 116/241] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:28:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:42.719440 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb425c6-d9bb-427a-bd61-77d53220b00f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:42.828401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb425c6-d9bb-427a-bd61-77d53220b00f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:42.836783 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 126/242] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 16:28:42 2022] POST /identity/v3/users => generated 293 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:42.845868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97615d68-9dfc-4cdc-a013-96d2924887bc None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:42.845868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97615d68-9dfc-4cdc-a013-96d2924887bc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:42.845868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97615d68-9dfc-4cdc-a013-96d2924887bc None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:42.849309 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 127/243] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:42.855734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93520f8b-e0a8-42b3-984b-52cab26d3c3d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:42.856520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93520f8b-e0a8-42b3-984b-52cab26d3c3d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:42.857027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93520f8b-e0a8-42b3-984b-52cab26d3c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:42.878113 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-93520f8b-e0a8-42b3-984b-52cab26d3c3d None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:42.880570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-93520f8b-e0a8-42b3-984b-52cab26d3c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:42.914056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41a6d9-8073-446d-8388-0d7a05dd93db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:42.915936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41a6d9-8073-446d-8388-0d7a05dd93db None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:42.916454 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41a6d9-8073-446d-8388-0d7a05dd93db None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:42.916937 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41a6d9-8073-446d-8388-0d7a05dd93db None admin] PATH_INFO: `/v3/users/121c50ec8c874104a517b931eaada8c9` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:42.923734 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:42.956901 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41a6d9-8073-446d-8388-0d7a05dd93db None admin] RBAC: Authorizing `identity:get_user(user_id=121c50ec8c874104a517b931eaada8c9)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:42.960077 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41a6d9-8073-446d-8388-0d7a05dd93db None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:42.965868 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 117/244] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:42 2022] GET /identity/v3/users/121c50ec8c874104a517b931eaada8c9 => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:42.968403 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41a6d9-8073-446d-8388-0d7a05dd93db None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:43.027958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 128/245] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:43.062169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93520f8b-e0a8-42b3-984b-52cab26d3c3d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:43.098388 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:43.158741 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41a6d9-8073-446d-8388-0d7a05dd93db None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:43.214486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93520f8b-e0a8-42b3-984b-52cab26d3c3d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:43.214810 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df055eb-9dfe-483b-84e0-e6973f263660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:43.215611 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df055eb-9dfe-483b-84e0-e6973f263660 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.215909 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df055eb-9dfe-483b-84e0-e6973f263660 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.216210 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df055eb-9dfe-483b-84e0-e6973f263660 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.256493 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9ae84-030e-4c71-9894-bc798fa57759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:43.257332 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9ae84-030e-4c71-9894-bc798fa57759 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.257616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9ae84-030e-4c71-9894-bc798fa57759 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.257884 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9ae84-030e-4c71-9894-bc798fa57759 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.273249 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9ae84-030e-4c71-9894-bc798fa57759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:43.281982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-f7e9ae84-030e-4c71-9894-bc798fa57759 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:43.281982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:43.281982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:43.281982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:43.281982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:43.281982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:43.281982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:43.281982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:43.281982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:43.281982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:43.281982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:43.281982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:43.281982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:43.281982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:43.281982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:43.281982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:43.283147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:43.283147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:43.283147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:43.283147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:43.283147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:43.283147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:43.283147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:43.283147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:43.283147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:43.283147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:43.283147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:43.283147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:28:43.283147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:43.283147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:43.283147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:43.283147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:43.284203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:43.284203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:43.284203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:43.284203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:43.284203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:43.284203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:43.284203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:43.284203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:43.284203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:43.284203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:43.284203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:43.284203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:28:43.286322 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 129/246] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:43.301835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9ae84-030e-4c71-9894-bc798fa57759 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:43.311026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:43.319244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df055eb-9dfe-483b-84e0-e6973f263660 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:43.323781 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df055eb-9dfe-483b-84e0-e6973f263660 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:43.400154 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:43.444918 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 118/247] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:28:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:28:43.448296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9ae84-030e-4c71-9894-bc798fa57759 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:43.451221 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df055eb-9dfe-483b-84e0-e6973f263660 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:43.489431 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b364e53-ed47-4a96-b16b-1214203e3c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:43.490659 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b364e53-ed47-4a96-b16b-1214203e3c23 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.491203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b364e53-ed47-4a96-b16b-1214203e3c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.491725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b364e53-ed47-4a96-b16b-1214203e3c23 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.492745 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b364e53-ed47-4a96-b16b-1214203e3c23 None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:43.493288 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b364e53-ed47-4a96-b16b-1214203e3c23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:43.494900 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b364e53-ed47-4a96-b16b-1214203e3c23 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:43.507759 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 130/248] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:28:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:43.512338 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b364e53-ed47-4a96-b16b-1214203e3c23 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:43.567511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:43.575872 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df055eb-9dfe-483b-84e0-e6973f263660 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:43.617873 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2694555-1659-4bf0-b70d-34d09a0abf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:43.619068 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2694555-1659-4bf0-b70d-34d09a0abf76 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.619557 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2694555-1659-4bf0-b70d-34d09a0abf76 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.620040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2694555-1659-4bf0-b70d-34d09a0abf76 None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.622383 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2694555-1659-4bf0-b70d-34d09a0abf76 None admin] RBAC: Authorizing `identity:get_project(project_id=30b0d97406c64a4d8830d98d414453ed)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:43.624128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2694555-1659-4bf0-b70d-34d09a0abf76 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:43.626544 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 119/249] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:43 2022] GET /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:43.633577 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2694555-1659-4bf0-b70d-34d09a0abf76 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:43.654905 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b364e53-ed47-4a96-b16b-1214203e3c23 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:43.697333 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a65963-96b8-4fed-b1aa-9f03aa5bacfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:43.698327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a65963-96b8-4fed-b1aa-9f03aa5bacfe None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.698709 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a65963-96b8-4fed-b1aa-9f03aa5bacfe None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.699082 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a65963-96b8-4fed-b1aa-9f03aa5bacfe None admin] PATH_INFO: `/v3/users/3a2989d9132e4f63957940c6efd5784f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.700531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a65963-96b8-4fed-b1aa-9f03aa5bacfe None admin] RBAC: Authorizing `identity:get_user(user_id=3a2989d9132e4f63957940c6efd5784f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:43.702147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a65963-96b8-4fed-b1aa-9f03aa5bacfe None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:43.704049 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 131/250] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:43 2022] GET /identity/v3/users/3a2989d9132e4f63957940c6efd5784f => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:43.710030 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a65963-96b8-4fed-b1aa-9f03aa5bacfe None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:43.720735 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:43.755384 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2694555-1659-4bf0-b70d-34d09a0abf76 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:43.793707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9561d5e-534f-4837-96a0-7fddf61b001b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:43.794623 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9561d5e-534f-4837-96a0-7fddf61b001b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.795164 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9561d5e-534f-4837-96a0-7fddf61b001b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.795578 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9561d5e-534f-4837-96a0-7fddf61b001b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.797341 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9561d5e-534f-4837-96a0-7fddf61b001b None admin] RBAC: Adding query filter params (role.id=ab11da387f674277a602ab6e1e7e5b44, scope.project.id=30b0d97406c64a4d8830d98d414453ed, user.id=121c50ec8c874104a517b931eaada8c9) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:43.797838 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9561d5e-534f-4837-96a0-7fddf61b001b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:43.799872 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9561d5e-534f-4837-96a0-7fddf61b001b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:43.807184 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 120/251] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:28:43 2022] GET /identity/v3/role_assignments?user.id=121c50ec8c874104a517b931eaada8c9&scope.project.id=30b0d97406c64a4d8830d98d414453ed&role.id=ab11da387f674277a602ab6e1e7e5b44 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:43.864460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a65963-96b8-4fed-b1aa-9f03aa5bacfe None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:43.911464 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f77d6d-ac8e-4919-86cb-0cfdae8581cb None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.912402 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f77d6d-ac8e-4919-86cb-0cfdae8581cb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.912993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f77d6d-ac8e-4919-86cb-0cfdae8581cb None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.916206 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 121/252] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:28:43.924491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b57312-ea89-4092-b9c6-712e0dacd3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:43.925421 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b57312-ea89-4092-b9c6-712e0dacd3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.925791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b57312-ea89-4092-b9c6-712e0dacd3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.926636 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b57312-ea89-4092-b9c6-712e0dacd3b5 None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.928009 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d8379-e7b9-43ba-aa37-f88d79ed43b2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.928330 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d8379-e7b9-43ba-aa37-f88d79ed43b2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.928605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d8379-e7b9-43ba-aa37-f88d79ed43b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.934261 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b57312-ea89-4092-b9c6-712e0dacd3b5 None admin] RBAC: Authorizing `identity:get_project(project_id=30b0d97406c64a4d8830d98d414453ed)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:43.935771 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b57312-ea89-4092-b9c6-712e0dacd3b5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:43.937666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 132/253] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:43 2022] GET /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:43.943795 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b57312-ea89-4092-b9c6-712e0dacd3b5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:43.964711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-371d8379-e7b9-43ba-aa37-f88d79ed43b2 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:43.965936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-371d8379-e7b9-43ba-aa37-f88d79ed43b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:44.016749 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:44.095471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:44.158554 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 122/254] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:44.159763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b57312-ea89-4092-b9c6-712e0dacd3b5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:44.203121 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d8379-e7b9-43ba-aa37-f88d79ed43b2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:44.232098 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4534c-0c87-42ae-9091-bd65cfccd5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:44.234283 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4534c-0c87-42ae-9091-bd65cfccd5ba None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:44.234283 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4534c-0c87-42ae-9091-bd65cfccd5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:44.234283 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4534c-0c87-42ae-9091-bd65cfccd5ba None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed/users/3a2989d9132e4f63957940c6efd5784f/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:44.239575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4534c-0c87-42ae-9091-bd65cfccd5ba None admin] RBAC: Authorizing `identity:create_grant(project_id=30b0d97406c64a4d8830d98d414453ed, user_id=3a2989d9132e4f63957940c6efd5784f, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:44.241137 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4534c-0c87-42ae-9091-bd65cfccd5ba None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:44.348154 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 133/255] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:28:43 2022] PUT /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed/users/3a2989d9132e4f63957940c6efd5784f/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:28:44.348594 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d8379-e7b9-43ba-aa37-f88d79ed43b2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:44.406126 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e742ae4-591f-467b-abcd-4de5435f4f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:44.407434 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e742ae4-591f-467b-abcd-4de5435f4f07 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:44.407917 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e742ae4-591f-467b-abcd-4de5435f4f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:44.408457 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e742ae4-591f-467b-abcd-4de5435f4f07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:44.424109 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e742ae4-591f-467b-abcd-4de5435f4f07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:44.433777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-0e742ae4-591f-467b-abcd-4de5435f4f07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:44.433777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:44.433777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:44.433777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:44.433777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:44.433777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:44.433777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:44.433777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:44.433777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:44.433777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:44.433777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:44.433777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:44.433777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:44.433777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:44.433777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:44.433777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:44.434825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:44.434825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:44.434825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:44.434825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:44.434825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:44.434825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:44.434825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:44.434825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:44.434825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:44.434825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:44.434825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:44.434825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:28:44.434825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:44.434825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:44.434825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:44.434825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:44.435644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:44.435644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:44.435644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:44.435644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:44.435644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:44.435644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:44.435644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:44.435644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:44.435644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:44.435644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:44.435644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:28:44.435644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:28:44.438297 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 123/256] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 16:28:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:44.444906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4534c-0c87-42ae-9091-bd65cfccd5ba None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:44.608503 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4534c-0c87-42ae-9091-bd65cfccd5ba None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:44.664274 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b70f3e-8530-4d8d-b60a-0273ef1494e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:44.665372 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b70f3e-8530-4d8d-b60a-0273ef1494e7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:44.665854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b70f3e-8530-4d8d-b60a-0273ef1494e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:44.666327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b70f3e-8530-4d8d-b60a-0273ef1494e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:44.667369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b70f3e-8530-4d8d-b60a-0273ef1494e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:44.667894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b70f3e-8530-4d8d-b60a-0273ef1494e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:44.669529 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b70f3e-8530-4d8d-b60a-0273ef1494e7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:44.677288 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:44.690876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 134/257] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:28:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:44.696532 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e742ae4-591f-467b-abcd-4de5435f4f07 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:44.732119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:44.810038 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec546c-ce12-460e-83c1-6019909976dc None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:44.810369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec546c-ce12-460e-83c1-6019909976dc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:44.810665 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec546c-ce12-460e-83c1-6019909976dc None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:44.812611 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 135/258] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:28:44.826897 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114c28b-7880-4e0e-8f1c-d2d4ea64ed6c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:44.827205 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114c28b-7880-4e0e-8f1c-d2d4ea64ed6c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:44.827452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114c28b-7880-4e0e-8f1c-d2d4ea64ed6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:44.831979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e742ae4-591f-467b-abcd-4de5435f4f07 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:44.870424 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2114c28b-7880-4e0e-8f1c-d2d4ea64ed6c None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:44.871623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2114c28b-7880-4e0e-8f1c-d2d4ea64ed6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:44.872227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9b2c5-9956-4d48-bc49-3932bd92b047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:44.873121 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9b2c5-9956-4d48-bc49-3932bd92b047 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:44.873445 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9b2c5-9956-4d48-bc49-3932bd92b047 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:44.873724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9b2c5-9956-4d48-bc49-3932bd92b047 None admin] PATH_INFO: `/v3/users/f324b1a60e9240e89b1e8cadd19cdaaa` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:44.874956 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9b2c5-9956-4d48-bc49-3932bd92b047 None admin] RBAC: Authorizing `identity:get_user(user_id=f324b1a60e9240e89b1e8cadd19cdaaa)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:44.876415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9b2c5-9956-4d48-bc49-3932bd92b047 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:44.878388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 124/259] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:44 2022] GET /identity/v3/users/f324b1a60e9240e89b1e8cadd19cdaaa => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:44.884403 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9b2c5-9956-4d48-bc49-3932bd92b047 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:44.973638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:44.991191 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9b2c5-9956-4d48-bc49-3932bd92b047 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:45.028429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a419d-60aa-4a39-8eac-b0c11ec03469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:45.029103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a419d-60aa-4a39-8eac-b0c11ec03469 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:45.029418 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a419d-60aa-4a39-8eac-b0c11ec03469 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:45.029696 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a419d-60aa-4a39-8eac-b0c11ec03469 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:45.103520 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a419d-60aa-4a39-8eac-b0c11ec03469 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:45.105011 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a419d-60aa-4a39-8eac-b0c11ec03469 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:45.123719 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 136/260] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:45.159880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114c28b-7880-4e0e-8f1c-d2d4ea64ed6c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:45.198248 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:45.219379 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 125/261] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:28:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:28:45.226557 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a419d-60aa-4a39-8eac-b0c11ec03469 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:45.340170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a419d-60aa-4a39-8eac-b0c11ec03469 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:45.382134 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b41abf-dc35-43ee-b31a-59cd17677751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:45.382933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b41abf-dc35-43ee-b31a-59cd17677751 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:45.383220 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b41abf-dc35-43ee-b31a-59cd17677751 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:45.383506 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b41abf-dc35-43ee-b31a-59cd17677751 None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:45.384718 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b41abf-dc35-43ee-b31a-59cd17677751 None admin] RBAC: Authorizing `identity:get_project(project_id=30b0d97406c64a4d8830d98d414453ed)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:45.386797 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b41abf-dc35-43ee-b31a-59cd17677751 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:45.388869 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 126/262] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:45 2022] GET /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:45.397223 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b41abf-dc35-43ee-b31a-59cd17677751 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:45.406405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114c28b-7880-4e0e-8f1c-d2d4ea64ed6c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:45.437625 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:45.466554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca7cb9-a9e2-4201-aaab-603ef52f5e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:45.467924 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca7cb9-a9e2-4201-aaab-603ef52f5e2d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:45.468385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca7cb9-a9e2-4201-aaab-603ef52f5e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:45.468861 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca7cb9-a9e2-4201-aaab-603ef52f5e2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:45.487772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca7cb9-a9e2-4201-aaab-603ef52f5e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:45.490137 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:45.506726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-4fca7cb9-a9e2-4201-aaab-603ef52f5e2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:45.506726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:45.506726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:45.506726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:45.506726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:45.506726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:45.506726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:45.506726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:45.506726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:45.506726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:45.506726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:45.506726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:45.506726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:45.506726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:45.506726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:45.506726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:45.507760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:45.507760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:45.507760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:45.507760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:45.507760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:45.507760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:45.507760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:45.507760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:45.507760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:45.507760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:45.507760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:45.507760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:28:45.507760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:45.507760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:45.507760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:45.507760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:45.508539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:45.508539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:45.508539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:45.508539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:45.508539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:45.508539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:45.508539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:45.508539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:45.508539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:45.508539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:45.508539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:45.508539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:28:45.511280 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 137/263] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:28:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:45.517719 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca7cb9-a9e2-4201-aaab-603ef52f5e2d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:45.656141 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b41abf-dc35-43ee-b31a-59cd17677751 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:45.662902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca7cb9-a9e2-4201-aaab-603ef52f5e2d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:45.705192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67447d39-bf76-4e4d-8dc1-6d7b37c7e0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:45.705565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67447d39-bf76-4e4d-8dc1-6d7b37c7e0cd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:45.705827 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67447d39-bf76-4e4d-8dc1-6d7b37c7e0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:45.706191 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67447d39-bf76-4e4d-8dc1-6d7b37c7e0cd None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:45.706851 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67447d39-bf76-4e4d-8dc1-6d7b37c7e0cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:45.707188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67447d39-bf76-4e4d-8dc1-6d7b37c7e0cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:45.708570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67447d39-bf76-4e4d-8dc1-6d7b37c7e0cd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:45.718916 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 138/264] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:45.726883 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67447d39-bf76-4e4d-8dc1-6d7b37c7e0cd None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:45.769501 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a3ad6-92d0-40c6-aa1d-53edad9bc4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:45.770242 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a3ad6-92d0-40c6-aa1d-53edad9bc4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:45.770549 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a3ad6-92d0-40c6-aa1d-53edad9bc4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:45.770839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a3ad6-92d0-40c6-aa1d-53edad9bc4b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:45.771649 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a3ad6-92d0-40c6-aa1d-53edad9bc4b1 None admin] RBAC: Adding query filter params (role.id=c8d1d9031cfc4ef8a0e62f6bfd7ff691, scope.project.id=30b0d97406c64a4d8830d98d414453ed, user.id=f324b1a60e9240e89b1e8cadd19cdaaa) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:45.771964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a3ad6-92d0-40c6-aa1d-53edad9bc4b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:45.781284 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a3ad6-92d0-40c6-aa1d-53edad9bc4b1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:45.784649 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 127/265] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:28:45 2022] GET /identity/v3/role_assignments?user.id=f324b1a60e9240e89b1e8cadd19cdaaa&scope.project.id=30b0d97406c64a4d8830d98d414453ed&role.id=c8d1d9031cfc4ef8a0e62f6bfd7ff691 => generated 608 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:45.825298 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:45.881516 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67447d39-bf76-4e4d-8dc1-6d7b37c7e0cd None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:45.943370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62642520-9b26-4e55-a16d-4d44896a2c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:45.944642 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62642520-9b26-4e55-a16d-4d44896a2c71 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:45.945138 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62642520-9b26-4e55-a16d-4d44896a2c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:45.945751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62642520-9b26-4e55-a16d-4d44896a2c71 None admin] PATH_INFO: `/v3/users/f324b1a60e9240e89b1e8cadd19cdaaa` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:45.950124 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62642520-9b26-4e55-a16d-4d44896a2c71 None admin] RBAC: Authorizing `identity:get_user(user_id=f324b1a60e9240e89b1e8cadd19cdaaa)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:45.951958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62642520-9b26-4e55-a16d-4d44896a2c71 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:45.954352 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 139/266] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:45 2022] GET /identity/v3/users/f324b1a60e9240e89b1e8cadd19cdaaa => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:45.960272 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a3ad6-92d0-40c6-aa1d-53edad9bc4b1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:46.145319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a3ad6-92d0-40c6-aa1d-53edad9bc4b1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:46.170681 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:46.185312 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174343d-8e31-4375-a87d-2b0efa71ce1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:46.192832 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174343d-8e31-4375-a87d-2b0efa71ce1a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:46.192832 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174343d-8e31-4375-a87d-2b0efa71ce1a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:46.192832 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174343d-8e31-4375-a87d-2b0efa71ce1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:46.265991 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174343d-8e31-4375-a87d-2b0efa71ce1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:46.267512 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174343d-8e31-4375-a87d-2b0efa71ce1a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:46.381512 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 128/267] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:28:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:46.384465 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62642520-9b26-4e55-a16d-4d44896a2c71 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:46.558316 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62642520-9b26-4e55-a16d-4d44896a2c71 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:46.581686 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:46.609129 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fb370-eb3a-4713-9bd2-d629a5b48d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:46.610294 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fb370-eb3a-4713-9bd2-d629a5b48d63 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:46.610727 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fb370-eb3a-4713-9bd2-d629a5b48d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:46.611089 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fb370-eb3a-4713-9bd2-d629a5b48d63 None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:46.616875 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fb370-eb3a-4713-9bd2-d629a5b48d63 None admin] RBAC: Authorizing `identity:get_project(project_id=30b0d97406c64a4d8830d98d414453ed)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:46.618512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fb370-eb3a-4713-9bd2-d629a5b48d63 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:46.620569 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 140/268] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:46 2022] GET /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:46.630535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174343d-8e31-4375-a87d-2b0efa71ce1a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:46.658353 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:46.769070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174343d-8e31-4375-a87d-2b0efa71ce1a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:46.821378 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c310c7d-85aa-4c05-9c09-a57966e0f627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:46.821988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c310c7d-85aa-4c05-9c09-a57966e0f627 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:46.822282 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c310c7d-85aa-4c05-9c09-a57966e0f627 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:46.822568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c310c7d-85aa-4c05-9c09-a57966e0f627 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:46.823425 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c310c7d-85aa-4c05-9c09-a57966e0f627 None admin] RBAC: Adding query filter params (role.id=796e313fa8794ac885ccf6300d09332a, scope.project.id=30b0d97406c64a4d8830d98d414453ed, user.id=f324b1a60e9240e89b1e8cadd19cdaaa) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:46.823743 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c310c7d-85aa-4c05-9c09-a57966e0f627 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:46.830733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c310c7d-85aa-4c05-9c09-a57966e0f627 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:46.838097 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 129/269] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:28:46 2022] GET /identity/v3/role_assignments?user.id=f324b1a60e9240e89b1e8cadd19cdaaa&scope.project.id=30b0d97406c64a4d8830d98d414453ed&role.id=796e313fa8794ac885ccf6300d09332a => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:46.950470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864186b4-75c6-406d-ab75-e3b900ca60b2 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:46.951118 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864186b4-75c6-406d-ab75-e3b900ca60b2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:46.951608 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864186b4-75c6-406d-ab75-e3b900ca60b2 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:46.953754 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 141/270] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:46.960473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794a07c-6969-4af0-9011-56569e77ed2a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:46.961037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794a07c-6969-4af0-9011-56569e77ed2a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:46.961573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794a07c-6969-4af0-9011-56569e77ed2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:46.967774 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be0b7b-c7b0-4a55-be1e-f2d49a1ee1ed None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:46.968394 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be0b7b-c7b0-4a55-be1e-f2d49a1ee1ed None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:46.968900 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be0b7b-c7b0-4a55-be1e-f2d49a1ee1ed None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:46.971106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 142/271] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:28:46.978105 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb126662-c612-4eac-bdde-9f97bbeb3eb9 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:46.978723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb126662-c612-4eac-bdde-9f97bbeb3eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:46.979195 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb126662-c612-4eac-bdde-9f97bbeb3eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:47.005156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5794a07c-6969-4af0-9011-56569e77ed2a None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:47.008490 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5794a07c-6969-4af0-9011-56569e77ed2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:47.015239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-bb126662-c612-4eac-bdde-9f97bbeb3eb9 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:47.016899 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bb126662-c612-4eac-bdde-9f97bbeb3eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:47.149362 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 143/272] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:47.151415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd4b0-9e0f-4431-ab5f-01b2b952c3c6 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:47.151880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd4b0-9e0f-4431-ab5f-01b2b952c3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:47.152286 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd4b0-9e0f-4431-ab5f-01b2b952c3c6 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:47.154113 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 144/273] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:47.157959 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 130/274] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:47.160332 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5166c8f-18db-4691-9f39-a2d12beb12b3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:47.160828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5166c8f-18db-4691-9f39-a2d12beb12b3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:47.161377 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5166c8f-18db-4691-9f39-a2d12beb12b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:47.183793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f5166c8f-18db-4691-9f39-a2d12beb12b3 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:47.184550 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794a07c-6969-4af0-9011-56569e77ed2a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:47.185254 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f5166c8f-18db-4691-9f39-a2d12beb12b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:47.203319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:47.289415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 145/275] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:47.290705 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5166c8f-18db-4691-9f39-a2d12beb12b3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:47.307533 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794a07c-6969-4af0-9011-56569e77ed2a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:47.348751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c27935-80e0-4c61-abe4-9645e91fe1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:47.349644 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:47.350872 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c27935-80e0-4c61-abe4-9645e91fe1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:47.351154 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c27935-80e0-4c61-abe4-9645e91fe1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:47.351430 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c27935-80e0-4c61-abe4-9645e91fe1c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:47.352641 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c27935-80e0-4c61-abe4-9645e91fe1c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:47.354313 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c27935-80e0-4c61-abe4-9645e91fe1c9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:47.364211 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 131/276] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:28:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:47.364211 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c27935-80e0-4c61-abe4-9645e91fe1c9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:47.427957 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5166c8f-18db-4691-9f39-a2d12beb12b3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:47.459786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:47.468069 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd10ea8-ca51-4f48-9bb1-ba6fbb73d0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:47.468873 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd10ea8-ca51-4f48-9bb1-ba6fbb73d0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:47.469153 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd10ea8-ca51-4f48-9bb1-ba6fbb73d0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:47.469454 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd10ea8-ca51-4f48-9bb1-ba6fbb73d0d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:47.481588 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd10ea8-ca51-4f48-9bb1-ba6fbb73d0d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:47.484553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c27935-80e0-4c61-abe4-9645e91fe1c9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:47.489937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-fdd10ea8-ca51-4f48-9bb1-ba6fbb73d0d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:47.489937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:47.489937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:47.489937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:47.489937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:47.489937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:47.489937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:47.489937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:47.489937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:47.489937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:47.489937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:47.489937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:47.489937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:47.489937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:47.489937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:47.489937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:47.490999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:47.490999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:47.490999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:47.490999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:47.490999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:47.490999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:47.490999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:47.490999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:47.490999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:47.490999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:47.490999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:47.490999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:28:47.490999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:47.490999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:47.490999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:47.490999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:47.491868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:47.491868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:47.491868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:47.491868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:47.491868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:47.491868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:47.491868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:47.491868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:47.491868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:47.491868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:47.491868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:47.491868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:28:47.491868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 146/277] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:47.492518 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd10ea8-ca51-4f48-9bb1-ba6fbb73d0d7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:47.540501 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0f88b-db71-4516-b228-48c94f2cc27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:47.541442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0f88b-db71-4516-b228-48c94f2cc27e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:47.541666 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0f88b-db71-4516-b228-48c94f2cc27e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:47.541939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0f88b-db71-4516-b228-48c94f2cc27e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:47.553800 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0f88b-db71-4516-b228-48c94f2cc27e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:47.562462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-c7c0f88b-db71-4516-b228-48c94f2cc27e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:47.562462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:47.562462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:47.562462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:47.562462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:47.562462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:47.562462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:47.562462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:47.562462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:47.562462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:47.562462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:47.562462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:47.562462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:47.562462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:47.562462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:47.562462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:47.563735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:47.563735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:47.563735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:47.563735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:47.563735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:47.563735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:47.563735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:47.563735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:47.563735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:47.563735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:47.563735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:47.563735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:28:47.563735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:47.563735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:47.563735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:47.563735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:47.564707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:47.564707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:47.564707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:47.564707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:47.564707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:47.564707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:47.564707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:47.564707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:47.564707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:47.564707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:47.564707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:47.564707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:28:47.564707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 132/278] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:47.564707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0f88b-db71-4516-b228-48c94f2cc27e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:47.619391 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd10ea8-ca51-4f48-9bb1-ba6fbb73d0d7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:47.623206 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:47.657616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0bd68-3566-499a-91c9-f25e45882168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:47.658577 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0bd68-3566-499a-91c9-f25e45882168 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:47.659010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0bd68-3566-499a-91c9-f25e45882168 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:47.659425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0bd68-3566-499a-91c9-f25e45882168 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:47.660328 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0bd68-3566-499a-91c9-f25e45882168 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:47.661981 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0bd68-3566-499a-91c9-f25e45882168 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:47.687774 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0f88b-db71-4516-b228-48c94f2cc27e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:47.723801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f5749-be74-4db2-b0c5-0348e52d270b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:47.733309 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f5749-be74-4db2-b0c5-0348e52d270b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:47.733309 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f5749-be74-4db2-b0c5-0348e52d270b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:47.733309 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f5749-be74-4db2-b0c5-0348e52d270b None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:47.733309 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f5749-be74-4db2-b0c5-0348e52d270b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:47.733309 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f5749-be74-4db2-b0c5-0348e52d270b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:47.733309 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f5749-be74-4db2-b0c5-0348e52d270b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:47.733790 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:47.736417 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 133/279] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:28:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:47.737193 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f5749-be74-4db2-b0c5-0348e52d270b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:47.799501 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 147/280] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 16:28:47 2022] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:47.801447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03d032-6feb-41a2-9e36-42bc4a47b7e6 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:47.801744 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03d032-6feb-41a2-9e36-42bc4a47b7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:47.802037 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03d032-6feb-41a2-9e36-42bc4a47b7e6 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:47.808723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 148/281] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:47.808723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03d032-6feb-41a2-9e36-42bc4a47b7e6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:47.851713 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f5749-be74-4db2-b0c5-0348e52d270b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:47.910384 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b888472-2492-4a59-89e6-8f393066148e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:47.911084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b888472-2492-4a59-89e6-8f393066148e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:47.911435 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b888472-2492-4a59-89e6-8f393066148e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:47.911727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b888472-2492-4a59-89e6-8f393066148e None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:47.912542 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b888472-2492-4a59-89e6-8f393066148e None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:47.912853 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b888472-2492-4a59-89e6-8f393066148e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:47.914543 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b888472-2492-4a59-89e6-8f393066148e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:47.926866 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 134/282] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:28:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:47.928004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cb0b4-7196-4762-a358-e9e6f4b1787c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:47.928292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cb0b4-7196-4762-a358-e9e6f4b1787c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:47.928563 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cb0b4-7196-4762-a358-e9e6f4b1787c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:47.958304 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c68cb0b4-7196-4762-a358-e9e6f4b1787c None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:47.959445 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c68cb0b4-7196-4762-a358-e9e6f4b1787c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:47.966828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03d032-6feb-41a2-9e36-42bc4a47b7e6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:48.015180 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f47cca-4685-4501-a8a7-ae143baa58fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:48.016120 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f47cca-4685-4501-a8a7-ae143baa58fe None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:48.016387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f47cca-4685-4501-a8a7-ae143baa58fe None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:48.016671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f47cca-4685-4501-a8a7-ae143baa58fe None admin] PATH_INFO: `/v3/users/121c50ec8c874104a517b931eaada8c9` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:48.017948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f47cca-4685-4501-a8a7-ae143baa58fe None admin] RBAC: Authorizing `identity:get_user(user_id=121c50ec8c874104a517b931eaada8c9)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:48.019720 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f47cca-4685-4501-a8a7-ae143baa58fe None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:48.021283 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 149/283] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:47 2022] GET /identity/v3/users/121c50ec8c874104a517b931eaada8c9 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:48.021283 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f47cca-4685-4501-a8a7-ae143baa58fe None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:48.031397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:48.044851 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 135/284] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:48.045157 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cb0b4-7196-4762-a358-e9e6f4b1787c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:48.072028 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:48.181033 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f47cca-4685-4501-a8a7-ae143baa58fe None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:48.204417 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cb0b4-7196-4762-a358-e9e6f4b1787c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:48.231265 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcf0de-1d19-4f0f-8a2a-83528687eef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:48.232077 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcf0de-1d19-4f0f-8a2a-83528687eef4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:48.232358 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcf0de-1d19-4f0f-8a2a-83528687eef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:48.232632 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcf0de-1d19-4f0f-8a2a-83528687eef4 None admin] PATH_INFO: `/v3/users/a6bbc02e206f4046b35d3b32baf87497` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:48.250642 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcf0de-1d19-4f0f-8a2a-83528687eef4 None admin] RBAC: Authorizing `identity:get_user(user_id=a6bbc02e206f4046b35d3b32baf87497)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:48.252132 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcf0de-1d19-4f0f-8a2a-83528687eef4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:48.257385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 150/285] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:48 2022] GET /identity/v3/users/a6bbc02e206f4046b35d3b32baf87497 => generated 293 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:48.257385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcf0de-1d19-4f0f-8a2a-83528687eef4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:48.270401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25097d5-b4c5-48e3-ae9b-67e20a284c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:48.273284 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25097d5-b4c5-48e3-ae9b-67e20a284c73 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:48.274011 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25097d5-b4c5-48e3-ae9b-67e20a284c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:48.274677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25097d5-b4c5-48e3-ae9b-67e20a284c73 None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:48.277155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25097d5-b4c5-48e3-ae9b-67e20a284c73 None admin] RBAC: Authorizing `identity:get_project(project_id=30b0d97406c64a4d8830d98d414453ed)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:48.279873 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25097d5-b4c5-48e3-ae9b-67e20a284c73 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:48.283070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 136/286] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:48 2022] GET /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:48.284345 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25097d5-b4c5-48e3-ae9b-67e20a284c73 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:48.369993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:48.379475 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:48.396112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcf0de-1d19-4f0f-8a2a-83528687eef4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:48.433369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25097d5-b4c5-48e3-ae9b-67e20a284c73 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:48.440925 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d951f-2170-4179-b004-2a017725bcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:48.441821 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d951f-2170-4179-b004-2a017725bcb0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:48.442120 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d951f-2170-4179-b004-2a017725bcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:48.442487 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d951f-2170-4179-b004-2a017725bcb0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:48.459862 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d951f-2170-4179-b004-2a017725bcb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:48.468218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-7e0d951f-2170-4179-b004-2a017725bcb0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:48.468218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:48.468218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:48.468218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:48.468218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:48.468218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:48.468218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:48.468218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:48.468218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:48.468218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:48.468218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:48.468218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:48.468218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:48.468218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:48.468218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:48.468218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:48.469432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:48.469432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:48.469432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:48.469432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:48.469432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:48.469432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:48.469432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:48.469432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:48.469432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:48.469432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:48.469432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:48.469432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:28:48.469432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:48.469432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:48.469432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:48.469432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:48.470460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:48.470460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:48.470460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:48.470460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:48.470460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:48.470460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:48.470460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:48.470460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:48.470460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:48.470460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:48.470460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:48.470460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:28:48.470460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 151/287] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:48.470460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d951f-2170-4179-b004-2a017725bcb0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:48.493466 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2d072-7ffe-47fe-8ec9-e868aa8837b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:48.494449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2d072-7ffe-47fe-8ec9-e868aa8837b5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:48.494914 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2d072-7ffe-47fe-8ec9-e868aa8837b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:48.495383 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2d072-7ffe-47fe-8ec9-e868aa8837b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:48.496635 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2d072-7ffe-47fe-8ec9-e868aa8837b5 None admin] RBAC: Adding query filter params (role.id=cdbaa8196c574e32a331e8d4faee1a7e, user.id=a6bbc02e206f4046b35d3b32baf87497, scope.system=all) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:48.497124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2d072-7ffe-47fe-8ec9-e868aa8837b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:48.498788 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2d072-7ffe-47fe-8ec9-e868aa8837b5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:48.508694 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 137/288] 10.222.0.48 () {56 vars in 1308 bytes} [Thu May 26 16:28:48 2022] GET /identity/v3/role_assignments?user.id=a6bbc02e206f4046b35d3b32baf87497&scope.system=all&role.id=cdbaa8196c574e32a331e8d4faee1a7e => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:48.509900 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2d072-7ffe-47fe-8ec9-e868aa8837b5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:48.661750 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2d072-7ffe-47fe-8ec9-e868aa8837b5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:48.703894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d951f-2170-4179-b004-2a017725bcb0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:48.709680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:48.724935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6380dc9-76a6-42a3-b0dd-12cd75d872be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:48.725659 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6380dc9-76a6-42a3-b0dd-12cd75d872be None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:48.725953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6380dc9-76a6-42a3-b0dd-12cd75d872be None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:48.726247 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6380dc9-76a6-42a3-b0dd-12cd75d872be None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:48.727012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6380dc9-76a6-42a3-b0dd-12cd75d872be None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:48.727316 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6380dc9-76a6-42a3-b0dd-12cd75d872be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:48.728853 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6380dc9-76a6-42a3-b0dd-12cd75d872be None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:48.760239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 138/289] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:28:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:48.765644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6380dc9-76a6-42a3-b0dd-12cd75d872be None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:48.791247 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335649ec-5ff0-4a82-a469-40f2393d7a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:48.792969 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335649ec-5ff0-4a82-a469-40f2393d7a58 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:48.793526 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335649ec-5ff0-4a82-a469-40f2393d7a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:48.794075 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335649ec-5ff0-4a82-a469-40f2393d7a58 None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed/users/121c50ec8c874104a517b931eaada8c9/roles/ab11da387f674277a602ab6e1e7e5b44` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:48.796542 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335649ec-5ff0-4a82-a469-40f2393d7a58 None admin] RBAC: Authorizing `identity:create_grant(project_id=30b0d97406c64a4d8830d98d414453ed, user_id=121c50ec8c874104a517b931eaada8c9, role_id=ab11da387f674277a602ab6e1e7e5b44)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:48.798840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335649ec-5ff0-4a82-a469-40f2393d7a58 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:48.880715 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 152/290] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:28:48 2022] PUT /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed/users/121c50ec8c874104a517b931eaada8c9/roles/ab11da387f674277a602ab6e1e7e5b44 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:48.915489 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6380dc9-76a6-42a3-b0dd-12cd75d872be None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:48.974474 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b14850-c306-4421-a682-7acacd0d77f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:48.975805 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b14850-c306-4421-a682-7acacd0d77f5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:48.976311 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b14850-c306-4421-a682-7acacd0d77f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:48.976785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b14850-c306-4421-a682-7acacd0d77f5 None admin] PATH_INFO: `/v3/users/3a2989d9132e4f63957940c6efd5784f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:48.978572 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b14850-c306-4421-a682-7acacd0d77f5 None admin] RBAC: Authorizing `identity:get_user(user_id=3a2989d9132e4f63957940c6efd5784f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:48.980874 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b14850-c306-4421-a682-7acacd0d77f5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:48.983605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 139/291] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:48 2022] GET /identity/v3/users/3a2989d9132e4f63957940c6efd5784f => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:48.989781 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335649ec-5ff0-4a82-a469-40f2393d7a58 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:49.013758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:49.146563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335649ec-5ff0-4a82-a469-40f2393d7a58 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:49.196096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d3d44-4e60-4a51-b2b6-e4fce82494f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:49.196779 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d3d44-4e60-4a51-b2b6-e4fce82494f6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:49.197061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d3d44-4e60-4a51-b2b6-e4fce82494f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:49.197404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d3d44-4e60-4a51-b2b6-e4fce82494f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:49.291275 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d3d44-4e60-4a51-b2b6-e4fce82494f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:49.293092 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d3d44-4e60-4a51-b2b6-e4fce82494f6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:49.304122 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:49.435985 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 153/292] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:28:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:49.442109 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b14850-c306-4421-a682-7acacd0d77f5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:49.540238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:49.592537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b14850-c306-4421-a682-7acacd0d77f5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:49.642518 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85294c81-800f-4a12-85d3-ee03cb4b58bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:49.643745 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85294c81-800f-4a12-85d3-ee03cb4b58bc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:49.644258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85294c81-800f-4a12-85d3-ee03cb4b58bc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:49.644824 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85294c81-800f-4a12-85d3-ee03cb4b58bc None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:49.646340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85294c81-800f-4a12-85d3-ee03cb4b58bc None admin] RBAC: Authorizing `identity:get_project(project_id=30b0d97406c64a4d8830d98d414453ed)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:49.648301 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85294c81-800f-4a12-85d3-ee03cb4b58bc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:49.650641 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 140/293] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:49 2022] GET /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:49.656414 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d3d44-4e60-4a51-b2b6-e4fce82494f6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:49.776424 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d3d44-4e60-4a51-b2b6-e4fce82494f6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:49.785726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:49.832796 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39090301-fa5c-4ad5-a876-8cadaa3371f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:49.833490 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39090301-fa5c-4ad5-a876-8cadaa3371f2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:49.833775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39090301-fa5c-4ad5-a876-8cadaa3371f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:49.834047 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39090301-fa5c-4ad5-a876-8cadaa3371f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:49.835380 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39090301-fa5c-4ad5-a876-8cadaa3371f2 None admin] RBAC: Adding query filter params (role.id=cdbaa8196c574e32a331e8d4faee1a7e, scope.project.id=30b0d97406c64a4d8830d98d414453ed, user.id=3a2989d9132e4f63957940c6efd5784f) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:49.835690 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39090301-fa5c-4ad5-a876-8cadaa3371f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:49.837145 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39090301-fa5c-4ad5-a876-8cadaa3371f2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:49.849501 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 154/294] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:28:49 2022] GET /identity/v3/role_assignments?user.id=3a2989d9132e4f63957940c6efd5784f&scope.project.id=30b0d97406c64a4d8830d98d414453ed&role.id=cdbaa8196c574e32a331e8d4faee1a7e => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:50.896112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ec6ed-107d-4206-882a-06140fdb6519 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:50.896630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ec6ed-107d-4206-882a-06140fdb6519 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:50.897071 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ec6ed-107d-4206-882a-06140fdb6519 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:50.900201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 141/295] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:50.904754 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176814c-19bd-4867-bf7c-6918a9b9c3e0 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:50.905665 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176814c-19bd-4867-bf7c-6918a9b9c3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:50.906149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176814c-19bd-4867-bf7c-6918a9b9c3e0 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:50.908411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbac077-027f-4f12-8206-b0c41e65b531 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:50.908625 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 155/296] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:28:50.909169 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbac077-027f-4f12-8206-b0c41e65b531 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:50.909704 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbac077-027f-4f12-8206-b0c41e65b531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:50.914752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc6d61-3108-4b68-9cfb-0ccc383c8ef3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:50.915291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc6d61-3108-4b68-9cfb-0ccc383c8ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:50.915806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc6d61-3108-4b68-9cfb-0ccc383c8ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:50.928858 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9bbac077-027f-4f12-8206-b0c41e65b531 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:50.930160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9bbac077-027f-4f12-8206-b0c41e65b531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:50.934029 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-34bc6d61-3108-4b68-9cfb-0ccc383c8ef3 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:50.935595 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-34bc6d61-3108-4b68-9cfb-0ccc383c8ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:51.031036 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 142/297] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:51.037425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 156/298] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:51.058956 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbac077-027f-4f12-8206-b0c41e65b531 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:51.066501 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc6d61-3108-4b68-9cfb-0ccc383c8ef3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:51.133614 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:51.214345 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbac077-027f-4f12-8206-b0c41e65b531 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:51.224872 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:51.229954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc6d61-3108-4b68-9cfb-0ccc383c8ef3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:51.269660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c083558-8b79-4998-98aa-873f61a7e2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:51.270475 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c083558-8b79-4998-98aa-873f61a7e2fb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:51.270756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c083558-8b79-4998-98aa-873f61a7e2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:51.271031 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c083558-8b79-4998-98aa-873f61a7e2fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:51.274354 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c083558-8b79-4998-98aa-873f61a7e2fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:51.276240 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c083558-8b79-4998-98aa-873f61a7e2fb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:51.281508 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 143/299] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:28:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:51.283250 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fbc4f-f7e1-4bfd-9c10-a873956d4282 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:51.283545 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fbc4f-f7e1-4bfd-9c10-a873956d4282 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:51.283820 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fbc4f-f7e1-4bfd-9c10-a873956d4282 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:51.285587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 144/300] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:51.286164 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fbc4f-f7e1-4bfd-9c10-a873956d4282 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:51.301532 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93d559-8731-4136-8c3d-f6db2a06e290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:51.302456 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93d559-8731-4136-8c3d-f6db2a06e290 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:51.302739 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93d559-8731-4136-8c3d-f6db2a06e290 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:51.303011 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93d559-8731-4136-8c3d-f6db2a06e290 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:51.316057 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d93d559-8731-4136-8c3d-f6db2a06e290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:51.323173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6d93d559-8731-4136-8c3d-f6db2a06e290 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:51.323173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:51.323173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:51.323173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:51.323173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:51.323173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:51.323173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:51.323173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:51.323173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:51.323173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:51.323173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:51.323173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:51.323173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:51.323173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:51.323173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:51.323173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:51.324149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:51.324149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:51.324149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:51.324149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:51.324149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:51.324149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:51.324149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:51.324149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:51.324149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:51.324149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:51.324149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:51.324149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:28:51.324149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:51.324149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:51.324149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:51.324149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:51.325773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:51.325773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:51.325773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:51.325773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:51.325773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:51.325773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:51.325773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:51.325773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:51.325773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:51.325773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:51.325773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:51.325773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:28:51.325773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 157/301] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:51.326464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c9786-3db2-4aa2-8441-4951b1b44810 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:51.326464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c9786-3db2-4aa2-8441-4951b1b44810 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:51.326980 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c9786-3db2-4aa2-8441-4951b1b44810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:51.345594 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-886c9786-3db2-4aa2-8441-4951b1b44810 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:51.347015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-886c9786-3db2-4aa2-8441-4951b1b44810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:51.439042 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fbc4f-f7e1-4bfd-9c10-a873956d4282 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:51.443819 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 158/302] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:51.445133 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c9786-3db2-4aa2-8441-4951b1b44810 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:51.503112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:51.522863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa9aab-9be7-4977-a326-af9a9a6ba0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:51.523933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa9aab-9be7-4977-a326-af9a9a6ba0c9 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:51.524386 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa9aab-9be7-4977-a326-af9a9a6ba0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:51.527680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa9aab-9be7-4977-a326-af9a9a6ba0c9 None admin] PATH_INFO: `/v3/groups` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:51.527680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa9aab-9be7-4977-a326-af9a9a6ba0c9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:51.528652 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa9aab-9be7-4977-a326-af9a9a6ba0c9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:51.590118 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:51.602235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c9786-3db2-4aa2-8441-4951b1b44810 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:51.637612 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2d45c-3f44-4bf6-8f3a-3febac6fb75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:51.638300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2d45c-3f44-4bf6-8f3a-3febac6fb75e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:51.638581 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2d45c-3f44-4bf6-8f3a-3febac6fb75e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:51.638855 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2d45c-3f44-4bf6-8f3a-3febac6fb75e None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:51.639606 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2d45c-3f44-4bf6-8f3a-3febac6fb75e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:51.639943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2d45c-3f44-4bf6-8f3a-3febac6fb75e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:51.641351 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2d45c-3f44-4bf6-8f3a-3febac6fb75e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:51.650751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 159/303] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:28:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:51.651603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2d45c-3f44-4bf6-8f3a-3febac6fb75e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:51.677295 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 145/304] 10.222.0.48 () {60 vars in 1134 bytes} [Thu May 26 16:28:51 2022] POST /identity/v3/groups => generated 229 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:51.677295 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa9aab-9be7-4977-a326-af9a9a6ba0c9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:51.802267 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa9aab-9be7-4977-a326-af9a9a6ba0c9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:51.823211 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2d45c-3f44-4bf6-8f3a-3febac6fb75e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:51.849134 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19420b1c-12f8-47ec-94f0-4b7978bc6c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:51.850084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19420b1c-12f8-47ec-94f0-4b7978bc6c07 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:51.850535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19420b1c-12f8-47ec-94f0-4b7978bc6c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:51.850932 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19420b1c-12f8-47ec-94f0-4b7978bc6c07 None admin] PATH_INFO: `/v3/users/a329fc1b438a4667ab462705a5ad0932` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:51.866239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19420b1c-12f8-47ec-94f0-4b7978bc6c07 None admin] RBAC: Authorizing `identity:get_user(user_id=a329fc1b438a4667ab462705a5ad0932)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:51.867774 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19420b1c-12f8-47ec-94f0-4b7978bc6c07 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:51.869616 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 146/305] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:51 2022] GET /identity/v3/users/a329fc1b438a4667ab462705a5ad0932 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:51.870169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b3220-8490-4a50-ac7c-526accbac2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:51.870953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd0580-9ef5-474a-b59b-1a9fe6a06f81 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:51.871412 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd0580-9ef5-474a-b59b-1a9fe6a06f81 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:51.871630 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b3220-8490-4a50-ac7c-526accbac2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:51.871747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd0580-9ef5-474a-b59b-1a9fe6a06f81 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:51.872212 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b3220-8490-4a50-ac7c-526accbac2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:51.872708 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b3220-8490-4a50-ac7c-526accbac2a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:51.877740 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 147/306] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:51.879211 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd0580-9ef5-474a-b59b-1a9fe6a06f81 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:51.890929 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b3220-8490-4a50-ac7c-526accbac2a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:51.898806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-da2b3220-8490-4a50-ac7c-526accbac2a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:51.898806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:51.898806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:51.898806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:51.898806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:51.898806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:51.898806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:51.898806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:51.898806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:51.898806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:51.898806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:51.898806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:51.898806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:51.898806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:51.898806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:51.898806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:51.900563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:51.900563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:51.900563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:51.900563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:51.900563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:51.900563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:51.900563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:51.900563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:51.900563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:51.900563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:51.900563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:51.900563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:28:51.900563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:51.900563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:51.900563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:51.900563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:51.902418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:51.902418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:51.902418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:51.902418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:51.902418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:51.902418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:51.902418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:51.902418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:51.902418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:51.902418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:51.902418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:51.902418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:28:51.902418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 160/307] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:51.902418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5edbff-ea27-4b82-8cfe-3ed793d1adee None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:51.903436 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5edbff-ea27-4b82-8cfe-3ed793d1adee None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:51.903436 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5edbff-ea27-4b82-8cfe-3ed793d1adee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:51.921602 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5a5edbff-ea27-4b82-8cfe-3ed793d1adee None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:51.922827 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5a5edbff-ea27-4b82-8cfe-3ed793d1adee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:51.932316 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:51.952669 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:52.013469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 161/308] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:52.014704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5edbff-ea27-4b82-8cfe-3ed793d1adee None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:52.037638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd0580-9ef5-474a-b59b-1a9fe6a06f81 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:52.082900 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e13ed-7851-4fb8-a9a5-89521322d929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:52.083574 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e13ed-7851-4fb8-a9a5-89521322d929 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:52.083856 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e13ed-7851-4fb8-a9a5-89521322d929 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:52.084132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e13ed-7851-4fb8-a9a5-89521322d929 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:52.085347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e13ed-7851-4fb8-a9a5-89521322d929 None admin] RBAC: Adding query filter params (role.id=ab11da387f674277a602ab6e1e7e5b44, user.id=a329fc1b438a4667ab462705a5ad0932, scope.system=all) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:52.085553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e13ed-7851-4fb8-a9a5-89521322d929 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:52.087671 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e13ed-7851-4fb8-a9a5-89521322d929 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:52.093599 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 148/309] 10.222.0.48 () {56 vars in 1308 bytes} [Thu May 26 16:28:51 2022] GET /identity/v3/role_assignments?user.id=a329fc1b438a4667ab462705a5ad0932&scope.system=all&role.id=ab11da387f674277a602ab6e1e7e5b44 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:52.094629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e13ed-7851-4fb8-a9a5-89521322d929 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:52.194298 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5edbff-ea27-4b82-8cfe-3ed793d1adee None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:52.263214 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e13ed-7851-4fb8-a9a5-89521322d929 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:52.264427 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdb406-deb4-4d47-8e51-804807eb85ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:52.265292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdb406-deb4-4d47-8e51-804807eb85ba None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:52.266284 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:52.266447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdb406-deb4-4d47-8e51-804807eb85ba None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:52.267754 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdb406-deb4-4d47-8e51-804807eb85ba None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:52.270923 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdb406-deb4-4d47-8e51-804807eb85ba None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:52.271598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdb406-deb4-4d47-8e51-804807eb85ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:52.274427 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdb406-deb4-4d47-8e51-804807eb85ba None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:52.294798 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 162/310] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:28:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:52.306324 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdb406-deb4-4d47-8e51-804807eb85ba None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:52.315499 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:52.335748 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334412d8-89c1-4847-8fa6-2120692a1c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:52.337245 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334412d8-89c1-4847-8fa6-2120692a1c02 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:52.338137 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334412d8-89c1-4847-8fa6-2120692a1c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:52.338664 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334412d8-89c1-4847-8fa6-2120692a1c02 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:52.362679 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334412d8-89c1-4847-8fa6-2120692a1c02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:52.374950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-334412d8-89c1-4847-8fa6-2120692a1c02 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:52.374950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:52.374950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:52.374950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:52.374950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:52.374950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:52.374950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:52.374950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:52.374950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:52.374950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:52.374950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:52.374950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:52.374950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:52.374950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:52.374950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:52.374950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:52.375936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:52.375936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:52.375936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:52.375936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:52.375936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:52.375936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:52.375936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:52.375936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:52.375936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:52.375936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:52.375936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:52.375936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:28:52.375936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:52.375936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:52.375936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:52.375936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:52.376723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:52.376723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:52.376723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:52.376723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:52.376723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:52.376723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:52.376723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:52.376723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:52.376723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:52.376723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:52.376723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:52.376723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:28:52.380121 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 149/311] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:52.388148 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334412d8-89c1-4847-8fa6-2120692a1c02 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:52.512655 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdb406-deb4-4d47-8e51-804807eb85ba None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:52.535319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334412d8-89c1-4847-8fa6-2120692a1c02 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:52.579064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d5283-2625-44fb-8b41-e5be7ae39a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:52.579742 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d5283-2625-44fb-8b41-e5be7ae39a7c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:52.580026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d5283-2625-44fb-8b41-e5be7ae39a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:52.580302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d5283-2625-44fb-8b41-e5be7ae39a7c None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:52.581117 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d5283-2625-44fb-8b41-e5be7ae39a7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:52.581461 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d5283-2625-44fb-8b41-e5be7ae39a7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:52.583453 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d5283-2625-44fb-8b41-e5be7ae39a7c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:52.596401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 150/312] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:28:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:52.599797 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc025a0-6a7d-4b6f-aa04-6a66f3ac105d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:52.601186 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc025a0-6a7d-4b6f-aa04-6a66f3ac105d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:52.601754 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc025a0-6a7d-4b6f-aa04-6a66f3ac105d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:52.602256 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc025a0-6a7d-4b6f-aa04-6a66f3ac105d None admin] PATH_INFO: `/v3/users/a6bbc02e206f4046b35d3b32baf87497` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:52.602590 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d5283-2625-44fb-8b41-e5be7ae39a7c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:52.604185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc025a0-6a7d-4b6f-aa04-6a66f3ac105d None admin] RBAC: Authorizing `identity:get_user(user_id=a6bbc02e206f4046b35d3b32baf87497)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:52.606810 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc025a0-6a7d-4b6f-aa04-6a66f3ac105d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:52.609807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 163/313] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:52 2022] GET /identity/v3/users/a6bbc02e206f4046b35d3b32baf87497 => generated 293 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:52.616397 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc025a0-6a7d-4b6f-aa04-6a66f3ac105d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:52.641590 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:52.734190 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:52.741894 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d5283-2625-44fb-8b41-e5be7ae39a7c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:52.780917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc025a0-6a7d-4b6f-aa04-6a66f3ac105d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:52.791761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c790fbc-6766-436e-ba9e-80913649be53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:52.792787 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c790fbc-6766-436e-ba9e-80913649be53 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:52.793143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c790fbc-6766-436e-ba9e-80913649be53 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:52.793519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c790fbc-6766-436e-ba9e-80913649be53 None admin] PATH_INFO: `/v3/users/121c50ec8c874104a517b931eaada8c9` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:52.794819 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c790fbc-6766-436e-ba9e-80913649be53 None admin] RBAC: Authorizing `identity:get_user(user_id=121c50ec8c874104a517b931eaada8c9)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:52.796542 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c790fbc-6766-436e-ba9e-80913649be53 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:52.803180 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 151/314] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:52 2022] GET /identity/v3/users/121c50ec8c874104a517b931eaada8c9 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:52.804356 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c790fbc-6766-436e-ba9e-80913649be53 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:52.836692 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801decce-1933-4fec-85d2-940d35d05163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:52.837915 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801decce-1933-4fec-85d2-940d35d05163 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:52.838203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801decce-1933-4fec-85d2-940d35d05163 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:52.838505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801decce-1933-4fec-85d2-940d35d05163 None admin] PATH_INFO: `/v3/system/users/a6bbc02e206f4046b35d3b32baf87497/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:52.841235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801decce-1933-4fec-85d2-940d35d05163 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a6bbc02e206f4046b35d3b32baf87497, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:52.844104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801decce-1933-4fec-85d2-940d35d05163 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:52.921764 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:52.931502 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c790fbc-6766-436e-ba9e-80913649be53 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:52.950142 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 164/315] 10.222.0.48 () {58 vars in 1334 bytes} [Thu May 26 16:28:52 2022] PUT /identity/v3/system/users/a6bbc02e206f4046b35d3b32baf87497/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:28:52.994195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408eedf2-ad7b-4768-b12c-9ca4d8b43a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:52.996672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408eedf2-ad7b-4768-b12c-9ca4d8b43a67 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:52.997618 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408eedf2-ad7b-4768-b12c-9ca4d8b43a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:52.998395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408eedf2-ad7b-4768-b12c-9ca4d8b43a67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:53.088451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408eedf2-ad7b-4768-b12c-9ca4d8b43a67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:53.089996 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408eedf2-ad7b-4768-b12c-9ca4d8b43a67 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:53.196819 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:53.207359 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 152/316] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:28:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:28:53.212973 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801decce-1933-4fec-85d2-940d35d05163 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:53.340822 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801decce-1933-4fec-85d2-940d35d05163 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:53.384044 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6cceb-dfba-466f-ad85-40bc30bbc778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:53.385605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6cceb-dfba-466f-ad85-40bc30bbc778 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:53.386178 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6cceb-dfba-466f-ad85-40bc30bbc778 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:53.386685 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6cceb-dfba-466f-ad85-40bc30bbc778 None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:53.388858 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6cceb-dfba-466f-ad85-40bc30bbc778 None admin] RBAC: Authorizing `identity:get_project(project_id=30b0d97406c64a4d8830d98d414453ed)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:53.391680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6cceb-dfba-466f-ad85-40bc30bbc778 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:53.397353 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 165/317] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:28:53 2022] GET /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:53.401165 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408eedf2-ad7b-4768-b12c-9ca4d8b43a67 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:53.545724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408eedf2-ad7b-4768-b12c-9ca4d8b43a67 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:53.593933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d5b0c-f2bd-46af-944c-d84f55afbc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:53.594848 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d5b0c-f2bd-46af-944c-d84f55afbc4e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:53.595170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d5b0c-f2bd-46af-944c-d84f55afbc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:53.595479 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d5b0c-f2bd-46af-944c-d84f55afbc4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:53.596543 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d5b0c-f2bd-46af-944c-d84f55afbc4e None admin] RBAC: Adding query filter params (role.id=ab11da387f674277a602ab6e1e7e5b44, scope.project.id=30b0d97406c64a4d8830d98d414453ed, user.id=121c50ec8c874104a517b931eaada8c9) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:53.597117 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d5b0c-f2bd-46af-944c-d84f55afbc4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:53.599434 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d5b0c-f2bd-46af-944c-d84f55afbc4e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:53.607603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 153/318] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:28:53 2022] GET /identity/v3/role_assignments?user.id=121c50ec8c874104a517b931eaada8c9&scope.project.id=30b0d97406c64a4d8830d98d414453ed&role.id=ab11da387f674277a602ab6e1e7e5b44 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:54.211002 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063147f-7cd4-4303-bc1e-864d56c87dae None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:54.211542 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063147f-7cd4-4303-bc1e-864d56c87dae None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:54.211542 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063147f-7cd4-4303-bc1e-864d56c87dae None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:54.212938 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 166/319] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:54.219067 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acba09-7893-4ad7-9f4a-e78ae164a843 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:54.219534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acba09-7893-4ad7-9f4a-e78ae164a843 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:54.219718 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acba09-7893-4ad7-9f4a-e78ae164a843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:54.239437 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-76acba09-7893-4ad7-9f4a-e78ae164a843 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:54.240671 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-76acba09-7893-4ad7-9f4a-e78ae164a843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:54.300238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:54.319402 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 154/320] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:54.342255 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063147f-7cd4-4303-bc1e-864d56c87dae None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:54.346497 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:54.455862 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063147f-7cd4-4303-bc1e-864d56c87dae None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:54.494687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f06f0-4284-4521-9505-eac5d95162c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:54.495491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f06f0-4284-4521-9505-eac5d95162c3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:54.495773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f06f0-4284-4521-9505-eac5d95162c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:54.496045 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f06f0-4284-4521-9505-eac5d95162c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:54.497395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f06f0-4284-4521-9505-eac5d95162c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:54.498850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f06f0-4284-4521-9505-eac5d95162c3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:54.500670 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 167/321] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:28:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:54.506734 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acba09-7893-4ad7-9f4a-e78ae164a843 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:54.619218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acba09-7893-4ad7-9f4a-e78ae164a843 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:54.655911 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806de9b6-cd5e-4b57-858f-cd31b6c71095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:54.656588 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806de9b6-cd5e-4b57-858f-cd31b6c71095 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:54.656866 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806de9b6-cd5e-4b57-858f-cd31b6c71095 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:54.657209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806de9b6-cd5e-4b57-858f-cd31b6c71095 None admin] PATH_INFO: `/v3/groups` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:54.657890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806de9b6-cd5e-4b57-858f-cd31b6c71095 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:54.659416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806de9b6-cd5e-4b57-858f-cd31b6c71095 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:54.745824 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcee62-3e11-4d93-befb-cb967a0735b0 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:54.746205 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcee62-3e11-4d93-befb-cb967a0735b0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:54.746508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcee62-3e11-4d93-befb-cb967a0735b0 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:54.749486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 168/322] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:28:54.756497 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2d2c6-ea67-4419-8e69-a741bf1f3b54 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:54.756951 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2d2c6-ea67-4419-8e69-a741bf1f3b54 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:54.757507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2d2c6-ea67-4419-8e69-a741bf1f3b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:54.777254 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3bb2d2c6-ea67-4419-8e69-a741bf1f3b54 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:54.778755 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3bb2d2c6-ea67-4419-8e69-a741bf1f3b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:54.797638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 155/323] 10.222.0.48 () {60 vars in 1134 bytes} [Thu May 26 16:28:54 2022] POST /identity/v3/groups => generated 226 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:54.862131 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 169/324] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:54.884928 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806de9b6-cd5e-4b57-858f-cd31b6c71095 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:54.951031 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:55.015928 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806de9b6-cd5e-4b57-858f-cd31b6c71095 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:55.056885 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40926bdb-62d5-4728-a950-8eb10fd31891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:55.057754 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40926bdb-62d5-4728-a950-8eb10fd31891 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:55.058043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40926bdb-62d5-4728-a950-8eb10fd31891 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:55.058353 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40926bdb-62d5-4728-a950-8eb10fd31891 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:55.076519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40926bdb-62d5-4728-a950-8eb10fd31891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:55.089656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-40926bdb-62d5-4728-a950-8eb10fd31891 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:55.089656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:55.089656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:55.089656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:55.089656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:55.089656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:55.089656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:55.089656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:55.089656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:55.089656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:55.089656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:55.089656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:55.089656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:55.089656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:55.089656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:55.089656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:55.090683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:55.090683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:55.090683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:55.090683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:55.090683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:55.090683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:55.090683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:55.090683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:55.090683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:55.090683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:55.090683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:55.090683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:28:55.090683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:55.090683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:55.090683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:55.090683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:55.091507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:55.091507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:55.091507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:55.091507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:55.091507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:55.091507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:55.091507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:55.091507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:55.091507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:55.091507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:55.091507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:28:55.091507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:28:55.092326 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 156/325] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:55.098823 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2d2c6-ea67-4419-8e69-a741bf1f3b54 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:55.103622 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:55.250489 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2d2c6-ea67-4419-8e69-a741bf1f3b54 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:55.314324 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4847198-c74d-4f62-a37f-af00c8242563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:55.315411 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4847198-c74d-4f62-a37f-af00c8242563 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:55.315880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4847198-c74d-4f62-a37f-af00c8242563 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:55.316995 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4847198-c74d-4f62-a37f-af00c8242563 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:55.318332 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4847198-c74d-4f62-a37f-af00c8242563 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:55.318804 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4847198-c74d-4f62-a37f-af00c8242563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:55.320926 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4847198-c74d-4f62-a37f-af00c8242563 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:55.334577 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 170/326] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:28:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:55.343223 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40926bdb-62d5-4728-a950-8eb10fd31891 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:55.530380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40926bdb-62d5-4728-a950-8eb10fd31891 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:55.544587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:55.598832 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40add79f-f2a1-4b65-9e3f-fefc966dea87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:55.600316 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40add79f-f2a1-4b65-9e3f-fefc966dea87 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:55.600802 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40add79f-f2a1-4b65-9e3f-fefc966dea87 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:55.601372 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40add79f-f2a1-4b65-9e3f-fefc966dea87 None admin] PATH_INFO: `/v3/users/a329fc1b438a4667ab462705a5ad0932` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:55.603978 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40add79f-f2a1-4b65-9e3f-fefc966dea87 None admin] RBAC: Authorizing `identity:get_user(user_id=a329fc1b438a4667ab462705a5ad0932)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:55.606680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40add79f-f2a1-4b65-9e3f-fefc966dea87 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:55.613726 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 157/327] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:55 2022] GET /identity/v3/users/a329fc1b438a4667ab462705a5ad0932 => generated 293 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:55.619231 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4847198-c74d-4f62-a37f-af00c8242563 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:55.746247 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:55.757999 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5b9e2-6041-4897-aec7-0bffad53c8c1 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:55.758471 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5b9e2-6041-4897-aec7-0bffad53c8c1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:55.758954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5b9e2-6041-4897-aec7-0bffad53c8c1 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:55.766798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 158/328] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:55 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:28:55.772178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd60839-401f-4ec6-a007-14e3a50d3869 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:55.772436 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd60839-401f-4ec6-a007-14e3a50d3869 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:55.772734 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd60839-401f-4ec6-a007-14e3a50d3869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:55.807517 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3fd60839-401f-4ec6-a007-14e3a50d3869 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:55.810124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3fd60839-401f-4ec6-a007-14e3a50d3869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:55.831222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4847198-c74d-4f62-a37f-af00c8242563 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:55.901534 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb13f6-a7dc-40ee-af26-b52a6a4d3f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:55.903423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb13f6-a7dc-40ee-af26-b52a6a4d3f31 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:55.904981 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb13f6-a7dc-40ee-af26-b52a6a4d3f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:55.905751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb13f6-a7dc-40ee-af26-b52a6a4d3f31 None admin] PATH_INFO: `/v3/system/users/a329fc1b438a4667ab462705a5ad0932/roles/ab11da387f674277a602ab6e1e7e5b44` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:55.909386 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb13f6-a7dc-40ee-af26-b52a6a4d3f31 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a329fc1b438a4667ab462705a5ad0932, role_id=ab11da387f674277a602ab6e1e7e5b44)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:55.914366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb13f6-a7dc-40ee-af26-b52a6a4d3f31 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:55.958668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 159/329] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:28:55.991039 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd60839-401f-4ec6-a007-14e3a50d3869 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:56.011875 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 171/330] 10.222.0.48 () {58 vars in 1334 bytes} [Thu May 26 16:28:55 2022] PUT /identity/v3/system/users/a329fc1b438a4667ab462705a5ad0932/roles/ab11da387f674277a602ab6e1e7e5b44 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:56.152406 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd60839-401f-4ec6-a007-14e3a50d3869 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:56.181858 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:56.199306 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f37ed0-4fd5-43ac-8b96-529431db4e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:56.200209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f37ed0-4fd5-43ac-8b96-529431db4e82 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:56.200497 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f37ed0-4fd5-43ac-8b96-529431db4e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:56.200796 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f37ed0-4fd5-43ac-8b96-529431db4e82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:56.214878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f37ed0-4fd5-43ac-8b96-529431db4e82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:56.223400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-05f37ed0-4fd5-43ac-8b96-529431db4e82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:56.223400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:56.223400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:56.223400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:56.223400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:56.223400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:56.223400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:56.223400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:56.223400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:56.223400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:56.223400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:56.223400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:56.223400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:56.223400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:56.223400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:56.223400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:56.224985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:56.224985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:56.224985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:56.224985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:56.224985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:56.224985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:56.224985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:56.224985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:56.224985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:56.224985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:56.224985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:56.224985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:28:56.224985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:56.224985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:56.224985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:56.224985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:56.226212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:56.226212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:56.226212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:56.226212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:56.226212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:56.226212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:56.226212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:56.226212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:56.226212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:56.226212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:56.226212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:56.226212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:28:56.226212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 160/331] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:56.235910 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb13f6-a7dc-40ee-af26-b52a6a4d3f31 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:56.373615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb13f6-a7dc-40ee-af26-b52a6a4d3f31 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:56.404226 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:56.413894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3832c88-acc7-4a02-aac3-6f9187a802c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:56.414594 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3832c88-acc7-4a02-aac3-6f9187a802c7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:56.414877 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3832c88-acc7-4a02-aac3-6f9187a802c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:56.415155 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3832c88-acc7-4a02-aac3-6f9187a802c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:56.415922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3832c88-acc7-4a02-aac3-6f9187a802c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:56.416230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3832c88-acc7-4a02-aac3-6f9187a802c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:56.417675 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3832c88-acc7-4a02-aac3-6f9187a802c7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:56.430222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 172/332] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:28:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:56.435861 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f37ed0-4fd5-43ac-8b96-529431db4e82 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:56.569334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f37ed0-4fd5-43ac-8b96-529431db4e82 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:56.612782 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a69790-e132-4ebd-b961-b6774e174edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:56.613762 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a69790-e132-4ebd-b961-b6774e174edb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:56.614045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a69790-e132-4ebd-b961-b6774e174edb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:56.614320 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a69790-e132-4ebd-b961-b6774e174edb None admin] PATH_INFO: `/v3/users/a6bbc02e206f4046b35d3b32baf87497` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:56.615573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a69790-e132-4ebd-b961-b6774e174edb None admin] RBAC: Authorizing `identity:get_user(user_id=a6bbc02e206f4046b35d3b32baf87497)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:56.617125 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a69790-e132-4ebd-b961-b6774e174edb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:56.619620 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 161/333] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:28:56 2022] GET /identity/v3/users/a6bbc02e206f4046b35d3b32baf87497 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:56.625987 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3832c88-acc7-4a02-aac3-6f9187a802c7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:56.771977 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3832c88-acc7-4a02-aac3-6f9187a802c7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:56.819757 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9397c02-bc48-488a-ad4f-6eaf50d34dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:56.822831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9397c02-bc48-488a-ad4f-6eaf50d34dfa None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:56.823323 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9397c02-bc48-488a-ad4f-6eaf50d34dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:56.823873 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9397c02-bc48-488a-ad4f-6eaf50d34dfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:56.824912 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9397c02-bc48-488a-ad4f-6eaf50d34dfa None admin] RBAC: Adding query filter params (role.id=cdbaa8196c574e32a331e8d4faee1a7e, user.id=a6bbc02e206f4046b35d3b32baf87497, scope.system=all) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:56.825427 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9397c02-bc48-488a-ad4f-6eaf50d34dfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:56.831269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9397c02-bc48-488a-ad4f-6eaf50d34dfa None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:56.855208 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 173/334] 10.222.0.48 () {56 vars in 1308 bytes} [Thu May 26 16:28:56 2022] GET /identity/v3/role_assignments?user.id=a6bbc02e206f4046b35d3b32baf87497&scope.system=all&role.id=cdbaa8196c574e32a331e8d4faee1a7e => generated 510 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:58.483817 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287224ae-e4b0-48a4-a0a2-62d501d7b078 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:58.484744 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287224ae-e4b0-48a4-a0a2-62d501d7b078 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:58.485170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287224ae-e4b0-48a4-a0a2-62d501d7b078 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:58.486955 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 162/335] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:28:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:28:58.494020 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b6f53-b506-4060-aa88-000f10313ce6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:58.495338 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b6f53-b506-4060-aa88-000f10313ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:58.496023 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b6f53-b506-4060-aa88-000f10313ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:58.528176 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-975b6f53-b506-4060-aa88-000f10313ce6 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:58.529795 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-975b6f53-b506-4060-aa88-000f10313ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:58.593578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:58.622351 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 174/336] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:28:58.669464 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287224ae-e4b0-48a4-a0a2-62d501d7b078 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:58.741796 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:58.892968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287224ae-e4b0-48a4-a0a2-62d501d7b078 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:58.952080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8185e-d5b8-474e-8178-59867360d2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:58.952917 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8185e-d5b8-474e-8178-59867360d2eb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:58.953193 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8185e-d5b8-474e-8178-59867360d2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:58.953495 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8185e-d5b8-474e-8178-59867360d2eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:58.977151 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8185e-d5b8-474e-8178-59867360d2eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:58.995913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-24c8185e-d5b8-474e-8178-59867360d2eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:58.995913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:58.995913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:58.995913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:58.995913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:58.995913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:58.995913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:58.995913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:58.995913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:58.995913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:58.995913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:58.995913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:58.995913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:58.995913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:58.995913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:58.995913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:58.997658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:58.997658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:58.997658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:58.997658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:58.997658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:58.997658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:58.997658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:58.997658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:58.997658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:58.997658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:58.997658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:58.997658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:28:58.997658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:58.997658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:58.997658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:58.997658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:58.999421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:58.999421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:58.999421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:58.999421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:58.999421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:58.999421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:58.999421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:58.999421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:58.999421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:58.999421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:58.999421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:28:58.999421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:28:58.999421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 163/337] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:28:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:59.008408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b6f53-b506-4060-aa88-000f10313ce6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:59.258160 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b6f53-b506-4060-aa88-000f10313ce6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:59.342900 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e033c2-2e62-414c-b55f-4da234a50be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:59.345287 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e033c2-2e62-414c-b55f-4da234a50be3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:59.346445 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e033c2-2e62-414c-b55f-4da234a50be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:59.347857 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e033c2-2e62-414c-b55f-4da234a50be3 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:59.350253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e033c2-2e62-414c-b55f-4da234a50be3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:59.351416 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e033c2-2e62-414c-b55f-4da234a50be3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:59.354602 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e033c2-2e62-414c-b55f-4da234a50be3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:59.374396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 175/338] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:28:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:59.380931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8185e-d5b8-474e-8178-59867360d2eb None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:59.659182 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:59.677019 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8185e-d5b8-474e-8178-59867360d2eb None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:59.790726 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c65dce-89ff-4eed-9e13-674309f48285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:59.791787 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c65dce-89ff-4eed-9e13-674309f48285 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:59.792258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c65dce-89ff-4eed-9e13-674309f48285 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:59.792718 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c65dce-89ff-4eed-9e13-674309f48285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:00.046785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c65dce-89ff-4eed-9e13-674309f48285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:00.053445 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c65dce-89ff-4eed-9e13-674309f48285 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:00.106406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a6909-aff4-43cd-8b5c-90fb3cef4443 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:00.114167 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a6909-aff4-43cd-8b5c-90fb3cef4443 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:00.114965 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a6909-aff4-43cd-8b5c-90fb3cef4443 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:00.118062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 176/339] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:00 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:00.124060 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b75e98-e729-4333-890e-5e21bc87f640 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:00.124449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b75e98-e729-4333-890e-5e21bc87f640 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:00.124691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b75e98-e729-4333-890e-5e21bc87f640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:00.178002 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-74b75e98-e729-4333-890e-5e21bc87f640 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:00.179208 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-74b75e98-e729-4333-890e-5e21bc87f640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:00.283055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:00.351164 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 177/340] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:29:00.399007 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f97ba9-83bd-413f-b11f-9708a228ee1b None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:00.399355 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f97ba9-83bd-413f-b11f-9708a228ee1b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:00.407008 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f97ba9-83bd-413f-b11f-9708a228ee1b None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:00.407008 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 178/341] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:00.407008 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f97ba9-83bd-413f-b11f-9708a228ee1b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:00.462023 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:00.497296 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 164/342] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:28:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1115 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:00.497296 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a3e84-ed9f-4017-af77-daf9624de7bd None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:00.497296 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a3e84-ed9f-4017-af77-daf9624de7bd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:00.497296 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a3e84-ed9f-4017-af77-daf9624de7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:00.535877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-398a3e84-ed9f-4017-af77-daf9624de7bd None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:00.537089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-398a3e84-ed9f-4017-af77-daf9624de7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:00.635574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f97ba9-83bd-413f-b11f-9708a228ee1b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:00.726373 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 165/343] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:00.727523 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a3e84-ed9f-4017-af77-daf9624de7bd None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:00.731558 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2d2ea-4f45-4a9a-ada1-21061b7fe298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:00.732386 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2d2ea-4f45-4a9a-ada1-21061b7fe298 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:00.732670 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2d2ea-4f45-4a9a-ada1-21061b7fe298 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:00.732944 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2d2ea-4f45-4a9a-ada1-21061b7fe298 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:00.753662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2d2ea-4f45-4a9a-ada1-21061b7fe298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:00.761993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-49c2d2ea-4f45-4a9a-ada1-21061b7fe298 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:29:00.761993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:00.761993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:00.761993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:00.761993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:00.761993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:00.761993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:00.761993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:00.761993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:00.761993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:00.761993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:00.761993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:00.761993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:00.761993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:00.761993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:00.761993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:00.763725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:00.763725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:00.763725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:00.763725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:00.763725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:00.763725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:00.763725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:00.763725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:00.763725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:00.763725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:00.763725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:00.763725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:00.763725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:00.763725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:00.763725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:00.763725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:00.765106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:00.765106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:00.765106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:00.765106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:00.765106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:00.765106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:00.765106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:00.765106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:00.765106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:00.765106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:00.765106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:29:00.765106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:00.765106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 179/344] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 16:29:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:00.771227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2d2ea-4f45-4a9a-ada1-21061b7fe298 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:00.851143 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:00.960269 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a3e84-ed9f-4017-af77-daf9624de7bd None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:00.978853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2d2ea-4f45-4a9a-ada1-21061b7fe298 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:00.998152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:01.028497 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbf72b-a129-480a-8ef3-7b40dc872062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:01.030382 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbf72b-a129-480a-8ef3-7b40dc872062 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.031129 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbf72b-a129-480a-8ef3-7b40dc872062 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.031798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbf72b-a129-480a-8ef3-7b40dc872062 None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.035650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94feb64c-1e22-4047-89a3-c9cc314ab27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:01.036102 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbf72b-a129-480a-8ef3-7b40dc872062 None admin] RBAC: Authorizing `identity:get_project(project_id=97a27564d6b5404fa22fe354151a49d1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:01.036334 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94feb64c-1e22-4047-89a3-c9cc314ab27e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.036614 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94feb64c-1e22-4047-89a3-c9cc314ab27e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.036883 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94feb64c-1e22-4047-89a3-c9cc314ab27e None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.038021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94feb64c-1e22-4047-89a3-c9cc314ab27e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:01.038325 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94feb64c-1e22-4047-89a3-c9cc314ab27e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:01.040515 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbf72b-a129-480a-8ef3-7b40dc872062 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:01.042395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94feb64c-1e22-4047-89a3-c9cc314ab27e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:01.044626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 166/345] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:29:00 2022] GET /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1 => generated 298 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:01.046291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbf72b-a129-480a-8ef3-7b40dc872062 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:01.069229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 180/346] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:01.072188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c64bb4-0cac-4c85-8317-7d0e8bab2fd8 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.073039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c64bb4-0cac-4c85-8317-7d0e8bab2fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.073826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c64bb4-0cac-4c85-8317-7d0e8bab2fd8 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.077702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 181/347] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:01.079396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c64bb4-0cac-4c85-8317-7d0e8bab2fd8 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:01.216091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbf72b-a129-480a-8ef3-7b40dc872062 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:01.222603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:01.242979 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c64bb4-0cac-4c85-8317-7d0e8bab2fd8 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:01.277479 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a926da-c450-45f9-92ad-586d5610e22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:01.279147 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a926da-c450-45f9-92ad-586d5610e22e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.279793 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a926da-c450-45f9-92ad-586d5610e22e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.280272 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a926da-c450-45f9-92ad-586d5610e22e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.294174 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a926da-c450-45f9-92ad-586d5610e22e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:01.303195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-17a926da-c450-45f9-92ad-586d5610e22e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:29:01.303195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:01.303195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:01.303195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:01.303195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:01.303195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:01.303195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:01.303195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:01.303195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:01.303195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:01.303195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:01.303195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:01.303195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:01.303195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:01.303195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:01.303195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:01.304232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:01.304232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:01.304232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:01.304232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:01.304232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:01.304232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:01.304232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:01.304232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:01.304232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:01.304232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:01.304232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:01.304232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:01.304232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:01.304232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:01.304232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:01.304232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:01.305398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:01.305398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:01.305398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:01.305398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:01.305398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:01.305398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:01.305398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:01.305398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:01.305398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:01.305398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:01.305398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:29:01.305398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:01.308376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 167/348] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:29:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:01.313598 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a926da-c450-45f9-92ad-586d5610e22e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:01.314678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bdf49-15bc-4d18-ad98-147721acbd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:01.315871 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bdf49-15bc-4d18-ad98-147721acbd7d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.316287 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bdf49-15bc-4d18-ad98-147721acbd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.316698 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bdf49-15bc-4d18-ad98-147721acbd7d None admin] PATH_INFO: `/v3/groups/ab11481ee6a64b27a37196204b86a4b4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.325424 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bdf49-15bc-4d18-ad98-147721acbd7d None admin] RBAC: Authorizing `identity:get_group(group_id=ab11481ee6a64b27a37196204b86a4b4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:01.327743 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bdf49-15bc-4d18-ad98-147721acbd7d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:01.330206 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 182/349] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 16:29:01 2022] GET /identity/v3/groups/ab11481ee6a64b27a37196204b86a4b4 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:01.333193 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62f6e3-2fb8-4aef-90d4-e7421fb081dc None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.333540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62f6e3-2fb8-4aef-90d4-e7421fb081dc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.333946 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62f6e3-2fb8-4aef-90d4-e7421fb081dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.362428 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fe62f6e3-2fb8-4aef-90d4-e7421fb081dc None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:01.364441 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fe62f6e3-2fb8-4aef-90d4-e7421fb081dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:01.378845 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:01.440918 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a926da-c450-45f9-92ad-586d5610e22e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:01.458919 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 183/350] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:01.460155 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70728d29-e52e-4be0-96f8-4f4697971add None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.460527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70728d29-e52e-4be0-96f8-4f4697971add None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.460842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70728d29-e52e-4be0-96f8-4f4697971add None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.462573 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 184/351] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:01.464553 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6562ede-6b0d-4f70-8b67-78b00dc945c3 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.464553 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6562ede-6b0d-4f70-8b67-78b00dc945c3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.464553 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6562ede-6b0d-4f70-8b67-78b00dc945c3 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.465560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 185/352] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:01.466325 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6562ede-6b0d-4f70-8b67-78b00dc945c3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:01.495785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88392198-df24-42a3-bba8-9ac2aa891e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:01.496963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88392198-df24-42a3-bba8-9ac2aa891e23 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.497249 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88392198-df24-42a3-bba8-9ac2aa891e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.497558 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88392198-df24-42a3-bba8-9ac2aa891e23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.578179 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:01.591093 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88392198-df24-42a3-bba8-9ac2aa891e23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:01.592595 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88392198-df24-42a3-bba8-9ac2aa891e23 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:01.600997 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6562ede-6b0d-4f70-8b67-78b00dc945c3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:01.654973 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd8706-4028-46b0-aff8-85a6281520dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:01.655675 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd8706-4028-46b0-aff8-85a6281520dc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.656046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd8706-4028-46b0-aff8-85a6281520dc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.656322 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd8706-4028-46b0-aff8-85a6281520dc None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.657017 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:01.657137 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd8706-4028-46b0-aff8-85a6281520dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:01.660042 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd8706-4028-46b0-aff8-85a6281520dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:01.660625 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd8706-4028-46b0-aff8-85a6281520dc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:01.672471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 186/353] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:29:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:01.673549 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd8706-4028-46b0-aff8-85a6281520dc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:01.758083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 168/354] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:29:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:01.760674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da7777-db6f-4713-bd79-8b01b19f5f65 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.761183 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da7777-db6f-4713-bd79-8b01b19f5f65 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.761659 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da7777-db6f-4713-bd79-8b01b19f5f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.797535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d6da7777-db6f-4713-bd79-8b01b19f5f65 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:01.799419 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d6da7777-db6f-4713-bd79-8b01b19f5f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:01.823850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd8706-4028-46b0-aff8-85a6281520dc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:01.878776 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264eee3-ecbc-45ea-b15f-0aa8a8a384d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:01.879514 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264eee3-ecbc-45ea-b15f-0aa8a8a384d5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.879807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264eee3-ecbc-45ea-b15f-0aa8a8a384d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.880104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264eee3-ecbc-45ea-b15f-0aa8a8a384d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.881166 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264eee3-ecbc-45ea-b15f-0aa8a8a384d5 None admin] RBAC: Adding query filter params (group.id=ab11481ee6a64b27a37196204b86a4b4, role.id=cdbaa8196c574e32a331e8d4faee1a7e, scope.project.id=97a27564d6b5404fa22fe354151a49d1) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:01.881326 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264eee3-ecbc-45ea-b15f-0aa8a8a384d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:01.882909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264eee3-ecbc-45ea-b15f-0aa8a8a384d5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:01.890809 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 187/355] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 26 16:29:01 2022] GET /identity/v3/role_assignments?group.id=ab11481ee6a64b27a37196204b86a4b4&scope.project.id=97a27564d6b5404fa22fe354151a49d1&role.id=cdbaa8196c574e32a331e8d4faee1a7e => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:01.892185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85193eba-6e63-469b-861c-bf787d95f6f2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.892497 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85193eba-6e63-469b-861c-bf787d95f6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.892777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85193eba-6e63-469b-861c-bf787d95f6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.901248 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 169/356] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:01.902533 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da7777-db6f-4713-bd79-8b01b19f5f65 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:01.924659 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-85193eba-6e63-469b-861c-bf787d95f6f2 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:01.927267 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-85193eba-6e63-469b-861c-bf787d95f6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:01.940466 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:02.033925 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:02.046201 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 188/357] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:02.049507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85193eba-6e63-469b-861c-bf787d95f6f2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:02.056186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da7777-db6f-4713-bd79-8b01b19f5f65 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:02.118983 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e4d84-247a-4c76-b5f0-d95455bcad77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:02.119872 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e4d84-247a-4c76-b5f0-d95455bcad77 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:02.120117 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e4d84-247a-4c76-b5f0-d95455bcad77 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:02.120382 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e4d84-247a-4c76-b5f0-d95455bcad77 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:02.134171 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e4d84-247a-4c76-b5f0-d95455bcad77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:02.143592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-c44e4d84-247a-4c76-b5f0-d95455bcad77 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:29:02.143592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:02.143592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:02.143592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:02.143592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:02.143592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:02.143592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:02.143592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:02.143592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:02.143592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:02.143592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:02.143592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:02.143592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:02.143592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:02.143592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:02.143592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:02.145358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:02.145358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:02.145358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:02.145358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:02.145358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:02.145358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:02.145358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:02.145358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:02.145358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:02.145358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:02.145358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:02.145358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:02.145358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:02.145358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:02.145358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:02.145358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:02.146568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:02.146568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:02.146568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:02.146568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:02.146568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:02.146568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:02.146568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:02.146568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:02.146568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:02.146568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:02.146568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:29:02.146568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:02.146568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 170/358] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 16:29:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:02.147978 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e4d84-247a-4c76-b5f0-d95455bcad77 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:02.184165 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85193eba-6e63-469b-861c-bf787d95f6f2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:02.233519 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee51b5-e215-4fa4-b450-8e25f9eba870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:02.234533 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee51b5-e215-4fa4-b450-8e25f9eba870 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:02.234820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee51b5-e215-4fa4-b450-8e25f9eba870 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:02.235159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee51b5-e215-4fa4-b450-8e25f9eba870 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:02.261355 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:02.287161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e4d84-247a-4c76-b5f0-d95455bcad77 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:02.343450 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbdc42-d41b-41dc-83d2-83ab4dfe5af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:02.344317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbdc42-d41b-41dc-83d2-83ab4dfe5af2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:02.344651 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbdc42-d41b-41dc-83d2-83ab4dfe5af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:02.344868 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbdc42-d41b-41dc-83d2-83ab4dfe5af2 None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:02.346322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbdc42-d41b-41dc-83d2-83ab4dfe5af2 None admin] RBAC: Authorizing `identity:get_project(project_id=97a27564d6b5404fa22fe354151a49d1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:02.351475 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbdc42-d41b-41dc-83d2-83ab4dfe5af2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:02.351475 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 171/359] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:29:02 2022] GET /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:02.351475 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbdc42-d41b-41dc-83d2-83ab4dfe5af2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:02.364709 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:02.369036 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee51b5-e215-4fa4-b450-8e25f9eba870 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:02.370770 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee51b5-e215-4fa4-b450-8e25f9eba870 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:02.519431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbdc42-d41b-41dc-83d2-83ab4dfe5af2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:02.533865 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 189/360] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:29:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:02.535731 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee51b5-e215-4fa4-b450-8e25f9eba870 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:02.584225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab02ea-aa81-4eba-abf6-baad21e5d1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:02.585680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab02ea-aa81-4eba-abf6-baad21e5d1ae None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:02.585975 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab02ea-aa81-4eba-abf6-baad21e5d1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:02.586260 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab02ea-aa81-4eba-abf6-baad21e5d1ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:02.603769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab02ea-aa81-4eba-abf6-baad21e5d1ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:02.605631 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:02.611830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-37ab02ea-aa81-4eba-abf6-baad21e5d1ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:02.611830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:02.611830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:02.611830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:02.611830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:02.611830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:02.611830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:02.611830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:02.611830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:02.611830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:02.611830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:02.611830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:02.611830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:02.611830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:02.611830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:02.611830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:02.613197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:02.613197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:02.613197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:02.613197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:02.613197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:02.613197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:02.613197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:02.613197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:02.613197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:02.613197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:02.613197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:02.613197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:02.613197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:02.613197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:02.613197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:02.613197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:02.614796 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:02.614796 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:02.614796 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:02.614796 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:02.614796 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:02.614796 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:02.614796 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:02.614796 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:02.614796 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:02.614796 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:02.614796 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:02.614796 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:02.614796 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 172/361] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:29:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:02.614796 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab02ea-aa81-4eba-abf6-baad21e5d1ae None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:02.699936 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee51b5-e215-4fa4-b450-8e25f9eba870 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:02.709858 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:02.742227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c423a-5899-462b-ade8-4302501965db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:02.743048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c423a-5899-462b-ade8-4302501965db None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:02.743331 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c423a-5899-462b-ade8-4302501965db None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:02.743606 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c423a-5899-462b-ade8-4302501965db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:02.750841 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab02ea-aa81-4eba-abf6-baad21e5d1ae None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:02.755492 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c423a-5899-462b-ade8-4302501965db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:02.763906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-618c423a-5899-462b-ade8-4302501965db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:29:02.763906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:02.763906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:02.763906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:02.763906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:02.763906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:02.763906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:02.763906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:02.763906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:02.763906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:02.763906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:02.763906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:02.763906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:02.763906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:02.763906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:02.763906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:02.765152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:02.765152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:02.765152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:02.765152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:02.765152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:02.765152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:02.765152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:02.765152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:02.765152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:02.765152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:02.765152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:02.765152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:02.765152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:02.765152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:02.765152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:02.765152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:02.766027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:02.766027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:02.766027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:02.766027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:02.766027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:02.766027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:02.766027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:02.766027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:02.766027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:02.766027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:02.766027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:29:02.766027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:02.766027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 190/362] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:29:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:02.766027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c423a-5899-462b-ade8-4302501965db None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:02.802105 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3066d-fb63-4f91-979c-cb4f4e8fbde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:02.802940 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3066d-fb63-4f91-979c-cb4f4e8fbde1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:02.803114 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3066d-fb63-4f91-979c-cb4f4e8fbde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:02.803381 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3066d-fb63-4f91-979c-cb4f4e8fbde1 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:02.804125 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3066d-fb63-4f91-979c-cb4f4e8fbde1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:02.804429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3066d-fb63-4f91-979c-cb4f4e8fbde1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:02.805872 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3066d-fb63-4f91-979c-cb4f4e8fbde1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:02.819684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 173/363] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:02.819684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3066d-fb63-4f91-979c-cb4f4e8fbde1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:02.894337 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c423a-5899-462b-ade8-4302501965db None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:02.896196 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:02.937571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726405fe-11bf-4b64-bc1a-f2952a704ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:02.938566 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726405fe-11bf-4b64-bc1a-f2952a704ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:02.938848 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726405fe-11bf-4b64-bc1a-f2952a704ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:02.939123 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726405fe-11bf-4b64-bc1a-f2952a704ae1 None admin] PATH_INFO: `/v3/groups/ab11481ee6a64b27a37196204b86a4b4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:02.940639 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726405fe-11bf-4b64-bc1a-f2952a704ae1 None admin] RBAC: Authorizing `identity:get_group(group_id=ab11481ee6a64b27a37196204b86a4b4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:02.942156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3066d-fb63-4f91-979c-cb4f4e8fbde1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:02.943057 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726405fe-11bf-4b64-bc1a-f2952a704ae1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:02.946124 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 191/364] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 16:29:02 2022] GET /identity/v3/groups/ab11481ee6a64b27a37196204b86a4b4 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:02.946124 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726405fe-11bf-4b64-bc1a-f2952a704ae1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:02.992548 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:02.998335 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec29c11-be61-4cac-abca-45384c907247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:02.999307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec29c11-be61-4cac-abca-45384c907247 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:02.999656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec29c11-be61-4cac-abca-45384c907247 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:03.000010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec29c11-be61-4cac-abca-45384c907247 None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:03.001339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec29c11-be61-4cac-abca-45384c907247 None admin] RBAC: Authorizing `identity:get_project(project_id=30b0d97406c64a4d8830d98d414453ed)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:03.002923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec29c11-be61-4cac-abca-45384c907247 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:03.019547 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 174/365] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:29:02 2022] GET /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:03.019547 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec29c11-be61-4cac-abca-45384c907247 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:03.083018 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726405fe-11bf-4b64-bc1a-f2952a704ae1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:03.131750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082eedf5-eac1-4dd2-9c18-46648f4e7b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:03.132481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082eedf5-eac1-4dd2-9c18-46648f4e7b1b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:03.132854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082eedf5-eac1-4dd2-9c18-46648f4e7b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:03.133198 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082eedf5-eac1-4dd2-9c18-46648f4e7b1b None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:03.134002 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082eedf5-eac1-4dd2-9c18-46648f4e7b1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:03.134317 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082eedf5-eac1-4dd2-9c18-46648f4e7b1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:03.135389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec29c11-be61-4cac-abca-45384c907247 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:03.135724 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082eedf5-eac1-4dd2-9c18-46648f4e7b1b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:03.151658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 192/366] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:29:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:03.151658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082eedf5-eac1-4dd2-9c18-46648f4e7b1b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:03.181916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8e36b-2824-471b-8629-00601fbf3b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:03.182938 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8e36b-2824-471b-8629-00601fbf3b30 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:03.183403 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8e36b-2824-471b-8629-00601fbf3b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:03.183851 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8e36b-2824-471b-8629-00601fbf3b30 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:03.185090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8e36b-2824-471b-8629-00601fbf3b30 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:03.185626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8e36b-2824-471b-8629-00601fbf3b30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:03.187683 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:03.188071 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8e36b-2824-471b-8629-00601fbf3b30 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:03.207553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 175/367] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:29:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:03.207553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8e36b-2824-471b-8629-00601fbf3b30 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:03.295582 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082eedf5-eac1-4dd2-9c18-46648f4e7b1b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:03.296427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:03.347100 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8e36b-2824-471b-8629-00601fbf3b30 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:03.358970 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5790c8-40cf-43fb-af44-37edd0d1661d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:03.359451 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5790c8-40cf-43fb-af44-37edd0d1661d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:03.359731 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5790c8-40cf-43fb-af44-37edd0d1661d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:03.360031 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5790c8-40cf-43fb-af44-37edd0d1661d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:03.389409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5839f79-c5fb-4e92-a65f-1fac4b48753b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:03.390074 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5839f79-c5fb-4e92-a65f-1fac4b48753b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:03.390359 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5839f79-c5fb-4e92-a65f-1fac4b48753b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:03.390637 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5839f79-c5fb-4e92-a65f-1fac4b48753b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:03.391536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5839f79-c5fb-4e92-a65f-1fac4b48753b None admin] RBAC: Adding query filter params (group.id=ab11481ee6a64b27a37196204b86a4b4, role.id=c8d1d9031cfc4ef8a0e62f6bfd7ff691, scope.project.id=97a27564d6b5404fa22fe354151a49d1) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:03.392007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5839f79-c5fb-4e92-a65f-1fac4b48753b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:03.393338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5839f79-c5fb-4e92-a65f-1fac4b48753b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:03.409421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 176/368] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 26 16:29:03 2022] GET /identity/v3/role_assignments?group.id=ab11481ee6a64b27a37196204b86a4b4&scope.project.id=97a27564d6b5404fa22fe354151a49d1&role.id=c8d1d9031cfc4ef8a0e62f6bfd7ff691 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:03.409421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5839f79-c5fb-4e92-a65f-1fac4b48753b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:03.477112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5790c8-40cf-43fb-af44-37edd0d1661d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:03.478962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5790c8-40cf-43fb-af44-37edd0d1661d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:03.523217 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:03.566451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5839f79-c5fb-4e92-a65f-1fac4b48753b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:03.596050 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:03.610124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798f90c-60bc-4732-a358-876b144384fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:03.611217 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798f90c-60bc-4732-a358-876b144384fb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:03.611504 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798f90c-60bc-4732-a358-876b144384fb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:03.611779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798f90c-60bc-4732-a358-876b144384fb None admin] PATH_INFO: `/v3/groups/ab11481ee6a64b27a37196204b86a4b4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:03.613682 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798f90c-60bc-4732-a358-876b144384fb None admin] RBAC: Authorizing `identity:get_group(group_id=ab11481ee6a64b27a37196204b86a4b4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:03.615260 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798f90c-60bc-4732-a358-876b144384fb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:03.617081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 177/369] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 16:29:03 2022] GET /identity/v3/groups/ab11481ee6a64b27a37196204b86a4b4 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:03.617988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798f90c-60bc-4732-a358-876b144384fb None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:03.619414 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 193/370] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:29:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:03.622251 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5790c8-40cf-43fb-af44-37edd0d1661d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:03.749165 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798f90c-60bc-4732-a358-876b144384fb None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:03.802342 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a485cc-50d8-45ca-a57a-1d67a6842396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:03.803462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a485cc-50d8-45ca-a57a-1d67a6842396 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:03.803462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a485cc-50d8-45ca-a57a-1d67a6842396 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:03.803754 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a485cc-50d8-45ca-a57a-1d67a6842396 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:03.813751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5790c8-40cf-43fb-af44-37edd0d1661d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:03.874350 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:03.879586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b901d-2049-4992-9353-b39260c9ce65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:03.880497 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b901d-2049-4992-9353-b39260c9ce65 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:03.880881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b901d-2049-4992-9353-b39260c9ce65 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:03.881162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b901d-2049-4992-9353-b39260c9ce65 None admin] PATH_INFO: `/v3/users/a329fc1b438a4667ab462705a5ad0932` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:03.882598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b901d-2049-4992-9353-b39260c9ce65 None admin] RBAC: Authorizing `identity:get_user(user_id=a329fc1b438a4667ab462705a5ad0932)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:03.896367 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b901d-2049-4992-9353-b39260c9ce65 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:03.896367 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 194/371] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:29:03 2022] GET /identity/v3/users/a329fc1b438a4667ab462705a5ad0932 => generated 293 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:03.896367 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b901d-2049-4992-9353-b39260c9ce65 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:03.915418 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:03.929856 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a485cc-50d8-45ca-a57a-1d67a6842396 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:03.931796 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a485cc-50d8-45ca-a57a-1d67a6842396 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:04.051169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b901d-2049-4992-9353-b39260c9ce65 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:04.083900 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 178/372] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:29:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:04.085587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a485cc-50d8-45ca-a57a-1d67a6842396 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:04.135027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083335e5-9e65-4e9a-8654-dbeda914967b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:04.135842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083335e5-9e65-4e9a-8654-dbeda914967b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:04.136205 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083335e5-9e65-4e9a-8654-dbeda914967b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:04.136604 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083335e5-9e65-4e9a-8654-dbeda914967b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:04.138001 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083335e5-9e65-4e9a-8654-dbeda914967b None admin] RBAC: Adding query filter params (group.id=ab11481ee6a64b27a37196204b86a4b4, role.id=cdbaa8196c574e32a331e8d4faee1a7e, scope.project.id=30b0d97406c64a4d8830d98d414453ed) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:04.138546 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083335e5-9e65-4e9a-8654-dbeda914967b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:04.141055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083335e5-9e65-4e9a-8654-dbeda914967b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:04.148891 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 195/373] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 26 16:29:03 2022] GET /identity/v3/role_assignments?group.id=ab11481ee6a64b27a37196204b86a4b4&scope.project.id=30b0d97406c64a4d8830d98d414453ed&role.id=cdbaa8196c574e32a331e8d4faee1a7e => generated 260 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:04.153339 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083335e5-9e65-4e9a-8654-dbeda914967b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:04.233737 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:04.279051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083335e5-9e65-4e9a-8654-dbeda914967b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:04.287079 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:04.304185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a485cc-50d8-45ca-a57a-1d67a6842396 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:04.318787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4253d-fcb1-43d9-a12a-8fc97661a576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:04.319652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4253d-fcb1-43d9-a12a-8fc97661a576 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:04.319769 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4253d-fcb1-43d9-a12a-8fc97661a576 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:04.319970 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4253d-fcb1-43d9-a12a-8fc97661a576 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:04.320896 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4253d-fcb1-43d9-a12a-8fc97661a576 None admin] RBAC: Adding query filter params (role.id=ab11da387f674277a602ab6e1e7e5b44, user.id=a329fc1b438a4667ab462705a5ad0932, scope.system=all) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:04.321212 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4253d-fcb1-43d9-a12a-8fc97661a576 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:04.322728 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4253d-fcb1-43d9-a12a-8fc97661a576 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:04.338949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 196/374] 10.222.0.48 () {56 vars in 1308 bytes} [Thu May 26 16:29:04 2022] GET /identity/v3/role_assignments?user.id=a329fc1b438a4667ab462705a5ad0932&scope.system=all&role.id=ab11da387f674277a602ab6e1e7e5b44 => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:04.340491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4253d-fcb1-43d9-a12a-8fc97661a576 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:04.413487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9984aba-0b3e-4651-b1bf-fe9cfa15dfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:04.414965 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9984aba-0b3e-4651-b1bf-fe9cfa15dfbf None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:04.415422 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9984aba-0b3e-4651-b1bf-fe9cfa15dfbf None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:04.415871 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9984aba-0b3e-4651-b1bf-fe9cfa15dfbf None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:04.422756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9984aba-0b3e-4651-b1bf-fe9cfa15dfbf None admin] RBAC: Authorizing `identity:get_project(project_id=30b0d97406c64a4d8830d98d414453ed)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:04.425644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9984aba-0b3e-4651-b1bf-fe9cfa15dfbf None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:04.429031 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 179/375] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:29:04 2022] GET /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed => generated 302 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:04.436927 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9984aba-0b3e-4651-b1bf-fe9cfa15dfbf None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:04.629322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9984aba-0b3e-4651-b1bf-fe9cfa15dfbf None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:04.689304 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4253d-fcb1-43d9-a12a-8fc97661a576 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:04.720873 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d093606-2cd1-4023-a4c1-7d1530fb45c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:04.722672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d093606-2cd1-4023-a4c1-7d1530fb45c3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:04.723170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d093606-2cd1-4023-a4c1-7d1530fb45c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:04.723637 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d093606-2cd1-4023-a4c1-7d1530fb45c3 None admin] PATH_INFO: `/v3/groups/ab11481ee6a64b27a37196204b86a4b4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:04.728594 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d093606-2cd1-4023-a4c1-7d1530fb45c3 None admin] RBAC: Authorizing `identity:get_group(group_id=ab11481ee6a64b27a37196204b86a4b4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:04.731376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d093606-2cd1-4023-a4c1-7d1530fb45c3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:04.734711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 180/376] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 16:29:04 2022] GET /identity/v3/groups/ab11481ee6a64b27a37196204b86a4b4 => generated 226 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:04.737060 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c85d0c-4d97-4978-9112-c20b6d188239 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:04.743787 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c85d0c-4d97-4978-9112-c20b6d188239 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:04.746159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c85d0c-4d97-4978-9112-c20b6d188239 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:04.749006 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 181/377] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:04 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:04.750273 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c85d0c-4d97-4978-9112-c20b6d188239 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:04.772185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:04.800624 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af3c95-e1d4-46a8-a6ee-b60d9d276ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:04.802975 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af3c95-e1d4-46a8-a6ee-b60d9d276ada None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:04.802975 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af3c95-e1d4-46a8-a6ee-b60d9d276ada None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:04.803162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af3c95-e1d4-46a8-a6ee-b60d9d276ada None admin] PATH_INFO: `/v3/projects/76a4e041bd164458a5b1a262dc443e9c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:04.805292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af3c95-e1d4-46a8-a6ee-b60d9d276ada None admin] RBAC: Authorizing `identity:get_project(project_id=76a4e041bd164458a5b1a262dc443e9c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:04.808036 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af3c95-e1d4-46a8-a6ee-b60d9d276ada None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:04.811378 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 197/378] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:29:04 2022] GET /identity/v3/projects/76a4e041bd164458a5b1a262dc443e9c => generated 344 bytes in 472 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:04.813717 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f21be-aea8-4791-8cdd-7976b40d3c85 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:04.814213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f21be-aea8-4791-8cdd-7976b40d3c85 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:04.814762 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f21be-aea8-4791-8cdd-7976b40d3c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:04.839489 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:04.844648 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8c5f21be-aea8-4791-8cdd-7976b40d3c85 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:04.846397 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8c5f21be-aea8-4791-8cdd-7976b40d3c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:04.949487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c85d0c-4d97-4978-9112-c20b6d188239 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:04.950189 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 198/379] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:04.952047 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f21be-aea8-4791-8cdd-7976b40d3c85 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:05.010820 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce21bc4-e583-4738-944e-b612f601dfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:05.011944 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce21bc4-e583-4738-944e-b612f601dfce None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:05.012455 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce21bc4-e583-4738-944e-b612f601dfce None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:05.012948 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce21bc4-e583-4738-944e-b612f601dfce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:05.014127 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce21bc4-e583-4738-944e-b612f601dfce None admin] RBAC: Adding query filter params (group.id=ab11481ee6a64b27a37196204b86a4b4, role.id=c8d1d9031cfc4ef8a0e62f6bfd7ff691, scope.project.id=30b0d97406c64a4d8830d98d414453ed) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:05.014827 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce21bc4-e583-4738-944e-b612f601dfce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:05.016554 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce21bc4-e583-4738-944e-b612f601dfce None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:05.023644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 182/380] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 26 16:29:04 2022] GET /identity/v3/role_assignments?group.id=ab11481ee6a64b27a37196204b86a4b4&scope.project.id=30b0d97406c64a4d8830d98d414453ed&role.id=c8d1d9031cfc4ef8a0e62f6bfd7ff691 => generated 260 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:05.024867 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce21bc4-e583-4738-944e-b612f601dfce None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:05.166196 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f21be-aea8-4791-8cdd-7976b40d3c85 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:05.223420 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:05.260802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f5726-fe74-4ffd-acf0-261a64fa5e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:05.262248 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f5726-fe74-4ffd-acf0-261a64fa5e82 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:05.262718 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f5726-fe74-4ffd-acf0-261a64fa5e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:05.263155 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f5726-fe74-4ffd-acf0-261a64fa5e82 None admin] PATH_INFO: `/v3/groups/2ff6e3d3d5104821a149af3254fd5a6f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:05.281586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f5726-fe74-4ffd-acf0-261a64fa5e82 None admin] RBAC: Authorizing `identity:get_group(group_id=2ff6e3d3d5104821a149af3254fd5a6f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:05.283247 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f5726-fe74-4ffd-acf0-261a64fa5e82 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:05.285235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 199/381] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 16:29:04 2022] GET /identity/v3/groups/2ff6e3d3d5104821a149af3254fd5a6f => generated 229 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:05.294542 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f5726-fe74-4ffd-acf0-261a64fa5e82 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:05.315356 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:05.334340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce21bc4-e583-4738-944e-b612f601dfce None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:05.388286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f418d-2950-42a1-903d-a4a7d368073a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:05.389861 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f418d-2950-42a1-903d-a4a7d368073a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:05.390156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f418d-2950-42a1-903d-a4a7d368073a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:05.390438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f418d-2950-42a1-903d-a4a7d368073a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:05.406157 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f418d-2950-42a1-903d-a4a7d368073a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:05.417814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-b02f418d-2950-42a1-903d-a4a7d368073a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:29:05.417814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:05.417814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:05.417814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:05.417814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:05.417814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:05.417814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:05.417814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:05.417814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:05.417814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:05.417814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:05.417814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:05.417814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:05.417814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:05.417814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:05.417814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:05.418761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:05.418761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:05.418761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:05.418761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:05.418761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:05.418761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:05.418761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:05.418761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:05.418761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:05.418761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:05.418761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:05.418761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:05.418761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:05.418761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:05.418761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:05.418761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:05.419561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:05.419561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:05.419561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:05.419561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:05.419561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:05.419561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:05.419561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:05.419561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:05.419561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:05.419561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:05.419561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:29:05.419561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:05.420210 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 183/382] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:29:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:05.427413 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f418d-2950-42a1-903d-a4a7d368073a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:05.471349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f5726-fe74-4ffd-acf0-261a64fa5e82 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:05.550633 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a39608-9102-404f-9132-7728b478b8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:05.551326 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a39608-9102-404f-9132-7728b478b8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:05.551601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a39608-9102-404f-9132-7728b478b8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:05.551872 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a39608-9102-404f-9132-7728b478b8a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:05.552721 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a39608-9102-404f-9132-7728b478b8a9 None admin] RBAC: Adding query filter params (group.id=2ff6e3d3d5104821a149af3254fd5a6f, role.id=796e313fa8794ac885ccf6300d09332a, scope.project.id=76a4e041bd164458a5b1a262dc443e9c) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:05.553110 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a39608-9102-404f-9132-7728b478b8a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:05.554675 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a39608-9102-404f-9132-7728b478b8a9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:05.571932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 200/383] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 26 16:29:05 2022] GET /identity/v3/role_assignments?group.id=2ff6e3d3d5104821a149af3254fd5a6f&scope.project.id=76a4e041bd164458a5b1a262dc443e9c&role.id=796e313fa8794ac885ccf6300d09332a => generated 260 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:05.627582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f418d-2950-42a1-903d-a4a7d368073a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:05.677285 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc092b-44b8-4261-a7f8-f0df3f0d6de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:05.678321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc092b-44b8-4261-a7f8-f0df3f0d6de3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:05.678755 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc092b-44b8-4261-a7f8-f0df3f0d6de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:05.679199 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc092b-44b8-4261-a7f8-f0df3f0d6de3 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:05.680462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc092b-44b8-4261-a7f8-f0df3f0d6de3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:05.680958 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc092b-44b8-4261-a7f8-f0df3f0d6de3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:05.683349 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc092b-44b8-4261-a7f8-f0df3f0d6de3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:05.702872 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 184/384] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:29:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:05.708776 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a39608-9102-404f-9132-7728b478b8a9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:05.771032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:05.831752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a39608-9102-404f-9132-7728b478b8a9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:05.872314 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe738a5e-7752-425a-814f-f01b28f6e0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:05.873209 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe738a5e-7752-425a-814f-f01b28f6e0fb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:05.873528 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe738a5e-7752-425a-814f-f01b28f6e0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:05.873809 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe738a5e-7752-425a-814f-f01b28f6e0fb None admin] PATH_INFO: `/v3/groups/ab11481ee6a64b27a37196204b86a4b4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:05.876639 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe738a5e-7752-425a-814f-f01b28f6e0fb None admin] RBAC: Authorizing `identity:get_group(group_id=ab11481ee6a64b27a37196204b86a4b4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:05.878232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe738a5e-7752-425a-814f-f01b28f6e0fb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:05.880899 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 201/385] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 16:29:05 2022] GET /identity/v3/groups/ab11481ee6a64b27a37196204b86a4b4 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:05.889732 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc092b-44b8-4261-a7f8-f0df3f0d6de3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:05.923929 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:06.091519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc092b-44b8-4261-a7f8-f0df3f0d6de3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:06.159037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97f52e-0dd0-43e2-bfc6-835dda1c3c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:06.159969 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97f52e-0dd0-43e2-bfc6-835dda1c3c5f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:06.160246 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97f52e-0dd0-43e2-bfc6-835dda1c3c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:06.160519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97f52e-0dd0-43e2-bfc6-835dda1c3c5f None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:06.161788 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97f52e-0dd0-43e2-bfc6-835dda1c3c5f None admin] RBAC: Authorizing `identity:get_project(project_id=97a27564d6b5404fa22fe354151a49d1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:06.163243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97f52e-0dd0-43e2-bfc6-835dda1c3c5f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:06.165514 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 185/386] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:29:05 2022] GET /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:06.173652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe738a5e-7752-425a-814f-f01b28f6e0fb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:06.324975 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe738a5e-7752-425a-814f-f01b28f6e0fb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:06.353829 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:06.376879 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372725c-2cd5-489a-8ea7-386228b4b0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:06.401430 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372725c-2cd5-489a-8ea7-386228b4b0e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:06.401430 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372725c-2cd5-489a-8ea7-386228b4b0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:06.401430 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372725c-2cd5-489a-8ea7-386228b4b0e5 None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1/groups/ab11481ee6a64b27a37196204b86a4b4/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:06.401430 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372725c-2cd5-489a-8ea7-386228b4b0e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=97a27564d6b5404fa22fe354151a49d1, group_id=ab11481ee6a64b27a37196204b86a4b4, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:06.401430 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372725c-2cd5-489a-8ea7-386228b4b0e5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:06.530982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 202/387] 10.222.0.48 () {58 vars in 1442 bytes} [Thu May 26 16:29:06 2022] PUT /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1/groups/ab11481ee6a64b27a37196204b86a4b4/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:29:06.711732 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cee01-64c3-41e1-9e9f-c01beef81fcb None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:06.712560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cee01-64c3-41e1-9e9f-c01beef81fcb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:06.713226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cee01-64c3-41e1-9e9f-c01beef81fcb None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:06.716411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 186/388] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:06.723918 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92737d-74db-4d5e-90d0-d9618e9b46f3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:06.724244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92737d-74db-4d5e-90d0-d9618e9b46f3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:06.724651 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92737d-74db-4d5e-90d0-d9618e9b46f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:06.754666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ce92737d-74db-4d5e-90d0-d9618e9b46f3 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:06.756375 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ce92737d-74db-4d5e-90d0-d9618e9b46f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:06.857995 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 203/389] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:06.891211 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cee01-64c3-41e1-9e9f-c01beef81fcb None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:07.033762 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:07.073087 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cee01-64c3-41e1-9e9f-c01beef81fcb None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:07.138676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e463a-18ec-4d40-9c64-bdffe57506e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:07.139587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e463a-18ec-4d40-9c64-bdffe57506e8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:07.139938 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e463a-18ec-4d40-9c64-bdffe57506e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:07.140351 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e463a-18ec-4d40-9c64-bdffe57506e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:07.162477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e463a-18ec-4d40-9c64-bdffe57506e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:07.170890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-bf5e463a-18ec-4d40-9c64-bdffe57506e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:29:07.170890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:07.170890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:07.170890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:07.170890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:07.170890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:07.170890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:07.170890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:07.170890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:07.170890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:07.170890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:07.170890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:07.170890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:07.170890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:07.170890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:07.170890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:07.171923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:07.171923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:07.171923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:07.171923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:07.171923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:07.171923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:07.171923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:07.171923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:07.171923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:07.171923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:07.171923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:07.171923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:07.171923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:07.171923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:07.171923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:07.171923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:07.173086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:07.173086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:07.173086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:07.173086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:07.173086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:07.173086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:07.173086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:07.173086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:07.173086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:07.173086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:07.173086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:29:07.173086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:07.173086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 187/390] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 16:29:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:07.178367 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92737d-74db-4d5e-90d0-d9618e9b46f3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:07.355178 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92737d-74db-4d5e-90d0-d9618e9b46f3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:07.364563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:07.410965 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ea907-54b3-451e-806c-6ea5aba9d7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:07.412489 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ea907-54b3-451e-806c-6ea5aba9d7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:07.413237 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ea907-54b3-451e-806c-6ea5aba9d7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:07.413856 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ea907-54b3-451e-806c-6ea5aba9d7a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:07.414847 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ea907-54b3-451e-806c-6ea5aba9d7a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:07.415362 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ea907-54b3-451e-806c-6ea5aba9d7a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:07.416958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ea907-54b3-451e-806c-6ea5aba9d7a6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:07.427163 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 204/391] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:07.433328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e463a-18ec-4d40-9c64-bdffe57506e8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:07.570078 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e463a-18ec-4d40-9c64-bdffe57506e8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:07.617611 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e3a2d-787b-4fc6-a28b-f7f85a1dff6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:07.618416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3a2d-787b-4fc6-a28b-f7f85a1dff6d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:07.618700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3a2d-787b-4fc6-a28b-f7f85a1dff6d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:07.618977 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3a2d-787b-4fc6-a28b-f7f85a1dff6d None admin] PATH_INFO: `/v3/groups/ab11481ee6a64b27a37196204b86a4b4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:07.626652 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e3a2d-787b-4fc6-a28b-f7f85a1dff6d None admin] RBAC: Authorizing `identity:get_group(group_id=ab11481ee6a64b27a37196204b86a4b4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:07.628737 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e3a2d-787b-4fc6-a28b-f7f85a1dff6d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:07.631036 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 188/392] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 16:29:07 2022] GET /identity/v3/groups/ab11481ee6a64b27a37196204b86a4b4 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:07.638821 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ea907-54b3-451e-806c-6ea5aba9d7a6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:07.786420 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ea907-54b3-451e-806c-6ea5aba9d7a6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:07.802413 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829575ef-e189-4b28-8198-9462b23bbe86 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:07.802751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829575ef-e189-4b28-8198-9462b23bbe86 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:07.802971 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829575ef-e189-4b28-8198-9462b23bbe86 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:07.804559 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 189/393] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:07.811715 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34742d4a-a169-40e9-9710-44a22fbdcbd3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:07.812028 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34742d4a-a169-40e9-9710-44a22fbdcbd3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:07.812313 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34742d4a-a169-40e9-9710-44a22fbdcbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:07.833371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423a260-18ca-4538-86d9-7b3e618b1cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:07.834278 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423a260-18ca-4538-86d9-7b3e618b1cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:07.834615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423a260-18ca-4538-86d9-7b3e618b1cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:07.834940 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423a260-18ca-4538-86d9-7b3e618b1cb3 None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:07.836224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423a260-18ca-4538-86d9-7b3e618b1cb3 None admin] RBAC: Authorizing `identity:get_project(project_id=97a27564d6b5404fa22fe354151a49d1)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:07.837892 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423a260-18ca-4538-86d9-7b3e618b1cb3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:07.840201 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 205/394] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:29:07 2022] GET /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:07.846176 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423a260-18ca-4538-86d9-7b3e618b1cb3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:07.854469 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-34742d4a-a169-40e9-9710-44a22fbdcbd3 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:07.855957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-34742d4a-a169-40e9-9710-44a22fbdcbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:07.863281 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:07.889738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:08.016670 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 190/395] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:08.024231 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423a260-18ca-4538-86d9-7b3e618b1cb3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:08.077845 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34742d4a-a169-40e9-9710-44a22fbdcbd3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:08.085820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a43c9-a30f-43fb-89a2-40473336e8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:08.087037 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a43c9-a30f-43fb-89a2-40473336e8ce None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:08.087323 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a43c9-a30f-43fb-89a2-40473336e8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:08.087602 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a43c9-a30f-43fb-89a2-40473336e8ce None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1/groups/ab11481ee6a64b27a37196204b86a4b4/roles/c8d1d9031cfc4ef8a0e62f6bfd7ff691` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:08.090528 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a43c9-a30f-43fb-89a2-40473336e8ce None admin] RBAC: Authorizing `identity:create_grant(project_id=97a27564d6b5404fa22fe354151a49d1, group_id=ab11481ee6a64b27a37196204b86a4b4, role_id=c8d1d9031cfc4ef8a0e62f6bfd7ff691)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:08.092142 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a43c9-a30f-43fb-89a2-40473336e8ce None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:08.226543 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 206/396] 10.222.0.48 () {58 vars in 1442 bytes} [Thu May 26 16:29:07 2022] PUT /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1/groups/ab11481ee6a64b27a37196204b86a4b4/roles/c8d1d9031cfc4ef8a0e62f6bfd7ff691 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:29:08.233247 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb649d-83a1-4e08-9420-51d8eb5af963 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:08.233770 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb649d-83a1-4e08-9420-51d8eb5af963 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:08.234452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb649d-83a1-4e08-9420-51d8eb5af963 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:08.245966 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 207/397] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:08 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:08.258936 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b571cd-9e07-4cac-b63c-8523e358d1ec None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:08.259543 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b571cd-9e07-4cac-b63c-8523e358d1ec None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:08.260200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b571cd-9e07-4cac-b63c-8523e358d1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:08.266431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34742d4a-a169-40e9-9710-44a22fbdcbd3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:08.313926 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c3b571cd-9e07-4cac-b63c-8523e358d1ec None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:08.316608 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c3b571cd-9e07-4cac-b63c-8523e358d1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:08.317851 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2d9e8-f44e-4034-91d0-cefcfddd0abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:08.319490 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2d9e8-f44e-4034-91d0-cefcfddd0abe None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:08.320651 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2d9e8-f44e-4034-91d0-cefcfddd0abe None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:08.321388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2d9e8-f44e-4034-91d0-cefcfddd0abe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:08.338795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:08.345025 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2d9e8-f44e-4034-91d0-cefcfddd0abe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:08.360998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-baa2d9e8-f44e-4034-91d0-cefcfddd0abe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:29:08.360998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:08.360998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:08.360998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:08.360998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:08.360998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:08.360998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:08.360998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:08.360998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:08.360998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:08.360998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:08.360998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:08.360998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:08.360998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:08.360998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:08.360998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:08.364160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:08.364160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:08.364160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:08.364160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:08.364160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:08.364160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:08.364160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:08.364160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:08.364160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:08.364160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:08.364160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:08.364160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:08.364160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:08.364160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:08.364160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:08.364160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:08.364995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:08.364995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:08.364995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:08.364995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:08.364995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:08.364995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:08.364995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:08.364995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:08.364995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:08.364995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:08.364995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:29:08.364995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:08.366804 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 191/398] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:29:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:08.385630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2d9e8-f44e-4034-91d0-cefcfddd0abe None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:08.508758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 208/399] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:08.545549 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b571cd-9e07-4cac-b63c-8523e358d1ec None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:08.588070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2d9e8-f44e-4034-91d0-cefcfddd0abe None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:08.597471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:08.632521 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b045c-1091-49cb-9802-210576d279ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:08.633238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b045c-1091-49cb-9802-210576d279ce None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:08.633589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b045c-1091-49cb-9802-210576d279ce None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:08.633876 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b045c-1091-49cb-9802-210576d279ce None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:08.634632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b045c-1091-49cb-9802-210576d279ce None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:08.634992 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b045c-1091-49cb-9802-210576d279ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:08.636508 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b045c-1091-49cb-9802-210576d279ce None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:08.648108 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 192/400] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:29:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:08.655258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b045c-1091-49cb-9802-210576d279ce None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:08.687046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b571cd-9e07-4cac-b63c-8523e358d1ec None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:08.748622 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6c313-349c-4a3c-9c46-61399d97c526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:08.751959 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:08.753509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6c313-349c-4a3c-9c46-61399d97c526 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:08.753957 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6c313-349c-4a3c-9c46-61399d97c526 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:08.755163 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6c313-349c-4a3c-9c46-61399d97c526 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:08.791973 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6c313-349c-4a3c-9c46-61399d97c526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:08.813908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e6b6c313-349c-4a3c-9c46-61399d97c526 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:29:08.813908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:08.813908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:08.813908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:08.813908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:08.813908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:08.813908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:08.813908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:08.813908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:08.813908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:08.813908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:08.813908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:08.813908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:08.813908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:08.813908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:08.813908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:08.815467 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:08.815467 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:08.815467 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:08.815467 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:08.815467 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:08.815467 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:08.815467 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:08.815467 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:08.815467 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:08.815467 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:08.815467 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:08.815467 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:08.815467 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:08.815467 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:08.815467 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:08.815467 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:08.817022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:08.817022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:08.817022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:08.817022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:08.817022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:08.817022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:08.817022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:08.817022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:08.817022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:08.817022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:08.817022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:29:08.817022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:08.823624 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 209/401] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 16:29:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:08.832340 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6c313-349c-4a3c-9c46-61399d97c526 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:08.855918 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b045c-1091-49cb-9802-210576d279ce None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:08.940049 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bcf4c-47d3-44d4-b3c0-43a3aed76c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:08.941745 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bcf4c-47d3-44d4-b3c0-43a3aed76c31 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:08.942076 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bcf4c-47d3-44d4-b3c0-43a3aed76c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:08.942772 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bcf4c-47d3-44d4-b3c0-43a3aed76c31 None admin] PATH_INFO: `/v3/groups/ab11481ee6a64b27a37196204b86a4b4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:08.945078 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bcf4c-47d3-44d4-b3c0-43a3aed76c31 None admin] RBAC: Authorizing `identity:get_group(group_id=ab11481ee6a64b27a37196204b86a4b4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:08.947130 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bcf4c-47d3-44d4-b3c0-43a3aed76c31 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:08.955681 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 193/402] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 16:29:08 2022] GET /identity/v3/groups/ab11481ee6a64b27a37196204b86a4b4 => generated 226 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:08.958441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bcf4c-47d3-44d4-b3c0-43a3aed76c31 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:09.034181 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:09.065140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6c313-349c-4a3c-9c46-61399d97c526 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:09.143223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12a18a-9cf2-45b6-b80b-d4d217d26125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:09.143975 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12a18a-9cf2-45b6-b80b-d4d217d26125 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:09.144256 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12a18a-9cf2-45b6-b80b-d4d217d26125 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:09.144555 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12a18a-9cf2-45b6-b80b-d4d217d26125 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:09.145501 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12a18a-9cf2-45b6-b80b-d4d217d26125 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:09.145833 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12a18a-9cf2-45b6-b80b-d4d217d26125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:09.147322 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12a18a-9cf2-45b6-b80b-d4d217d26125 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:09.156595 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 210/403] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:09.158215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f2830-90cc-4751-8b07-08d3775ba0bb None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:09.158499 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f2830-90cc-4751-8b07-08d3775ba0bb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:09.158769 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f2830-90cc-4751-8b07-08d3775ba0bb None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:09.165963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 211/404] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:09.165963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f2830-90cc-4751-8b07-08d3775ba0bb None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:09.178118 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bcf4c-47d3-44d4-b3c0-43a3aed76c31 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:09.209448 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:09.217049 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc77bd5-1157-4dc2-b917-368ab59f9f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:09.217958 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc77bd5-1157-4dc2-b917-368ab59f9f02 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:09.218237 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc77bd5-1157-4dc2-b917-368ab59f9f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:09.218519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc77bd5-1157-4dc2-b917-368ab59f9f02 None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:09.219835 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc77bd5-1157-4dc2-b917-368ab59f9f02 None admin] RBAC: Authorizing `identity:get_project(project_id=30b0d97406c64a4d8830d98d414453ed)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:09.221384 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc77bd5-1157-4dc2-b917-368ab59f9f02 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:09.224083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 194/405] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:29:08 2022] GET /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:09.229493 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3de18-d527-44c6-bb89-8e86122aeb21 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:09.229493 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3de18-d527-44c6-bb89-8e86122aeb21 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:09.229493 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3de18-d527-44c6-bb89-8e86122aeb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:09.249028 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fdd3de18-d527-44c6-bb89-8e86122aeb21 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:09.251313 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fdd3de18-d527-44c6-bb89-8e86122aeb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:09.315789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f2830-90cc-4751-8b07-08d3775ba0bb None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:09.353567 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 195/406] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:09.354512 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3de18-d527-44c6-bb89-8e86122aeb21 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:09.372764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86360455-2209-46af-a675-d82a3213dbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:09.374031 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86360455-2209-46af-a675-d82a3213dbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:09.374563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86360455-2209-46af-a675-d82a3213dbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:09.375138 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86360455-2209-46af-a675-d82a3213dbb3 None admin] PATH_INFO: `/v3/groups/ab11481ee6a64b27a37196204b86a4b4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:09.376714 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86360455-2209-46af-a675-d82a3213dbb3 None admin] RBAC: Authorizing `identity:get_group(group_id=ab11481ee6a64b27a37196204b86a4b4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:09.378442 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86360455-2209-46af-a675-d82a3213dbb3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:09.380821 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 212/407] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 16:29:09 2022] GET /identity/v3/groups/ab11481ee6a64b27a37196204b86a4b4 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:09.381944 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86360455-2209-46af-a675-d82a3213dbb3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:09.411315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:09.479614 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3de18-d527-44c6-bb89-8e86122aeb21 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:09.513928 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:09.524994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7f631-2cd7-4fad-acf3-ba8b50d68ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:09.526427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7f631-2cd7-4fad-acf3-ba8b50d68ac2 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:09.526909 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7f631-2cd7-4fad-acf3-ba8b50d68ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:09.527361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7f631-2cd7-4fad-acf3-ba8b50d68ac2 None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed/groups/ab11481ee6a64b27a37196204b86a4b4/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:09.530246 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7f631-2cd7-4fad-acf3-ba8b50d68ac2 None admin] RBAC: Authorizing `identity:create_grant(project_id=30b0d97406c64a4d8830d98d414453ed, group_id=ab11481ee6a64b27a37196204b86a4b4, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:09.532144 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7f631-2cd7-4fad-acf3-ba8b50d68ac2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:09.543484 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86360455-2209-46af-a675-d82a3213dbb3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:09.582609 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fee15-2d0e-4557-86e2-608475a9a589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:09.583558 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fee15-2d0e-4557-86e2-608475a9a589 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:09.583751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fee15-2d0e-4557-86e2-608475a9a589 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:09.583751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fee15-2d0e-4557-86e2-608475a9a589 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:09.599045 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355fee15-2d0e-4557-86e2-608475a9a589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:09.606091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-355fee15-2d0e-4557-86e2-608475a9a589 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:09.606091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:09.606091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:09.606091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:09.606091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:09.606091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:09.606091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:09.606091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:09.606091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:09.606091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:09.606091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:09.606091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:09.606091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:09.606091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:09.606091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:09.606091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:09.607329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:09.607329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:09.607329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:09.607329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:09.607329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:09.607329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:09.607329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:09.607329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:09.607329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:09.607329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:09.607329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:09.607329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:09.607329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:09.607329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:09.607329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:09.607329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:09.608149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:09.608149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:09.608149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:09.608149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:09.608149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:09.608149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:09.608149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:09.608149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:09.608149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:09.608149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:09.608149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:09.608149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:09.608149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 213/408] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:29:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:09.608812 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fee15-2d0e-4557-86e2-608475a9a589 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:09.687071 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 196/409] 10.222.0.48 () {58 vars in 1442 bytes} [Thu May 26 16:29:09 2022] PUT /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed/groups/ab11481ee6a64b27a37196204b86a4b4/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:29:09.688372 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7f631-2cd7-4fad-acf3-ba8b50d68ac2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:09.719084 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:09.747307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fee15-2d0e-4557-86e2-608475a9a589 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:09.794215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b047713-77f1-45e2-83e5-ec8037c71db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:09.795127 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b047713-77f1-45e2-83e5-ec8037c71db1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:09.795413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b047713-77f1-45e2-83e5-ec8037c71db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:09.795689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b047713-77f1-45e2-83e5-ec8037c71db1 None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:09.797194 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b047713-77f1-45e2-83e5-ec8037c71db1 None admin] RBAC: Authorizing `identity:get_project(project_id=30b0d97406c64a4d8830d98d414453ed)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:09.798884 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b047713-77f1-45e2-83e5-ec8037c71db1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:09.801691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 214/410] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:29:09 2022] GET /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:09.803220 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21f28b-dd0a-4e43-ac8a-1eba074df2ca None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:09.803509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21f28b-dd0a-4e43-ac8a-1eba074df2ca None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:09.803782 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21f28b-dd0a-4e43-ac8a-1eba074df2ca None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:09.805535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 215/411] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:09.814054 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b81de-e921-4a59-bd5d-87fcd1acc2dd None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:09.814054 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b81de-e921-4a59-bd5d-87fcd1acc2dd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:09.814054 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b81de-e921-4a59-bd5d-87fcd1acc2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:09.831581 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4e3b81de-e921-4a59-bd5d-87fcd1acc2dd None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:09.832943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4e3b81de-e921-4a59-bd5d-87fcd1acc2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:09.847296 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7f631-2cd7-4fad-acf3-ba8b50d68ac2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:09.888008 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06530ad-d8dd-4ecb-a787-fe62942accf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:09.888691 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06530ad-d8dd-4ecb-a787-fe62942accf7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:09.889026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06530ad-d8dd-4ecb-a787-fe62942accf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:09.889331 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06530ad-d8dd-4ecb-a787-fe62942accf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:09.890098 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06530ad-d8dd-4ecb-a787-fe62942accf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:09.890404 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06530ad-d8dd-4ecb-a787-fe62942accf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:09.891794 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06530ad-d8dd-4ecb-a787-fe62942accf7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:09.902696 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 197/412] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:29:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:09.903626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06530ad-d8dd-4ecb-a787-fe62942accf7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:09.917404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 216/413] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:09.918417 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b81de-e921-4a59-bd5d-87fcd1acc2dd None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:09.960909 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:10.024781 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:10.041756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06530ad-d8dd-4ecb-a787-fe62942accf7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:10.051867 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b81de-e921-4a59-bd5d-87fcd1acc2dd None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:10.099603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdc52f-c36d-4257-aeab-094b3e1e1d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:10.099943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdc52f-c36d-4257-aeab-094b3e1e1d17 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.100227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdc52f-c36d-4257-aeab-094b3e1e1d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.100502 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdc52f-c36d-4257-aeab-094b3e1e1d17 None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed/groups/ab11481ee6a64b27a37196204b86a4b4/roles/c8d1d9031cfc4ef8a0e62f6bfd7ff691` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.102674 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93eb05-2d7e-4831-8ca4-99e86af249f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:10.103545 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93eb05-2d7e-4831-8ca4-99e86af249f7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.103825 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93eb05-2d7e-4831-8ca4-99e86af249f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.104094 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93eb05-2d7e-4831-8ca4-99e86af249f7 None admin] PATH_INFO: `/v3/groups/2ff6e3d3d5104821a149af3254fd5a6f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.105797 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93eb05-2d7e-4831-8ca4-99e86af249f7 None admin] RBAC: Authorizing `identity:get_group(group_id=2ff6e3d3d5104821a149af3254fd5a6f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:10.106389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdc52f-c36d-4257-aeab-094b3e1e1d17 None admin] RBAC: Authorizing `identity:create_grant(project_id=30b0d97406c64a4d8830d98d414453ed, group_id=ab11481ee6a64b27a37196204b86a4b4, role_id=c8d1d9031cfc4ef8a0e62f6bfd7ff691)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:10.107261 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93eb05-2d7e-4831-8ca4-99e86af249f7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:10.108531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdc52f-c36d-4257-aeab-094b3e1e1d17 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:10.114990 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 217/414] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 16:29:09 2022] GET /identity/v3/groups/2ff6e3d3d5104821a149af3254fd5a6f => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:10.114990 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93eb05-2d7e-4831-8ca4-99e86af249f7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:10.226710 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93eb05-2d7e-4831-8ca4-99e86af249f7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:10.265084 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d927495-de17-4917-9fd7-46a016d9deb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:10.265932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d927495-de17-4917-9fd7-46a016d9deb5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.266219 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d927495-de17-4917-9fd7-46a016d9deb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.266498 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d927495-de17-4917-9fd7-46a016d9deb5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.278626 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d927495-de17-4917-9fd7-46a016d9deb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:10.287539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-5d927495-de17-4917-9fd7-46a016d9deb5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:29:10.287539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:10.287539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:10.287539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:10.287539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:10.287539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:10.287539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:10.287539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:10.287539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:10.287539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:10.287539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:10.287539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:10.287539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:10.287539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:10.287539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:10.287539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:10.288470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:10.288470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:10.288470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:10.288470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:10.288470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:10.288470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:10.288470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:10.288470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:10.288470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:10.288470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:10.288470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:10.288470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:10.288470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:10.288470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:10.288470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:10.288470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:10.289321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:10.289321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:10.289321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:10.289321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:10.289321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:10.289321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:10.289321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:10.289321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:10.289321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:10.289321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:10.289321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:29:10.289321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:10.289321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 218/415] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:29:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:10.290011 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d927495-de17-4917-9fd7-46a016d9deb5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:10.296267 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:10.319039 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 198/416] 10.222.0.48 () {58 vars in 1442 bytes} [Thu May 26 16:29:09 2022] PUT /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed/groups/ab11481ee6a64b27a37196204b86a4b4/roles/c8d1d9031cfc4ef8a0e62f6bfd7ff691 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:29:10.320681 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdc52f-c36d-4257-aeab-094b3e1e1d17 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:10.472968 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d927495-de17-4917-9fd7-46a016d9deb5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:10.517687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989f340-c1c4-41a9-b5c0-a2bc86d4a9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:10.519108 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989f340-c1c4-41a9-b5c0-a2bc86d4a9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.519394 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989f340-c1c4-41a9-b5c0-a2bc86d4a9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.519671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989f340-c1c4-41a9-b5c0-a2bc86d4a9c4 None admin] PATH_INFO: `/v3/projects/76a4e041bd164458a5b1a262dc443e9c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.521555 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989f340-c1c4-41a9-b5c0-a2bc86d4a9c4 None admin] RBAC: Authorizing `identity:get_project(project_id=76a4e041bd164458a5b1a262dc443e9c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:10.525284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989f340-c1c4-41a9-b5c0-a2bc86d4a9c4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:10.525611 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 219/417] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:29:10 2022] GET /identity/v3/projects/76a4e041bd164458a5b1a262dc443e9c => generated 344 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:10.530928 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989f340-c1c4-41a9-b5c0-a2bc86d4a9c4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:10.563577 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdc52f-c36d-4257-aeab-094b3e1e1d17 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:10.585740 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:10.625595 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:10.636341 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac29c85-2f04-440d-97e4-9dec20a727f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:10.637307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac29c85-2f04-440d-97e4-9dec20a727f1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.637646 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac29c85-2f04-440d-97e4-9dec20a727f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.638020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac29c85-2f04-440d-97e4-9dec20a727f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.638904 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac29c85-2f04-440d-97e4-9dec20a727f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:10.639287 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac29c85-2f04-440d-97e4-9dec20a727f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:10.640857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac29c85-2f04-440d-97e4-9dec20a727f1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:10.663490 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 199/418] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:29:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:10.663752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989f340-c1c4-41a9-b5c0-a2bc86d4a9c4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:10.670777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac29c85-2f04-440d-97e4-9dec20a727f1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:10.718966 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ca513-1c68-4716-bf08-c335a9d71b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:10.720256 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ca513-1c68-4716-bf08-c335a9d71b76 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.721177 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ca513-1c68-4716-bf08-c335a9d71b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.722000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ca513-1c68-4716-bf08-c335a9d71b76 None admin] PATH_INFO: `/v3/projects/76a4e041bd164458a5b1a262dc443e9c/groups/2ff6e3d3d5104821a149af3254fd5a6f/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.724548 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ca513-1c68-4716-bf08-c335a9d71b76 None admin] RBAC: Authorizing `identity:create_grant(project_id=76a4e041bd164458a5b1a262dc443e9c, group_id=2ff6e3d3d5104821a149af3254fd5a6f, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:10.726277 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ca513-1c68-4716-bf08-c335a9d71b76 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:10.790156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac29c85-2f04-440d-97e4-9dec20a727f1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:10.821941 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 220/419] 10.222.0.48 () {58 vars in 1442 bytes} [Thu May 26 16:29:10 2022] PUT /identity/v3/projects/76a4e041bd164458a5b1a262dc443e9c/groups/2ff6e3d3d5104821a149af3254fd5a6f/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:29:10.833321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9f70c-ea5b-4ced-9c52-c68daf97bf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:10.834013 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9f70c-ea5b-4ced-9c52-c68daf97bf3d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.834297 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9f70c-ea5b-4ced-9c52-c68daf97bf3d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.834572 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9f70c-ea5b-4ced-9c52-c68daf97bf3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.901560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:10.932109 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9f70c-ea5b-4ced-9c52-c68daf97bf3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:10.933684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9f70c-ea5b-4ced-9c52-c68daf97bf3d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:11.057945 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 200/420] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:29:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:29:11.064473 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ca513-1c68-4716-bf08-c335a9d71b76 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:11.178703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e321c-5e46-47f1-b6f9-62d6d410a638 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:11.179005 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e321c-5e46-47f1-b6f9-62d6d410a638 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:11.179248 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e321c-5e46-47f1-b6f9-62d6d410a638 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:11.180916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 201/421] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:11.185945 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc735881-0b9a-4d74-bbb1-dd4ccc2fa0ec None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:11.186368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc735881-0b9a-4d74-bbb1-dd4ccc2fa0ec None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:11.186533 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ca513-1c68-4716-bf08-c335a9d71b76 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:11.186693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc735881-0b9a-4d74-bbb1-dd4ccc2fa0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:11.210958 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dc735881-0b9a-4d74-bbb1-dd4ccc2fa0ec None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:11.214184 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dc735881-0b9a-4d74-bbb1-dd4ccc2fa0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:11.266131 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:11.286646 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3d1d8-e361-481e-970a-41af4d9790a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:11.287545 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3d1d8-e361-481e-970a-41af4d9790a5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:11.287834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3d1d8-e361-481e-970a-41af4d9790a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:11.288095 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3d1d8-e361-481e-970a-41af4d9790a5 None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:11.289486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3d1d8-e361-481e-970a-41af4d9790a5 None admin] RBAC: Authorizing `identity:get_project(project_id=97a27564d6b5404fa22fe354151a49d1)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:11.305757 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3d1d8-e361-481e-970a-41af4d9790a5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:11.305757 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 221/422] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:29:11 2022] GET /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:11.305757 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3d1d8-e361-481e-970a-41af4d9790a5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:11.306014 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 202/423] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:29:11.332720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc735881-0b9a-4d74-bbb1-dd4ccc2fa0ec None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:11.338195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:11.450161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc735881-0b9a-4d74-bbb1-dd4ccc2fa0ec None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:11.498285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3d1d8-e361-481e-970a-41af4d9790a5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:11.512073 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafa220-efd7-4823-bba5-14636ad284a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:11.513404 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafa220-efd7-4823-bba5-14636ad284a5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:11.513818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafa220-efd7-4823-bba5-14636ad284a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:11.514109 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafa220-efd7-4823-bba5-14636ad284a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:11.551134 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafa220-efd7-4823-bba5-14636ad284a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:11.576327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-5eafa220-efd7-4823-bba5-14636ad284a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:29:11.576327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:11.576327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:11.576327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:11.576327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:11.576327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:11.576327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:11.576327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:11.576327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:11.576327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:11.576327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:11.576327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:11.576327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:11.576327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:11.576327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:11.576327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:11.578606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:11.578606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:11.578606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:11.578606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:11.578606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:11.578606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:11.578606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:11.578606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:11.578606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:11.578606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:11.578606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:11.578606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:11.578606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:11.578606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:11.578606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:11.578606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:11.579994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:11.579994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:11.579994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:11.579994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:11.579994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:11.579994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:11.579994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:11.579994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:11.579994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:11.579994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:11.579994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:29:11.579994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:11.579994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 203/424] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 16:29:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:11.582176 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc34427-0690-4e0f-9f0e-40a3e2eede7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:11.583678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc34427-0690-4e0f-9f0e-40a3e2eede7d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:11.583678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc34427-0690-4e0f-9f0e-40a3e2eede7d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:11.583678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc34427-0690-4e0f-9f0e-40a3e2eede7d None admin] PATH_INFO: `/v3/groups/ab11481ee6a64b27a37196204b86a4b4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:11.584588 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafa220-efd7-4823-bba5-14636ad284a5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:11.586033 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc34427-0690-4e0f-9f0e-40a3e2eede7d None admin] RBAC: Authorizing `identity:get_group(group_id=ab11481ee6a64b27a37196204b86a4b4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:11.588023 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc34427-0690-4e0f-9f0e-40a3e2eede7d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:11.590291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 222/425] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 16:29:11 2022] GET /identity/v3/groups/ab11481ee6a64b27a37196204b86a4b4 => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:11.597694 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc34427-0690-4e0f-9f0e-40a3e2eede7d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:11.682914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:11.741829 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:11.759505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc34427-0690-4e0f-9f0e-40a3e2eede7d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:11.817109 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafa220-efd7-4823-bba5-14636ad284a5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:11.827772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61555fad-23a5-4128-bcd4-7f1829ea4e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:11.828447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61555fad-23a5-4128-bcd4-7f1829ea4e76 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:11.829182 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61555fad-23a5-4128-bcd4-7f1829ea4e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:11.829499 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61555fad-23a5-4128-bcd4-7f1829ea4e76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:11.830332 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61555fad-23a5-4128-bcd4-7f1829ea4e76 None admin] RBAC: Adding query filter params (group.id=ab11481ee6a64b27a37196204b86a4b4, role.id=cdbaa8196c574e32a331e8d4faee1a7e, scope.project.id=97a27564d6b5404fa22fe354151a49d1) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:11.830643 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61555fad-23a5-4128-bcd4-7f1829ea4e76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:11.833338 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61555fad-23a5-4128-bcd4-7f1829ea4e76 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:11.847212 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 223/426] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 26 16:29:11 2022] GET /identity/v3/role_assignments?group.id=ab11481ee6a64b27a37196204b86a4b4&scope.project.id=97a27564d6b5404fa22fe354151a49d1&role.id=cdbaa8196c574e32a331e8d4faee1a7e => generated 611 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:11.886273 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43731f7e-a045-40fe-8e69-9d8b6ae2c97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:11.886995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43731f7e-a045-40fe-8e69-9d8b6ae2c97a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:11.887282 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43731f7e-a045-40fe-8e69-9d8b6ae2c97a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:11.887562 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43731f7e-a045-40fe-8e69-9d8b6ae2c97a None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:11.888427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43731f7e-a045-40fe-8e69-9d8b6ae2c97a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:11.888871 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43731f7e-a045-40fe-8e69-9d8b6ae2c97a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:11.890398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43731f7e-a045-40fe-8e69-9d8b6ae2c97a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:11.900458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 204/427] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:11.905814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61555fad-23a5-4128-bcd4-7f1829ea4e76 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:12.043014 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61555fad-23a5-4128-bcd4-7f1829ea4e76 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:12.085652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:12.096384 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27815d3f-faf7-4e7b-aa3b-b818d67a8637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:12.101982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27815d3f-faf7-4e7b-aa3b-b818d67a8637 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:12.101982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27815d3f-faf7-4e7b-aa3b-b818d67a8637 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:12.101982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27815d3f-faf7-4e7b-aa3b-b818d67a8637 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:12.180482 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27815d3f-faf7-4e7b-aa3b-b818d67a8637 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:12.182227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27815d3f-faf7-4e7b-aa3b-b818d67a8637 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:12.292606 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 224/428] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:29:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:12.298414 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43731f7e-a045-40fe-8e69-9d8b6ae2c97a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:12.441583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43731f7e-a045-40fe-8e69-9d8b6ae2c97a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:12.467982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b8001-098f-49a1-89cd-90683b816ffb None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:12.468324 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b8001-098f-49a1-89cd-90683b816ffb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:12.468546 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b8001-098f-49a1-89cd-90683b816ffb None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:12.470245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 225/429] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:12.478043 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382b02b-1071-489a-b2b0-d60993c5c823 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:12.478043 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382b02b-1071-489a-b2b0-d60993c5c823 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:12.478043 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382b02b-1071-489a-b2b0-d60993c5c823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:12.478863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:12.502436 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3382b02b-1071-489a-b2b0-d60993c5c823 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:12.504375 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3382b02b-1071-489a-b2b0-d60993c5c823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:12.505926 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d249ea8-973c-4910-9de0-e1647d624a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:12.509341 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d249ea8-973c-4910-9de0-e1647d624a7b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:12.510226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d249ea8-973c-4910-9de0-e1647d624a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:12.511194 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d249ea8-973c-4910-9de0-e1647d624a7b None admin] PATH_INFO: `/v3/projects/97a27564d6b5404fa22fe354151a49d1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:12.514358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d249ea8-973c-4910-9de0-e1647d624a7b None admin] RBAC: Authorizing `identity:get_project(project_id=97a27564d6b5404fa22fe354151a49d1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:12.519375 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d249ea8-973c-4910-9de0-e1647d624a7b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:12.524813 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 205/430] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:29:12 2022] GET /identity/v3/projects/97a27564d6b5404fa22fe354151a49d1 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:12.533936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d249ea8-973c-4910-9de0-e1647d624a7b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:12.539837 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:12.589158 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 226/431] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:29:12.614318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382b02b-1071-489a-b2b0-d60993c5c823 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:12.720913 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382b02b-1071-489a-b2b0-d60993c5c823 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:12.732899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d249ea8-973c-4910-9de0-e1647d624a7b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:12.758674 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6076e0-1ceb-44f8-a324-875292321fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:12.759510 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6076e0-1ceb-44f8-a324-875292321fbf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:12.759845 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6076e0-1ceb-44f8-a324-875292321fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:12.760590 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6076e0-1ceb-44f8-a324-875292321fbf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:12.772635 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6076e0-1ceb-44f8-a324-875292321fbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:12.780802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-8f6076e0-1ceb-44f8-a324-875292321fbf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:29:12.780802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:12.780802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:12.780802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:12.780802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:12.780802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:12.780802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:12.780802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:12.780802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:12.780802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:12.780802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:12.780802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:12.780802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:12.780802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:12.780802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:12.780802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:12.782752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:12.782752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:12.782752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:12.782752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:12.782752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:12.782752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:12.782752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:12.782752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:12.782752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:12.782752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:12.782752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:12.782752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:12.782752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:12.782752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:12.782752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:12.782752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:12.784816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:12.784816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:12.784816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:12.784816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:12.784816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:12.784816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:12.784816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:12.784816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:12.784816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:12.784816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:12.784816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:29:12.784816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:12.784816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 227/432] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:29:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:12.789921 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6076e0-1ceb-44f8-a324-875292321fbf None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:12.811642 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88371223-9bca-4905-8f37-3194ac7bc4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:12.813675 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88371223-9bca-4905-8f37-3194ac7bc4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:12.814348 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:12.815168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88371223-9bca-4905-8f37-3194ac7bc4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:12.816479 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88371223-9bca-4905-8f37-3194ac7bc4d3 None admin] PATH_INFO: `/v3/groups/ab11481ee6a64b27a37196204b86a4b4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:12.818977 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88371223-9bca-4905-8f37-3194ac7bc4d3 None admin] RBAC: Authorizing `identity:get_group(group_id=ab11481ee6a64b27a37196204b86a4b4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:12.822051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88371223-9bca-4905-8f37-3194ac7bc4d3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:12.832657 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 206/433] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 16:29:12 2022] GET /identity/v3/groups/ab11481ee6a64b27a37196204b86a4b4 => generated 226 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:12.835943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88371223-9bca-4905-8f37-3194ac7bc4d3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:12.901866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6076e0-1ceb-44f8-a324-875292321fbf None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:12.946787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922baf42-3fe6-494d-b7f0-cbb24c6cfc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:12.947514 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922baf42-3fe6-494d-b7f0-cbb24c6cfc7c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:12.947801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922baf42-3fe6-494d-b7f0-cbb24c6cfc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:12.948074 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922baf42-3fe6-494d-b7f0-cbb24c6cfc7c None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:12.949195 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922baf42-3fe6-494d-b7f0-cbb24c6cfc7c None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:12.949531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922baf42-3fe6-494d-b7f0-cbb24c6cfc7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:12.950932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922baf42-3fe6-494d-b7f0-cbb24c6cfc7c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:12.953738 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:12.969946 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 228/434] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:29:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:12.978656 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922baf42-3fe6-494d-b7f0-cbb24c6cfc7c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:13.020148 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88371223-9bca-4905-8f37-3194ac7bc4d3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:13.071007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69643de-38ea-46ef-bb2a-b84f28f49726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:13.071856 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69643de-38ea-46ef-bb2a-b84f28f49726 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:13.072242 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69643de-38ea-46ef-bb2a-b84f28f49726 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:13.072622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69643de-38ea-46ef-bb2a-b84f28f49726 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:13.073809 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69643de-38ea-46ef-bb2a-b84f28f49726 None admin] RBAC: Adding query filter params (group.id=ab11481ee6a64b27a37196204b86a4b4, role.id=c8d1d9031cfc4ef8a0e62f6bfd7ff691, scope.project.id=97a27564d6b5404fa22fe354151a49d1) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:13.074366 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69643de-38ea-46ef-bb2a-b84f28f49726 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:13.079835 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69643de-38ea-46ef-bb2a-b84f28f49726 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:13.091042 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 207/435] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 26 16:29:12 2022] GET /identity/v3/role_assignments?group.id=ab11481ee6a64b27a37196204b86a4b4&scope.project.id=97a27564d6b5404fa22fe354151a49d1&role.id=c8d1d9031cfc4ef8a0e62f6bfd7ff691 => generated 611 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:13.093652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:13.116899 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922baf42-3fe6-494d-b7f0-cbb24c6cfc7c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:13.160859 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de30ec0-1b49-4f68-8040-aa579c0d5840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:13.161922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de30ec0-1b49-4f68-8040-aa579c0d5840 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:13.162404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de30ec0-1b49-4f68-8040-aa579c0d5840 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:13.162847 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de30ec0-1b49-4f68-8040-aa579c0d5840 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:13.257286 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de30ec0-1b49-4f68-8040-aa579c0d5840 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:13.259391 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de30ec0-1b49-4f68-8040-aa579c0d5840 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:13.367034 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:13.390766 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 229/436] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:29:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:13.394783 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0d0dc-5ce2-4d8d-a297-b13e68f1e64d None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:13.395384 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0d0dc-5ce2-4d8d-a297-b13e68f1e64d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:13.396070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0d0dc-5ce2-4d8d-a297-b13e68f1e64d None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:13.397443 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de30ec0-1b49-4f68-8040-aa579c0d5840 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:13.397999 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 208/437] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:29:13.406684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666632c-dfbc-43f4-9914-81d65c909779 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:13.406860 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666632c-dfbc-43f4-9914-81d65c909779 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:13.407098 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666632c-dfbc-43f4-9914-81d65c909779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:13.443185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4666632c-dfbc-43f4-9914-81d65c909779 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:13.445050 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4666632c-dfbc-43f4-9914-81d65c909779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:13.570109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de30ec0-1b49-4f68-8040-aa579c0d5840 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:13.573043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 209/438] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:13.598318 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666632c-dfbc-43f4-9914-81d65c909779 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:13.618140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3718f6-3099-4676-9ac4-5e7bbebdceea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:13.619543 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3718f6-3099-4676-9ac4-5e7bbebdceea None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:13.619898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3718f6-3099-4676-9ac4-5e7bbebdceea None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:13.620271 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3718f6-3099-4676-9ac4-5e7bbebdceea None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:13.622007 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3718f6-3099-4676-9ac4-5e7bbebdceea None admin] RBAC: Authorizing `identity:get_project(project_id=30b0d97406c64a4d8830d98d414453ed)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:13.624039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3718f6-3099-4676-9ac4-5e7bbebdceea None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:13.626226 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 230/439] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:29:13 2022] GET /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:13.633900 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3718f6-3099-4676-9ac4-5e7bbebdceea None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:13.672351 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:13.699948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:13.720955 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666632c-dfbc-43f4-9914-81d65c909779 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:13.755773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3718f6-3099-4676-9ac4-5e7bbebdceea None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:13.764907 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e36ee4-0b72-492f-b177-c59b38d2e97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:13.765818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e36ee4-0b72-492f-b177-c59b38d2e97e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:13.766100 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e36ee4-0b72-492f-b177-c59b38d2e97e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:13.766402 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e36ee4-0b72-492f-b177-c59b38d2e97e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:13.777303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e36ee4-0b72-492f-b177-c59b38d2e97e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:13.786091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-20e36ee4-0b72-492f-b177-c59b38d2e97e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:29:13.786091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:13.786091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:13.786091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:13.786091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:13.786091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:13.786091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:13.786091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:13.786091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:13.786091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:13.786091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:13.786091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:13.786091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:13.786091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:13.786091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:13.786091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:13.787185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:13.787185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:13.787185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:13.787185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:13.787185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:13.787185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:13.787185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:13.787185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:13.787185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:13.787185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:13.787185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:13.787185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:13.787185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:13.787185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:13.787185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:13.787185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:13.787976 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:13.787976 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:13.787976 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:13.787976 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:13.787976 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:13.787976 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:13.787976 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:13.787976 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:13.787976 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:13.787976 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:13.787976 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:29:13.787976 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:13.787976 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 210/440] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 16:29:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:13.788632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59810dce-8522-41cb-8673-87e4e9b6f499 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:13.788962 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59810dce-8522-41cb-8673-87e4e9b6f499 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:13.789148 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59810dce-8522-41cb-8673-87e4e9b6f499 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:13.790434 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 211/441] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:13.793247 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59810dce-8522-41cb-8673-87e4e9b6f499 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:13.795655 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc3e71-8e41-4aa5-90f1-804e2760332e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:13.796552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc3e71-8e41-4aa5-90f1-804e2760332e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:13.796845 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc3e71-8e41-4aa5-90f1-804e2760332e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:13.797120 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc3e71-8e41-4aa5-90f1-804e2760332e None admin] PATH_INFO: `/v3/groups/ab11481ee6a64b27a37196204b86a4b4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:13.798367 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc3e71-8e41-4aa5-90f1-804e2760332e None admin] RBAC: Authorizing `identity:get_group(group_id=ab11481ee6a64b27a37196204b86a4b4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:13.800373 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc3e71-8e41-4aa5-90f1-804e2760332e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:13.802047 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 231/442] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 16:29:13 2022] GET /identity/v3/groups/ab11481ee6a64b27a37196204b86a4b4 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:13.803231 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236b8b4-cafc-455c-a9ff-bb97e44f4343 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:13.803518 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236b8b4-cafc-455c-a9ff-bb97e44f4343 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:13.803797 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236b8b4-cafc-455c-a9ff-bb97e44f4343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:13.822822 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e236b8b4-cafc-455c-a9ff-bb97e44f4343 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:13.823968 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e236b8b4-cafc-455c-a9ff-bb97e44f4343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:13.895201 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 232/443] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:13.896116 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236b8b4-cafc-455c-a9ff-bb97e44f4343 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:13.907015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59810dce-8522-41cb-8673-87e4e9b6f499 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:13.922516 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:13.942531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39fa94-b5a8-45ed-955e-a1273f07c80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:13.943198 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39fa94-b5a8-45ed-955e-a1273f07c80c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:13.943481 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39fa94-b5a8-45ed-955e-a1273f07c80c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:13.943758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39fa94-b5a8-45ed-955e-a1273f07c80c None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:13.944494 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39fa94-b5a8-45ed-955e-a1273f07c80c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:13.944798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39fa94-b5a8-45ed-955e-a1273f07c80c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:13.946220 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39fa94-b5a8-45ed-955e-a1273f07c80c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:13.946808 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:13.954553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 212/444] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:13.955347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39fa94-b5a8-45ed-955e-a1273f07c80c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:13.999243 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236b8b4-cafc-455c-a9ff-bb97e44f4343 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:14.037066 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c72a2-edd9-460e-8ff6-1cb1d4f41aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:14.037757 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c72a2-edd9-460e-8ff6-1cb1d4f41aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:14.038041 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c72a2-edd9-460e-8ff6-1cb1d4f41aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:14.038317 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c72a2-edd9-460e-8ff6-1cb1d4f41aa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:14.039333 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c72a2-edd9-460e-8ff6-1cb1d4f41aa1 None admin] RBAC: Adding query filter params (group.id=ab11481ee6a64b27a37196204b86a4b4, role.id=cdbaa8196c574e32a331e8d4faee1a7e, scope.project.id=30b0d97406c64a4d8830d98d414453ed) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:14.039645 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c72a2-edd9-460e-8ff6-1cb1d4f41aa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:14.041103 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c72a2-edd9-460e-8ff6-1cb1d4f41aa1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:14.047560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 233/445] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 26 16:29:13 2022] GET /identity/v3/role_assignments?group.id=ab11481ee6a64b27a37196204b86a4b4&scope.project.id=30b0d97406c64a4d8830d98d414453ed&role.id=cdbaa8196c574e32a331e8d4faee1a7e => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:14.048432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c72a2-edd9-460e-8ff6-1cb1d4f41aa1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:14.065540 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39fa94-b5a8-45ed-955e-a1273f07c80c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:14.113454 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5820895-5518-44c6-b17a-cb8754ba2922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:14.114195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5820895-5518-44c6-b17a-cb8754ba2922 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:14.114482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5820895-5518-44c6-b17a-cb8754ba2922 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:14.114764 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5820895-5518-44c6-b17a-cb8754ba2922 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:14.127617 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5820895-5518-44c6-b17a-cb8754ba2922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:14.137252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-c5820895-5518-44c6-b17a-cb8754ba2922 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:14.137252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:14.137252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:14.137252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:14.137252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:14.137252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:14.137252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:14.137252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:14.137252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:14.137252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:14.137252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:14.137252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:14.137252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:14.137252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:14.137252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:14.137252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:14.138261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:14.138261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:14.138261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:14.138261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:14.138261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:14.138261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:14.138261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:14.138261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:14.138261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:14.138261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:14.138261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:14.138261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:14.138261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:14.138261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:14.138261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:14.138261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:14.139473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:14.139473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:14.139473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:14.139473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:14.139473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:14.139473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:14.139473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:14.139473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:14.139473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:14.139473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:14.139473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:14.139473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:14.139473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 213/446] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:29:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:14.144596 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5820895-5518-44c6-b17a-cb8754ba2922 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:14.179172 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c72a2-edd9-460e-8ff6-1cb1d4f41aa1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:14.189797 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:14.194301 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:14.221118 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40604a-e924-4cff-965c-423f92e0550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:14.222654 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40604a-e924-4cff-965c-423f92e0550f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:14.222942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40604a-e924-4cff-965c-423f92e0550f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:14.223214 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40604a-e924-4cff-965c-423f92e0550f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:14.265769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5820895-5518-44c6-b17a-cb8754ba2922 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:14.306383 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54666ed5-7c52-46de-a7d8-b41737e93c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:14.307056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54666ed5-7c52-46de-a7d8-b41737e93c1a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:14.307359 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54666ed5-7c52-46de-a7d8-b41737e93c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:14.307604 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54666ed5-7c52-46de-a7d8-b41737e93c1a None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:14.308753 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54666ed5-7c52-46de-a7d8-b41737e93c1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:14.308753 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54666ed5-7c52-46de-a7d8-b41737e93c1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:14.310213 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54666ed5-7c52-46de-a7d8-b41737e93c1a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:14.310425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40604a-e924-4cff-965c-423f92e0550f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:14.312321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40604a-e924-4cff-965c-423f92e0550f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:14.321828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 214/447] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:29:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:14.327158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54666ed5-7c52-46de-a7d8-b41737e93c1a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:14.443133 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 234/448] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:29:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:14.447728 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40604a-e924-4cff-965c-423f92e0550f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:14.457455 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:14.462205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54666ed5-7c52-46de-a7d8-b41737e93c1a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:14.467469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:14.507220 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90271df-5bd2-4e01-84fb-7665d213a5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:14.507883 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90271df-5bd2-4e01-84fb-7665d213a5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:14.508171 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90271df-5bd2-4e01-84fb-7665d213a5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:14.508446 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90271df-5bd2-4e01-84fb-7665d213a5a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:14.568781 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40604a-e924-4cff-965c-423f92e0550f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:14.576361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90271df-5bd2-4e01-84fb-7665d213a5a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:14.577900 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90271df-5bd2-4e01-84fb-7665d213a5a9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:14.603892 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca1f47-db87-41b0-93d0-9447d5cc669a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:14.604746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca1f47-db87-41b0-93d0-9447d5cc669a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:14.605027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca1f47-db87-41b0-93d0-9447d5cc669a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:14.605325 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca1f47-db87-41b0-93d0-9447d5cc669a None admin] PATH_INFO: `/v3/projects/30b0d97406c64a4d8830d98d414453ed` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:14.606507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca1f47-db87-41b0-93d0-9447d5cc669a None admin] RBAC: Authorizing `identity:get_project(project_id=30b0d97406c64a4d8830d98d414453ed)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:14.607945 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca1f47-db87-41b0-93d0-9447d5cc669a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:14.609744 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 235/449] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:29:14 2022] GET /identity/v3/projects/30b0d97406c64a4d8830d98d414453ed => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:14.615908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca1f47-db87-41b0-93d0-9447d5cc669a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:14.677865 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:14.682513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 215/450] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:29:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:29:14.688075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90271df-5bd2-4e01-84fb-7665d213a5a9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:14.700620 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:14.718870 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca1f47-db87-41b0-93d0-9447d5cc669a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:14.752910 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d3f19-ed91-46fb-a3ed-cd419b174834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:14.753800 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d3f19-ed91-46fb-a3ed-cd419b174834 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:14.754074 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d3f19-ed91-46fb-a3ed-cd419b174834 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:14.754378 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d3f19-ed91-46fb-a3ed-cd419b174834 None admin] PATH_INFO: `/v3/groups/ab11481ee6a64b27a37196204b86a4b4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:14.755513 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d3f19-ed91-46fb-a3ed-cd419b174834 None admin] RBAC: Authorizing `identity:get_group(group_id=ab11481ee6a64b27a37196204b86a4b4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:14.757054 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d3f19-ed91-46fb-a3ed-cd419b174834 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:14.758658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 236/451] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 16:29:14 2022] GET /identity/v3/groups/ab11481ee6a64b27a37196204b86a4b4 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:14.764478 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d3f19-ed91-46fb-a3ed-cd419b174834 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:14.787202 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90271df-5bd2-4e01-84fb-7665d213a5a9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:14.820879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57744dd2-09aa-43cc-9dad-ca8e2ca90fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:14.821566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57744dd2-09aa-43cc-9dad-ca8e2ca90fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:14.821843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57744dd2-09aa-43cc-9dad-ca8e2ca90fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:14.822112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57744dd2-09aa-43cc-9dad-ca8e2ca90fb8 None admin] PATH_INFO: `/v3/projects/76a4e041bd164458a5b1a262dc443e9c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:14.823290 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57744dd2-09aa-43cc-9dad-ca8e2ca90fb8 None admin] RBAC: Authorizing `identity:get_project(project_id=76a4e041bd164458a5b1a262dc443e9c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:14.824748 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57744dd2-09aa-43cc-9dad-ca8e2ca90fb8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:14.826500 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 216/452] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:29:14 2022] GET /identity/v3/projects/76a4e041bd164458a5b1a262dc443e9c => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:14.832296 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57744dd2-09aa-43cc-9dad-ca8e2ca90fb8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:14.863632 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d3f19-ed91-46fb-a3ed-cd419b174834 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:14.897845 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00eac5-4d92-4ce9-8cb4-91f21cac4d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:14.898532 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00eac5-4d92-4ce9-8cb4-91f21cac4d8e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:14.898785 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00eac5-4d92-4ce9-8cb4-91f21cac4d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:14.899059 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00eac5-4d92-4ce9-8cb4-91f21cac4d8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:14.899527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:14.899917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00eac5-4d92-4ce9-8cb4-91f21cac4d8e None admin] RBAC: Adding query filter params (group.id=ab11481ee6a64b27a37196204b86a4b4, role.id=c8d1d9031cfc4ef8a0e62f6bfd7ff691, scope.project.id=30b0d97406c64a4d8830d98d414453ed) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:14.900233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00eac5-4d92-4ce9-8cb4-91f21cac4d8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:14.901739 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00eac5-4d92-4ce9-8cb4-91f21cac4d8e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:14.907712 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 237/453] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 26 16:29:14 2022] GET /identity/v3/role_assignments?group.id=ab11481ee6a64b27a37196204b86a4b4&scope.project.id=30b0d97406c64a4d8830d98d414453ed&role.id=c8d1d9031cfc4ef8a0e62f6bfd7ff691 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:14.938421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57744dd2-09aa-43cc-9dad-ca8e2ca90fb8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:14.976615 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a7bd1-cb0e-426d-8ab1-5c6a68bb21bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:14.977468 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a7bd1-cb0e-426d-8ab1-5c6a68bb21bb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:14.977747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a7bd1-cb0e-426d-8ab1-5c6a68bb21bb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:14.978018 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a7bd1-cb0e-426d-8ab1-5c6a68bb21bb None admin] PATH_INFO: `/v3/groups/2ff6e3d3d5104821a149af3254fd5a6f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:14.979238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a7bd1-cb0e-426d-8ab1-5c6a68bb21bb None admin] RBAC: Authorizing `identity:get_group(group_id=2ff6e3d3d5104821a149af3254fd5a6f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:14.980756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a7bd1-cb0e-426d-8ab1-5c6a68bb21bb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:14.982471 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 217/454] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 16:29:14 2022] GET /identity/v3/groups/2ff6e3d3d5104821a149af3254fd5a6f => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:14.988678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00eac5-4d92-4ce9-8cb4-91f21cac4d8e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:15.004863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:15.105117 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00eac5-4d92-4ce9-8cb4-91f21cac4d8e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:15.141965 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ece9a-fd08-4367-870f-5fa29c8f3bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:15.142634 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ece9a-fd08-4367-870f-5fa29c8f3bdd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:15.142917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ece9a-fd08-4367-870f-5fa29c8f3bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:15.143192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ece9a-fd08-4367-870f-5fa29c8f3bdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:15.144603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ece9a-fd08-4367-870f-5fa29c8f3bdd None admin] RBAC: Adding query filter params (group.id=2ff6e3d3d5104821a149af3254fd5a6f, role.id=796e313fa8794ac885ccf6300d09332a, scope.project.id=76a4e041bd164458a5b1a262dc443e9c) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:15.144912 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ece9a-fd08-4367-870f-5fa29c8f3bdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:15.146438 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ece9a-fd08-4367-870f-5fa29c8f3bdd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:15.154343 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 238/455] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 26 16:29:14 2022] GET /identity/v3/role_assignments?group.id=2ff6e3d3d5104821a149af3254fd5a6f&scope.project.id=76a4e041bd164458a5b1a262dc443e9c&role.id=796e313fa8794ac885ccf6300d09332a => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:17.881702 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f89c8-cc80-4872-aaa0-88210db7501e None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:17.882722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f89c8-cc80-4872-aaa0-88210db7501e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:17.883271 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f89c8-cc80-4872-aaa0-88210db7501e None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:17.885440 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 218/456] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:17.892132 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68e789-4e8e-4d61-8b60-51e78af18e12 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:17.893089 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68e789-4e8e-4d61-8b60-51e78af18e12 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:17.893644 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68e789-4e8e-4d61-8b60-51e78af18e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:17.918259 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-eb68e789-4e8e-4d61-8b60-51e78af18e12 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:17.919801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-eb68e789-4e8e-4d61-8b60-51e78af18e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:18.022306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 239/457] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:18.059387 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f89c8-cc80-4872-aaa0-88210db7501e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:18.221105 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f89c8-cc80-4872-aaa0-88210db7501e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:18.230863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05446bb0-08ac-4a03-850b-91eed32bff06 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:18.231480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05446bb0-08ac-4a03-850b-91eed32bff06 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:18.231997 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05446bb0-08ac-4a03-850b-91eed32bff06 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:18.236103 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 240/458] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:18.246634 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50913fb-62d7-44b9-a181-9855c10af866 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:18.247336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50913fb-62d7-44b9-a181-9855c10af866 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:18.247815 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50913fb-62d7-44b9-a181-9855c10af866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:18.269697 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:18.285600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f50913fb-62d7-44b9-a181-9855c10af866 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:18.287627 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f50913fb-62d7-44b9-a181-9855c10af866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:18.294361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff401e-37ce-49d4-9757-ec6aeb770abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:18.295524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff401e-37ce-49d4-9757-ec6aeb770abe None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:18.297580 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff401e-37ce-49d4-9757-ec6aeb770abe None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:18.303199 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff401e-37ce-49d4-9757-ec6aeb770abe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:18.305845 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:18.323442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff401e-37ce-49d4-9757-ec6aeb770abe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:18.327806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff401e-37ce-49d4-9757-ec6aeb770abe None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:18.349380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-c4ff401e-37ce-49d4-9757-ec6aeb770abe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:18.349380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:18.349380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:18.349380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:18.349380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:18.349380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:18.349380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:18.349380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:18.349380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:18.349380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:18.349380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:18.349380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:18.349380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:18.349380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:18.349380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:18.351409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:18.351409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:18.351409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:18.351409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:18.351409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:18.351409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:18.351409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:18.351409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:18.351409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:18.351409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:18.351409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:18.351409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:18.351409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:18.351409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:18.351409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:18.351409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:18.351409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:18.353186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:18.353186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:18.353186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:18.353186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:18.353186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 219/459] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:18.353186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861a00f-8473-4e4b-9636-a1c06311db96 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:18.353186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861a00f-8473-4e4b-9636-a1c06311db96 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:18.353186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861a00f-8473-4e4b-9636-a1c06311db96 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:18.354215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 220/460] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:18.358907 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861a00f-8473-4e4b-9636-a1c06311db96 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:18.401390 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 241/461] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:18.401577 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e588882-0f51-4c26-8c3e-02ffc3dde596 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:18.401813 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e588882-0f51-4c26-8c3e-02ffc3dde596 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:18.405400 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e588882-0f51-4c26-8c3e-02ffc3dde596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:18.434165 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9e588882-0f51-4c26-8c3e-02ffc3dde596 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:18.435717 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9e588882-0f51-4c26-8c3e-02ffc3dde596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:18.499539 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861a00f-8473-4e4b-9636-a1c06311db96 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:18.529285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 242/462] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:18.529285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e588882-0f51-4c26-8c3e-02ffc3dde596 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:18.556811 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac20553-597d-4c3d-a6af-dd9874b0e3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:18.557851 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac20553-597d-4c3d-a6af-dd9874b0e3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:18.558364 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac20553-597d-4c3d-a6af-dd9874b0e3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:18.559099 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac20553-597d-4c3d-a6af-dd9874b0e3d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:18.560143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac20553-597d-4c3d-a6af-dd9874b0e3d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:18.560655 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac20553-597d-4c3d-a6af-dd9874b0e3d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:18.570166 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac20553-597d-4c3d-a6af-dd9874b0e3d8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:18.590985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 221/463] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:18.592304 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac20553-597d-4c3d-a6af-dd9874b0e3d8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:18.602690 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:18.650500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e588882-0f51-4c26-8c3e-02ffc3dde596 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:18.655849 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:18.687663 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9e90b-5e6b-475d-beba-4989e810fc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:18.688863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9e90b-5e6b-475d-beba-4989e810fc35 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:18.689415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9e90b-5e6b-475d-beba-4989e810fc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:18.689893 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9e90b-5e6b-475d-beba-4989e810fc35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:18.702323 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9e90b-5e6b-475d-beba-4989e810fc35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:18.704146 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9e90b-5e6b-475d-beba-4989e810fc35 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:18.723942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-1fd9e90b-5e6b-475d-beba-4989e810fc35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:18.723942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:18.723942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:18.723942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:18.723942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:18.723942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:18.723942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:18.723942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:18.723942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:18.723942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:18.723942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:18.723942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:18.723942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:18.723942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:18.723942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:18.724943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:18.724943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:18.724943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:18.724943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:18.724943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:18.724943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:18.724943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:18.724943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:18.724943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:18.724943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:18.724943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:18.724943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:18.724943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:18.724943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:18.724943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:18.724943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:18.724943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:18.726190 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:18.726190 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:18.726190 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:18.726190 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:18.726402 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac20553-597d-4c3d-a6af-dd9874b0e3d8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:18.728312 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 243/464] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:18.733932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9e90b-5e6b-475d-beba-4989e810fc35 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:18.771232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f776d-af1f-4a03-89e4-a414ff73693a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:18.771958 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f776d-af1f-4a03-89e4-a414ff73693a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:18.772240 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f776d-af1f-4a03-89e4-a414ff73693a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:18.772513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f776d-af1f-4a03-89e4-a414ff73693a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:18.789359 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f776d-af1f-4a03-89e4-a414ff73693a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:18.791339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f776d-af1f-4a03-89e4-a414ff73693a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:18.814038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-f35f776d-af1f-4a03-89e4-a414ff73693a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:18.814038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:18.814038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:18.814038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:18.814038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:18.814038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:18.814038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:18.814038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:18.814038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:18.814038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:18.814038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:18.814038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:18.814038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:18.814038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:18.814038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:18.814984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:18.814984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:18.814984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:18.814984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:18.814984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:18.814984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:18.814984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:18.814984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:18.814984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:18.814984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:18.814984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:18.814984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:18.814984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:18.814984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:18.814984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:18.814984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:18.814984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:18.816386 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:18.816386 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:18.816386 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:18.816386 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:18.824141 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 222/465] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:18.825501 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f776d-af1f-4a03-89e4-a414ff73693a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:18.869653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9e90b-5e6b-475d-beba-4989e810fc35 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:18.896310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:18.920218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0807e8-b957-4637-ad37-0d3fdb0a949b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:18.920917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0807e8-b957-4637-ad37-0d3fdb0a949b None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:18.921204 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0807e8-b957-4637-ad37-0d3fdb0a949b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:18.921512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0807e8-b957-4637-ad37-0d3fdb0a949b None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:18.922527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0807e8-b957-4637-ad37-0d3fdb0a949b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:18.925167 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0807e8-b957-4637-ad37-0d3fdb0a949b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:18.941604 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:18.946086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f776d-af1f-4a03-89e4-a414ff73693a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:18.983528 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01366f4b-9daf-456d-abdd-c65cbd4f6d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:18.984283 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01366f4b-9daf-456d-abdd-c65cbd4f6d3b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:18.984571 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01366f4b-9daf-456d-abdd-c65cbd4f6d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:18.984844 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01366f4b-9daf-456d-abdd-c65cbd4f6d3b None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:18.985732 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01366f4b-9daf-456d-abdd-c65cbd4f6d3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:18.986038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01366f4b-9daf-456d-abdd-c65cbd4f6d3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:18.987452 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01366f4b-9daf-456d-abdd-c65cbd4f6d3b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:19.000260 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 223/466] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:19.001190 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01366f4b-9daf-456d-abdd-c65cbd4f6d3b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:19.055254 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 244/467] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 16:29:18 2022] POST /identity/v3/users => generated 246 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:29:19.067201 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765d587-070c-44b2-9016-0b1f87c2bddc None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:19.067515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765d587-070c-44b2-9016-0b1f87c2bddc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:19.067757 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765d587-070c-44b2-9016-0b1f87c2bddc None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:19.074084 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 245/468] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:19.074084 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765d587-070c-44b2-9016-0b1f87c2bddc None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:19.138712 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01366f4b-9daf-456d-abdd-c65cbd4f6d3b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:19.192023 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ce116-34af-4df2-95b6-98b659074c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:19.194385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ce116-34af-4df2-95b6-98b659074c81 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:19.194657 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ce116-34af-4df2-95b6-98b659074c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:19.194936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ce116-34af-4df2-95b6-98b659074c81 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:19.195677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ce116-34af-4df2-95b6-98b659074c81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:19.198682 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ce116-34af-4df2-95b6-98b659074c81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:19.201395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ce116-34af-4df2-95b6-98b659074c81 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:19.225983 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 224/469] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:19.227985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e64f8-0112-4994-a7ef-a61ef8176b27 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:19.228608 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e64f8-0112-4994-a7ef-a61ef8176b27 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:19.229102 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e64f8-0112-4994-a7ef-a61ef8176b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:19.248733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c65e64f8-0112-4994-a7ef-a61ef8176b27 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:19.250389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c65e64f8-0112-4994-a7ef-a61ef8176b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:19.267585 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:19.274158 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765d587-070c-44b2-9016-0b1f87c2bddc None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:19.336334 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772bd61-8394-4d8d-9d61-788083252dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:19.336943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772bd61-8394-4d8d-9d61-788083252dba None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:19.337431 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772bd61-8394-4d8d-9d61-788083252dba None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:19.337713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772bd61-8394-4d8d-9d61-788083252dba None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:19.338835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772bd61-8394-4d8d-9d61-788083252dba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:19.340636 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772bd61-8394-4d8d-9d61-788083252dba None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:19.350951 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 225/470] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:19.352983 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e64f8-0112-4994-a7ef-a61ef8176b27 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:19.441893 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 246/471] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 16:29:19 2022] POST /identity/v3/users => generated 248 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:29:19.443581 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772bd61-8394-4d8d-9d61-788083252dba None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:19.488021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e64f8-0112-4994-a7ef-a61ef8176b27 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:19.510462 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:19.539840 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4eb9cb-659c-48d2-9633-9a5f2be5caf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:19.540532 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4eb9cb-659c-48d2-9633-9a5f2be5caf0 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:19.540812 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4eb9cb-659c-48d2-9633-9a5f2be5caf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:19.541086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4eb9cb-659c-48d2-9633-9a5f2be5caf0 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:19.541869 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4eb9cb-659c-48d2-9633-9a5f2be5caf0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:19.543578 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4eb9cb-659c-48d2-9633-9a5f2be5caf0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:19.599427 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772bd61-8394-4d8d-9d61-788083252dba None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:19.642489 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92cef0-894b-4045-b8de-f963f43ccddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:19.643363 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92cef0-894b-4045-b8de-f963f43ccddd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:19.644134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92cef0-894b-4045-b8de-f963f43ccddd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:19.644471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92cef0-894b-4045-b8de-f963f43ccddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:19.658285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92cef0-894b-4045-b8de-f963f43ccddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:19.660966 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 226/472] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 16:29:19 2022] POST /identity/v3/users => generated 248 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:29:19.661096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92cef0-894b-4045-b8de-f963f43ccddd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:19.663363 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042ce9f-d8c3-499d-8832-18fdafd2b81e None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:19.663363 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042ce9f-d8c3-499d-8832-18fdafd2b81e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:19.663363 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042ce9f-d8c3-499d-8832-18fdafd2b81e None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:19.669943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 227/473] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:19.674204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2b1d9-ffe2-42a3-b8b1-e93525d5edca None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:19.674578 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2b1d9-ffe2-42a3-b8b1-e93525d5edca None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:19.674853 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2b1d9-ffe2-42a3-b8b1-e93525d5edca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:19.685382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6b92cef0-894b-4045-b8de-f963f43ccddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:19.685382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:19.685382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:19.685382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:19.685382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:19.685382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:19.685382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:19.685382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:19.685382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:19.685382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:19.685382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:19.685382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:19.685382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:19.685382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:19.685382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:19.686500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:19.686500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:19.686500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:19.686500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:19.686500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:19.686500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:19.686500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:19.686500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:19.686500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:19.686500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:19.686500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:19.686500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:19.686500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:19.686500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:19.686500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:19.686500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:19.686500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:19.687545 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:19.687545 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:19.687545 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:19.687545 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:19.693301 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 247/474] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:19.695934 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:19.698536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92cef0-894b-4045-b8de-f963f43ccddd None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:19.706354 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-55c2b1d9-ffe2-42a3-b8b1-e93525d5edca None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:19.708129 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-55c2b1d9-ffe2-42a3-b8b1-e93525d5edca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:19.824169 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 228/475] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:19.834663 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:19.853201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2b1d9-ffe2-42a3-b8b1-e93525d5edca None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:19.858597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92cef0-894b-4045-b8de-f963f43ccddd None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:19.913865 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b34252-4719-4a41-9b91-7895fa2e9e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:19.914661 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b34252-4719-4a41-9b91-7895fa2e9e00 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:19.914851 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b34252-4719-4a41-9b91-7895fa2e9e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:19.915095 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b34252-4719-4a41-9b91-7895fa2e9e00 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:19.915834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b34252-4719-4a41-9b91-7895fa2e9e00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:19.916138 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b34252-4719-4a41-9b91-7895fa2e9e00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:19.917597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b34252-4719-4a41-9b91-7895fa2e9e00 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:19.933553 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 248/476] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:19.939134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b34252-4719-4a41-9b91-7895fa2e9e00 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:19.993779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2b1d9-ffe2-42a3-b8b1-e93525d5edca None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:20.035450 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4677be-efe7-445b-b862-544786bcbe3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:20.036173 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4677be-efe7-445b-b862-544786bcbe3d None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:20.036457 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4677be-efe7-445b-b862-544786bcbe3d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:20.036730 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4677be-efe7-445b-b862-544786bcbe3d None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:20.037507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4677be-efe7-445b-b862-544786bcbe3d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:20.038909 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4677be-efe7-445b-b862-544786bcbe3d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:20.041429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:20.069889 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b34252-4719-4a41-9b91-7895fa2e9e00 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:20.080963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.sql.core [None req-6c4677be-efe7-445b-b862-544786bcbe3d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 16:29:20.080963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 16:29:20.080963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [parameters: {'id': 'e0770b10fa1045b2b7cb4b10814e248a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 16:29:20.080963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80497) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 16:29:20.104628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-6c4677be-efe7-445b-b862-544786bcbe3d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 16:29:20.104628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:20.104628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:29:20.104628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:29:20.104628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:29:20.104628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:29:20.104628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:29:20.104628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:29:20.104628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:29:20.104628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application conn.query(q) May 26 16:29:20.104628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:29:20.104628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:29:20.104628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:29:20.104628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application result.read() May 26 16:29:20.104628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:29:20.105759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:29:20.105759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:29:20.105759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:29:20.105759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:29:20.105759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:29:20.105759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:29:20.105759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:29:20.105759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 16:29:20.105759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:20.105759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 16:29:20.105759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:20.105759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:20.105759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 16:29:20.105759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 16:29:20.105759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 26 16:29:20.105759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return ref.to_dict() May 26 16:29:20.105759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:29:20.105759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application next(self.gen) May 26 16:29:20.106877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 16:29:20.106877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application yield resource May 26 16:29:20.106877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:29:20.106877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application next(self.gen) May 26 16:29:20.106877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 16:29:20.106877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.session.rollback() May 26 16:29:20.106877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 16:29:20.106877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.force_reraise() May 26 16:29:20.106877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 16:29:20.106877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise self.value May 26 16:29:20.106877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 16:29:20.106877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 16:29:20.106877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 16:29:20.106877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application session.commit() May 26 16:29:20.106877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 16:29:20.106877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 16:29:20.106877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 16:29:20.107799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._prepare_impl() May 26 16:29:20.107799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 16:29:20.107799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.session.flush() May 26 16:29:20.107799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 16:29:20.107799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._flush(objects) May 26 16:29:20.107799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 16:29:20.107799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 16:29:20.107799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 16:29:20.107799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application compat.raise_( May 26 16:29:20.107799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:29:20.107799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception May 26 16:29:20.107799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 16:29:20.107799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application flush_context.execute() May 26 16:29:20.107799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 16:29:20.107799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rec.execute(self) May 26 16:29:20.107799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 16:29:20.107799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 16:29:20.108693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 16:29:20.108693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 16:29:20.108693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 16:29:20.108693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 16:29:20.108693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 16:29:20.108693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 16:29:20.108693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 16:29:20.108693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 16:29:20.108693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 16:29:20.108693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 16:29:20.108693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 16:29:20.108693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 16:29:20.108693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 16:29:20.108693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 16:29:20.108693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:29:20.108693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception May 26 16:29:20.109639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:29:20.109639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:29:20.109639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:29:20.109639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:29:20.109639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:29:20.109639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:29:20.109639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:29:20.109639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application conn.query(q) May 26 16:29:20.109639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:29:20.109639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:29:20.109639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:29:20.109639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application result.read() May 26 16:29:20.109639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:29:20.109639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:29:20.109639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:29:20.109639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:29:20.110510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:29:20.110510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:29:20.110510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:29:20.110510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:29:20.110510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 16:29:20.110510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 16:29:20.110510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [parameters: {'id': 'e0770b10fa1045b2b7cb4b10814e248a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 16:29:20.110510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 16:29:20.110510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:20.110510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:20.110510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:20.110510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:20.110510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:20.110510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:20.110510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:20.110510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:20.111398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:20.111398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:20.111398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:20.111398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:20.111398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:20.111398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:20.111398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 26 16:29:20.111398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 26 16:29:20.111398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:20.111398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:20.111398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 26 16:29:20.111398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 26 16:29:20.111398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 16:29:20.111398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 16:29:20.111398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 16:29:20.111398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:20.118624 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 229/477] 10.222.0.48 () {60 vars in 1131 bytes} [Thu May 26 16:29:19 2022] POST /identity/v3/roles => generated 144 bytes in 254 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:20.118624 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4677be-efe7-445b-b862-544786bcbe3d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:20.134745 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84798af4-9446-4ea5-b7db-5ee61202ecf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:20.135847 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84798af4-9446-4ea5-b7db-5ee61202ecf5 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:20.136591 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84798af4-9446-4ea5-b7db-5ee61202ecf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:20.137693 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84798af4-9446-4ea5-b7db-5ee61202ecf5 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:20.138898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84798af4-9446-4ea5-b7db-5ee61202ecf5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:20.141231 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84798af4-9446-4ea5-b7db-5ee61202ecf5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:20.233642 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:20.245300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4677be-efe7-445b-b862-544786bcbe3d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:20.247475 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 249/478] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 16:29:19 2022] POST /identity/v3/users => generated 249 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:29:20.290220 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea73a7-a4c2-4497-87ca-1aa0eb4678a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:20.291123 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea73a7-a4c2-4497-87ca-1aa0eb4678a1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:20.291404 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea73a7-a4c2-4497-87ca-1aa0eb4678a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:20.291674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea73a7-a4c2-4497-87ca-1aa0eb4678a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:20.306185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea73a7-a4c2-4497-87ca-1aa0eb4678a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:20.315582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-1dea73a7-a4c2-4497-87ca-1aa0eb4678a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:29:20.315582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:20.315582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:20.315582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:20.315582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:20.315582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:20.315582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:20.315582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:20.315582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:20.315582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:20.315582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:20.315582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:20.315582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:20.315582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:20.315582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:20.315582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:20.316536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:20.316536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:20.316536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:20.316536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:20.316536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:20.316536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:20.316536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:20.316536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:20.316536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:20.316536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:20.316536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:20.316536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:20.316536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:20.316536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:20.316536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:20.316536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:20.317361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:20.317361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:20.317361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:20.317361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:20.317361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:20.317361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:20.317361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:20.317361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:20.317361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:20.317361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:20.317361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:29:20.317361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:20.317361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 230/479] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 16:29:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:20.323406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84798af4-9446-4ea5-b7db-5ee61202ecf5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:20.468182 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84798af4-9446-4ea5-b7db-5ee61202ecf5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:20.568734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036251e3-c530-494e-9bf8-46189eec534e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:20.569826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036251e3-c530-494e-9bf8-46189eec534e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:20.570332 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036251e3-c530-494e-9bf8-46189eec534e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:20.570830 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036251e3-c530-494e-9bf8-46189eec534e None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:20.571793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036251e3-c530-494e-9bf8-46189eec534e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:20.572335 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036251e3-c530-494e-9bf8-46189eec534e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:20.573981 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036251e3-c530-494e-9bf8-46189eec534e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:20.586620 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 250/480] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:21.719076 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c3238-cc2c-4c6d-96ad-5cb88ada4b51 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:21.719614 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c3238-cc2c-4c6d-96ad-5cb88ada4b51 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:21.719614 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c3238-cc2c-4c6d-96ad-5cb88ada4b51 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:21.721809 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 231/481] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:21.727285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0976b-4fa2-46ee-b1ef-72df48d85f0a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:21.728137 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0976b-4fa2-46ee-b1ef-72df48d85f0a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:21.728758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0976b-4fa2-46ee-b1ef-72df48d85f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:21.754192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-87d0976b-4fa2-46ee-b1ef-72df48d85f0a None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:21.755758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-87d0976b-4fa2-46ee-b1ef-72df48d85f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:21.847304 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:21.864474 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 251/482] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:21.900321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c3238-cc2c-4c6d-96ad-5cb88ada4b51 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:21.988746 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:22.052491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c3238-cc2c-4c6d-96ad-5cb88ada4b51 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:22.115131 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003af9b-86c4-4952-b459-f36edfabd939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:22.115943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003af9b-86c4-4952-b459-f36edfabd939 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:22.116231 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003af9b-86c4-4952-b459-f36edfabd939 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:22.116512 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003af9b-86c4-4952-b459-f36edfabd939 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:22.138115 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003af9b-86c4-4952-b459-f36edfabd939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:22.146546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-0003af9b-86c4-4952-b459-f36edfabd939 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:22.146546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:22.146546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:22.146546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:22.146546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:22.146546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:22.146546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:22.146546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:22.146546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:22.146546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:22.146546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:22.146546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:22.146546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:22.146546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:22.146546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:22.146546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:22.147632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:22.147632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:22.147632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:22.147632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:22.147632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:22.147632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:22.147632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:22.147632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:22.147632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:22.147632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:22.147632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:22.147632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:22.147632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:22.147632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:22.147632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:22.147632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:22.148449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:22.148449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:22.148449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:22.148449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:22.148449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:22.148449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:22.148449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:22.148449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:22.148449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:22.148449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:22.148449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:22.148449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:22.148449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 232/483] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:29:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:22.154641 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0976b-4fa2-46ee-b1ef-72df48d85f0a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:22.303779 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0976b-4fa2-46ee-b1ef-72df48d85f0a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:22.359409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de91c9f-dd2e-4b03-a8d6-68f1902f04fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:22.360161 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de91c9f-dd2e-4b03-a8d6-68f1902f04fa None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:22.360520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de91c9f-dd2e-4b03-a8d6-68f1902f04fa None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:22.360801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de91c9f-dd2e-4b03-a8d6-68f1902f04fa None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:22.361621 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de91c9f-dd2e-4b03-a8d6-68f1902f04fa None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:22.362522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de91c9f-dd2e-4b03-a8d6-68f1902f04fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:22.364308 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de91c9f-dd2e-4b03-a8d6-68f1902f04fa None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:22.378431 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 252/484] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 16:29:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:22.386393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003af9b-86c4-4952-b459-f36edfabd939 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:22.464049 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c1356-7940-49b1-91b8-9c7e1480dbf0 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:22.464374 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c1356-7940-49b1-91b8-9c7e1480dbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:22.464606 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c1356-7940-49b1-91b8-9c7e1480dbf0 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:22.467547 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 253/485] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:22.472681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc4978-1cff-4bef-a2c4-49adf862d794 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:22.472970 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc4978-1cff-4bef-a2c4-49adf862d794 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:22.473249 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc4978-1cff-4bef-a2c4-49adf862d794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:22.514355 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-55dc4978-1cff-4bef-a2c4-49adf862d794 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:22.515576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-55dc4978-1cff-4bef-a2c4-49adf862d794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:22.556440 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003af9b-86c4-4952-b459-f36edfabd939 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:22.581465 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:22.589766 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:22.612374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd040ce4-0428-4786-9f1c-6baffb057561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:22.613487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd040ce4-0428-4786-9f1c-6baffb057561 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:22.614035 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd040ce4-0428-4786-9f1c-6baffb057561 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:22.614473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd040ce4-0428-4786-9f1c-6baffb057561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:22.633205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd040ce4-0428-4786-9f1c-6baffb057561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:22.635438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd040ce4-0428-4786-9f1c-6baffb057561 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:22.657363 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 254/486] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:22.670089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-bd040ce4-0428-4786-9f1c-6baffb057561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:22.670089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:22.670089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:22.670089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:22.670089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:22.670089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:22.670089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:22.670089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:22.670089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:22.670089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:22.670089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:22.670089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:22.670089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:22.670089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:22.670089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:22.671236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:22.671236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:22.671236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:22.671236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:22.671236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:22.671236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:22.671236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:22.671236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:22.671236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:22.671236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:22.671236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:22.671236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:22.671236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:22.671236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:22.671236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:22.671236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:22.671236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:22.672158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:22.672158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:22.672158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:22.672158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:22.672158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 233/487] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:22.673341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9401a-ca08-4a41-a7ae-c6b438c85bc2 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:22.673762 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9401a-ca08-4a41-a7ae-c6b438c85bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:22.674207 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9401a-ca08-4a41-a7ae-c6b438c85bc2 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:22.676580 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 255/488] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:22.680157 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd040ce4-0428-4786-9f1c-6baffb057561 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:22.687120 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a1348-0009-4d4a-896a-86b6b849fdf8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:22.687624 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a1348-0009-4d4a-896a-86b6b849fdf8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:22.688081 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a1348-0009-4d4a-896a-86b6b849fdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:22.712984 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-620a1348-0009-4d4a-896a-86b6b849fdf8 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:22.714440 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-620a1348-0009-4d4a-896a-86b6b849fdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:22.801284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 256/489] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:29:22.801284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a1348-0009-4d4a-896a-86b6b849fdf8 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:22.830995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd040ce4-0428-4786-9f1c-6baffb057561 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:22.879456 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d4476-fe46-4659-885e-78d49b585c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:22.880391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d4476-fe46-4659-885e-78d49b585c2d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:22.881097 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d4476-fe46-4659-885e-78d49b585c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:22.881555 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d4476-fe46-4659-885e-78d49b585c2d None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:22.882748 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d4476-fe46-4659-885e-78d49b585c2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:22.883212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d4476-fe46-4659-885e-78d49b585c2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:22.885247 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d4476-fe46-4659-885e-78d49b585c2d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:22.904676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 234/490] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:22.905958 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d4476-fe46-4659-885e-78d49b585c2d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:22.946438 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a1348-0009-4d4a-896a-86b6b849fdf8 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:22.947891 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:22.964515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:22.991968 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26aaaaf-a43d-4c4f-91e0-3ea79f931611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:22.992933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26aaaaf-a43d-4c4f-91e0-3ea79f931611 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:22.993391 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26aaaaf-a43d-4c4f-91e0-3ea79f931611 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:22.993805 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26aaaaf-a43d-4c4f-91e0-3ea79f931611 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:23.007202 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26aaaaf-a43d-4c4f-91e0-3ea79f931611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:23.016061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e26aaaaf-a43d-4c4f-91e0-3ea79f931611 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:23.016061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:23.016061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:23.016061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:23.016061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:23.016061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:23.016061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:23.016061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:23.016061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:23.016061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:23.016061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:23.016061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:23.016061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:23.016061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:23.016061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:23.016061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:23.017215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:23.017215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:23.017215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:23.017215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:23.017215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:23.017215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:23.017215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:23.017215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:23.017215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:23.017215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:23.017215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:23.017215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:23.017215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:23.017215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:23.017215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:23.017215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:23.018772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:23.018772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:23.018772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:23.018772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:23.018772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:23.018772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:23.018772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:23.018772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:23.018772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:23.018772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:23.018772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:23.018772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:23.025983 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 257/491] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:29:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:23.027444 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26aaaaf-a43d-4c4f-91e0-3ea79f931611 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:23.048132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d4476-fe46-4659-885e-78d49b585c2d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:23.094238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4e3fa-92d1-40de-82c1-8c5bf37c04c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:23.095631 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4e3fa-92d1-40de-82c1-8c5bf37c04c7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:23.096086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4e3fa-92d1-40de-82c1-8c5bf37c04c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:23.097001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4e3fa-92d1-40de-82c1-8c5bf37c04c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:23.113084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4e3fa-92d1-40de-82c1-8c5bf37c04c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:23.123974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d6c4e3fa-92d1-40de-82c1-8c5bf37c04c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:23.123974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:23.123974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:23.123974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:23.123974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:23.123974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:23.123974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:23.123974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:23.123974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:23.123974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:23.123974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:23.123974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:23.123974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:23.123974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:23.123974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:23.123974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:23.124915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:23.124915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:23.124915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:23.124915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:23.124915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:23.124915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:23.124915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:23.124915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:23.124915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:23.124915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:23.124915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:23.124915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:23.124915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:23.124915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:23.124915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:23.124915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:23.125784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:23.125784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:23.125784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:23.125784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:23.125784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:23.125784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:23.125784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:23.125784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:23.125784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:23.125784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:23.125784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:23.125784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:23.129403 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 235/492] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:29:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:23.133713 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4e3fa-92d1-40de-82c1-8c5bf37c04c7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:23.196346 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26aaaaf-a43d-4c4f-91e0-3ea79f931611 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:23.254688 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:23.257051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a31c7-e350-4f69-9163-ac2ad1f78e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:23.258412 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a31c7-e350-4f69-9163-ac2ad1f78e08 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:23.258842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a31c7-e350-4f69-9163-ac2ad1f78e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:23.259319 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a31c7-e350-4f69-9163-ac2ad1f78e08 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:23.271721 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4e3fa-92d1-40de-82c1-8c5bf37c04c7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:23.274048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a31c7-e350-4f69-9163-ac2ad1f78e08 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:23.277160 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a31c7-e350-4f69-9163-ac2ad1f78e08 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:23.302863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-945a31c7-e350-4f69-9163-ac2ad1f78e08 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:29:23.302863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:23.302863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:23.302863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:23.302863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:23.302863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:23.302863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:23.302863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:23.302863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:23.302863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:23.302863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:23.302863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:23.302863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:23.302863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:23.302863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:23.302863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:23.303814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:23.303814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:23.303814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:23.303814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:23.303814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:23.303814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:23.303814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:23.303814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:23.303814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:23.303814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:23.303814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:23.303814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:23.303814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:23.303814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:23.303814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:23.303814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:23.303814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:23.303814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:23.304689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:23.304689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:23.304689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:23.304689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:23.304689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:23.304689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:23.304689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:23.304689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:23.304689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:29:23.304689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:23.307010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 258/493] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 26 16:29:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:23.307964 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a31c7-e350-4f69-9163-ac2ad1f78e08 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:23.329609 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29587296-ae77-473c-8105-9518a7c4a5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:23.331548 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29587296-ae77-473c-8105-9518a7c4a5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:23.332050 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29587296-ae77-473c-8105-9518a7c4a5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:23.332521 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29587296-ae77-473c-8105-9518a7c4a5a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:23.334081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29587296-ae77-473c-8105-9518a7c4a5a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:23.334606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29587296-ae77-473c-8105-9518a7c4a5a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:23.336774 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29587296-ae77-473c-8105-9518a7c4a5a3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:23.344225 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:23.358098 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 236/494] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 16:29:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:23.358098 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29587296-ae77-473c-8105-9518a7c4a5a3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:23.440738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a31c7-e350-4f69-9163-ac2ad1f78e08 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:23.489492 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad819de-33ac-4b42-9348-f5defcb50265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:23.490477 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad819de-33ac-4b42-9348-f5defcb50265 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:23.490763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad819de-33ac-4b42-9348-f5defcb50265 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:23.491311 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad819de-33ac-4b42-9348-f5defcb50265 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:23.492067 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad819de-33ac-4b42-9348-f5defcb50265 None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:23.492372 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad819de-33ac-4b42-9348-f5defcb50265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:23.493947 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad819de-33ac-4b42-9348-f5defcb50265 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:23.498465 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29587296-ae77-473c-8105-9518a7c4a5a3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:23.510418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 259/495] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 16:29:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:23.510418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad819de-33ac-4b42-9348-f5defcb50265 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:23.548090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab91a20-8950-442f-9999-daf016707a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:23.549374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab91a20-8950-442f-9999-daf016707a15 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:23.549957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab91a20-8950-442f-9999-daf016707a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:23.550393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab91a20-8950-442f-9999-daf016707a15 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:23.552064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab91a20-8950-442f-9999-daf016707a15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:23.552582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab91a20-8950-442f-9999-daf016707a15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:23.554935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab91a20-8950-442f-9999-daf016707a15 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:23.601815 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 237/496] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 26 16:29:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:23.603491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c574fa9-8d14-4182-9550-6a8c148692b8 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:23.603908 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c574fa9-8d14-4182-9550-6a8c148692b8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:23.604308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c574fa9-8d14-4182-9550-6a8c148692b8 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:23.610162 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 238/497] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:23.610162 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c574fa9-8d14-4182-9550-6a8c148692b8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:23.621755 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:23.631950 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:23.638799 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad819de-33ac-4b42-9348-f5defcb50265 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:23.684170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e596455-f49c-4f69-a7db-e429c1c7a293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:23.684975 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e596455-f49c-4f69-a7db-e429c1c7a293 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:23.685254 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e596455-f49c-4f69-a7db-e429c1c7a293 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:23.685559 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e596455-f49c-4f69-a7db-e429c1c7a293 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:23.697675 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e596455-f49c-4f69-a7db-e429c1c7a293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:23.699173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e596455-f49c-4f69-a7db-e429c1c7a293 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:23.717967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-2e596455-f49c-4f69-a7db-e429c1c7a293 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:23.717967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:23.717967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:23.717967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:23.717967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:23.717967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:23.717967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:23.717967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:23.717967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:23.717967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:23.717967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:23.717967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:23.717967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:23.717967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:23.717967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:23.718963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:23.718963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:23.718963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:23.718963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:23.718963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:23.718963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:23.718963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:23.718963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:23.718963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:23.718963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:23.718963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:23.718963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:23.718963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:23.718963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:23.718963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:23.718963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:23.718963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:23.720185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:23.720185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:23.720185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:23.720185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:23.720185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 260/498] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:23.720185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e596455-f49c-4f69-a7db-e429c1c7a293 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:23.732112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c574fa9-8d14-4182-9550-6a8c148692b8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:23.773451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae9531-9037-4acc-9931-7a86f6122324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:23.774244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae9531-9037-4acc-9931-7a86f6122324 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:23.774525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae9531-9037-4acc-9931-7a86f6122324 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:23.774795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae9531-9037-4acc-9931-7a86f6122324 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:23.785178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae9531-9037-4acc-9931-7a86f6122324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:23.786676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae9531-9037-4acc-9931-7a86f6122324 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:23.805007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-e5ae9531-9037-4acc-9931-7a86f6122324 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:23.805007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:23.805007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:23.805007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:23.805007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:23.805007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:23.805007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:23.805007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:23.805007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:23.805007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:23.805007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:23.805007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:23.805007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:23.805007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:23.805007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:23.806124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:23.806124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:23.806124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:23.806124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:23.806124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:23.806124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:23.806124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:23.806124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:23.806124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:23.806124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:23.806124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:23.806124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:23.806124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:23.806124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:23.806124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:23.806124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:23.806124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:23.806998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:23.806998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:23.806998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:23.806998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:23.806998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 239/499] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:23.807447 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d154e-fec1-4c83-af6b-0e3389bbe7a0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:23.807723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d154e-fec1-4c83-af6b-0e3389bbe7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:23.807994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d154e-fec1-4c83-af6b-0e3389bbe7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:23.833290 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-983d154e-fec1-4c83-af6b-0e3389bbe7a0 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:23.834628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-983d154e-fec1-4c83-af6b-0e3389bbe7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:23.842659 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e596455-f49c-4f69-a7db-e429c1c7a293 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:23.881379 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb7cfe-32fa-479e-b069-cedf74095fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:23.881961 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb7cfe-32fa-479e-b069-cedf74095fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:23.882189 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb7cfe-32fa-479e-b069-cedf74095fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:23.882973 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb7cfe-32fa-479e-b069-cedf74095fe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:23.898855 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:23.900118 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:23.911596 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 240/500] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:23.924921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb278865-7ec5-40ce-aed8-bf62fb03e044 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:23.924921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb278865-7ec5-40ce-aed8-bf62fb03e044 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:23.924921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb278865-7ec5-40ce-aed8-bf62fb03e044 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:23.924921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 241/501] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:23.924921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb278865-7ec5-40ce-aed8-bf62fb03e044 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:23.964012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb7cfe-32fa-479e-b069-cedf74095fe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:23.965515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb7cfe-32fa-479e-b069-cedf74095fe8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:24.039493 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb278865-7ec5-40ce-aed8-bf62fb03e044 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:24.084994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7379ce-bcee-43c4-9e6d-7253cdd8cc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:24.085699 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7379ce-bcee-43c4-9e6d-7253cdd8cc93 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:24.086066 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7379ce-bcee-43c4-9e6d-7253cdd8cc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:24.086350 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7379ce-bcee-43c4-9e6d-7253cdd8cc93 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:24.087075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7379ce-bcee-43c4-9e6d-7253cdd8cc93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:24.087383 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7379ce-bcee-43c4-9e6d-7253cdd8cc93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:24.088786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7379ce-bcee-43c4-9e6d-7253cdd8cc93 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:24.095164 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 261/502] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:29:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:24.095836 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb7cfe-32fa-479e-b069-cedf74095fe8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:24.102840 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 242/503] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:24.104254 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52822a55-dbce-4642-8c69-e6046458b37d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:24.104620 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52822a55-dbce-4642-8c69-e6046458b37d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:24.104909 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52822a55-dbce-4642-8c69-e6046458b37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:24.125749 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-52822a55-dbce-4642-8c69-e6046458b37d None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:24.127135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-52822a55-dbce-4642-8c69-e6046458b37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:24.164147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:24.186096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:24.221287 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 243/504] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:24.221287 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52822a55-dbce-4642-8c69-e6046458b37d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:24.234563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb7cfe-32fa-479e-b069-cedf74095fe8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:24.273413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc02bcc-9d05-4993-bae4-cdaf1c1b36a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:24.274337 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc02bcc-9d05-4993-bae4-cdaf1c1b36a2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:24.274623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc02bcc-9d05-4993-bae4-cdaf1c1b36a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:24.274897 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc02bcc-9d05-4993-bae4-cdaf1c1b36a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:24.275626 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc02bcc-9d05-4993-bae4-cdaf1c1b36a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:24.275929 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc02bcc-9d05-4993-bae4-cdaf1c1b36a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:24.277324 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc02bcc-9d05-4993-bae4-cdaf1c1b36a2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:24.291063 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 262/505] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:24.291897 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc02bcc-9d05-4993-bae4-cdaf1c1b36a2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:24.333501 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52822a55-dbce-4642-8c69-e6046458b37d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:24.376413 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5450e-5416-4372-9494-58e6593871de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:24.377455 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5450e-5416-4372-9494-58e6593871de None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:24.377770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5450e-5416-4372-9494-58e6593871de None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:24.378068 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5450e-5416-4372-9494-58e6593871de None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:24.391682 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5450e-5416-4372-9494-58e6593871de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:24.399899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-57c5450e-5416-4372-9494-58e6593871de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:24.399899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:24.399899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:24.399899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:24.399899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:24.399899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:24.399899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:24.399899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:24.399899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:24.399899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:24.399899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:24.399899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:24.399899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:24.399899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:24.399899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:24.399899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:24.402106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:24.402106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:24.402106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:24.402106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:24.402106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:24.402106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:24.402106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:24.402106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:24.402106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:24.402106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:24.402106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:24.402106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:24.402106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:24.402106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:24.402106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:24.402106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:24.403912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:24.403912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:24.403912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:24.403912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:24.403912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:24.403912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:24.403912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:24.403912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:24.403912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:24.403912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:24.403912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:24.403912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:24.403912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 244/506] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:29:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:24.403912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5450e-5416-4372-9494-58e6593871de None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:24.411484 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc02bcc-9d05-4993-bae4-cdaf1c1b36a2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:24.420004 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:24.454569 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05a29d-8872-4b10-b21b-f6fbc8eeb5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:24.455536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05a29d-8872-4b10-b21b-f6fbc8eeb5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:24.455818 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05a29d-8872-4b10-b21b-f6fbc8eeb5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:24.456092 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05a29d-8872-4b10-b21b-f6fbc8eeb5b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:24.467637 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05a29d-8872-4b10-b21b-f6fbc8eeb5b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:24.468121 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:24.469244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05a29d-8872-4b10-b21b-f6fbc8eeb5b3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:24.489341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6c05a29d-8872-4b10-b21b-f6fbc8eeb5b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:24.489341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:24.489341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:24.489341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:24.489341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:24.489341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:24.489341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:24.489341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:24.489341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:24.489341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:24.489341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:24.489341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:24.489341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:24.489341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:24.489341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:24.491079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:24.491079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:24.491079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:24.491079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:24.491079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:24.491079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:24.491079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:24.491079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:24.491079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:24.491079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:24.491079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:24.491079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:24.491079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:24.491079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:24.491079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:24.491079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:24.491079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:24.491938 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:24.491938 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:24.491938 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:24.491938 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:24.491938 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 263/507] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:24.491938 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05a29d-8872-4b10-b21b-f6fbc8eeb5b3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:24.538140 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5450e-5416-4372-9494-58e6593871de None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:24.572991 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf84a4-c263-49d4-8fd6-2fbbc8eb6045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:24.573834 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf84a4-c263-49d4-8fd6-2fbbc8eb6045 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:24.574112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf84a4-c263-49d4-8fd6-2fbbc8eb6045 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:24.574392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf84a4-c263-49d4-8fd6-2fbbc8eb6045 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:24.582632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf84a4-c263-49d4-8fd6-2fbbc8eb6045 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:24.584310 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf84a4-c263-49d4-8fd6-2fbbc8eb6045 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:24.602070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-09bf84a4-c263-49d4-8fd6-2fbbc8eb6045 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 16:29:24.602070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:24.602070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:24.602070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:24.602070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:24.602070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:24.602070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:24.602070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:24.602070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:24.602070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:24.602070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:24.602070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:24.602070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:24.602070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:24.602070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:24.602070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:24.603000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:24.603000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:24.603000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:24.603000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:24.603000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:24.603000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:24.603000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:24.603000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:24.603000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:24.603000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:24.603000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:24.603000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:24.603000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:24.603000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:24.603000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:24.603000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:24.603000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:24.603000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:24.604237 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:24.604237 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:24.604237 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:24.604237 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:24.604237 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:24.604237 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:24.604237 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:24.604237 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:24.604237 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 16:29:24.604237 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:24.604237 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 245/508] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:29:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:24.604237 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf84a4-c263-49d4-8fd6-2fbbc8eb6045 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:24.615773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05a29d-8872-4b10-b21b-f6fbc8eeb5b3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:24.655233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e96868-66e5-4a00-87e8-6fb6f61f5b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:24.656189 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e96868-66e5-4a00-87e8-6fb6f61f5b19 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:24.656598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e96868-66e5-4a00-87e8-6fb6f61f5b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:24.656930 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e96868-66e5-4a00-87e8-6fb6f61f5b19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:24.669531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e96868-66e5-4a00-87e8-6fb6f61f5b19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:24.671093 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e96868-66e5-4a00-87e8-6fb6f61f5b19 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:24.689433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-72e96868-66e5-4a00-87e8-6fb6f61f5b19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:24.689433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:24.689433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:24.689433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:24.689433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:24.689433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:24.689433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:24.689433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:24.689433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:24.689433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:24.689433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:24.689433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:24.689433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:24.689433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:24.689433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:24.690344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:24.690344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:24.690344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:24.690344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:24.690344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:24.690344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:24.690344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:24.690344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:24.690344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:24.690344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:24.690344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:24.690344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:24.690344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:24.690344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:24.690344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:24.690344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:24.690344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:24.691171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:24.691171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:24.691171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:24.691171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:24.691171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 264/509] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:24.691491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e96868-66e5-4a00-87e8-6fb6f61f5b19 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:24.712044 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:24.720263 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf84a4-c263-49d4-8fd6-2fbbc8eb6045 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:24.722568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:24.755676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2a03a-b523-488d-a460-b9f37c05e577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:24.756051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2a03a-b523-488d-a460-b9f37c05e577 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:24.756334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2a03a-b523-488d-a460-b9f37c05e577 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:24.756604 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2a03a-b523-488d-a460-b9f37c05e577 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:24.767100 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2a03a-b523-488d-a460-b9f37c05e577 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:24.770149 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2a03a-b523-488d-a460-b9f37c05e577 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:24.790792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-a7a2a03a-b523-488d-a460-b9f37c05e577 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:29:24.790792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:24.790792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:24.790792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:24.790792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:24.790792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:24.790792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:24.790792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:24.790792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:24.790792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:24.790792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:24.790792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:24.790792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:24.790792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:24.790792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:24.790792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:24.792882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:24.792882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:24.792882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:24.792882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:24.792882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:24.792882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:24.792882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:24.792882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:24.792882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:24.792882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:24.792882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:24.792882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:24.792882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:24.792882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:24.792882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:24.792882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:24.792882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:24.792882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:24.794607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:24.794607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:24.794607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:24.794607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:24.794607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:24.794607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:24.794607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:24.794607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:24.794607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:29:24.794607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:24.794607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 246/510] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:29:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:24.794607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2a03a-b523-488d-a460-b9f37c05e577 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:24.834532 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e96868-66e5-4a00-87e8-6fb6f61f5b19 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:24.874977 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd0130-c4cc-4572-8382-908b23bdfd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:24.875632 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd0130-c4cc-4572-8382-908b23bdfd68 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:24.875918 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd0130-c4cc-4572-8382-908b23bdfd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:24.876190 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd0130-c4cc-4572-8382-908b23bdfd68 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:24.876938 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd0130-c4cc-4572-8382-908b23bdfd68 None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:24.877801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd0130-c4cc-4572-8382-908b23bdfd68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:24.879237 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd0130-c4cc-4572-8382-908b23bdfd68 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:24.887819 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 265/511] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 16:29:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:24.888651 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd0130-c4cc-4572-8382-908b23bdfd68 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:24.924835 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2a03a-b523-488d-a460-b9f37c05e577 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:24.961151 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866dff25-8a10-44cf-9336-e7c1508c6fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:24.961854 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866dff25-8a10-44cf-9336-e7c1508c6fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:24.962137 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866dff25-8a10-44cf-9336-e7c1508c6fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:24.962425 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866dff25-8a10-44cf-9336-e7c1508c6fd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:24.963149 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866dff25-8a10-44cf-9336-e7c1508c6fd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:24.963456 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866dff25-8a10-44cf-9336-e7c1508c6fd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:24.964844 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866dff25-8a10-44cf-9336-e7c1508c6fd2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:24.966511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:24.978159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 247/512] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:24.981464 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866dff25-8a10-44cf-9336-e7c1508c6fd2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:24.999116 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd0130-c4cc-4572-8382-908b23bdfd68 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:25.008002 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:25.035261 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f08363-a842-4bb0-921c-8c3486daa3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:25.035938 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f08363-a842-4bb0-921c-8c3486daa3fc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:25.036316 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f08363-a842-4bb0-921c-8c3486daa3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:25.036597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f08363-a842-4bb0-921c-8c3486daa3fc None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:25.037490 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f08363-a842-4bb0-921c-8c3486daa3fc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:25.037813 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f08363-a842-4bb0-921c-8c3486daa3fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:25.039262 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f08363-a842-4bb0-921c-8c3486daa3fc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:25.077472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 266/513] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 26 16:29:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:25.078334 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f08363-a842-4bb0-921c-8c3486daa3fc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:25.090872 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866dff25-8a10-44cf-9336-e7c1508c6fd2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:25.129805 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1613c1-06a5-45b4-bc5c-9a903962c017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:25.130840 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1613c1-06a5-45b4-bc5c-9a903962c017 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:25.131579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1613c1-06a5-45b4-bc5c-9a903962c017 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:25.132000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1613c1-06a5-45b4-bc5c-9a903962c017 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:25.133199 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1613c1-06a5-45b4-bc5c-9a903962c017 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:25.133506 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1613c1-06a5-45b4-bc5c-9a903962c017 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:25.134930 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1613c1-06a5-45b4-bc5c-9a903962c017 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:25.146578 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 248/514] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:25.147381 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1613c1-06a5-45b4-bc5c-9a903962c017 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:25.197227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f08363-a842-4bb0-921c-8c3486daa3fc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:25.230696 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:25.237402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027d04c-840f-45e8-9b99-53581db8a5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:25.238087 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027d04c-840f-45e8-9b99-53581db8a5ea None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:25.238373 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027d04c-840f-45e8-9b99-53581db8a5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:25.238653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027d04c-840f-45e8-9b99-53581db8a5ea None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:25.239501 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027d04c-840f-45e8-9b99-53581db8a5ea None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:25.239867 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027d04c-840f-45e8-9b99-53581db8a5ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:25.241468 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027d04c-840f-45e8-9b99-53581db8a5ea None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:25.248588 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:25.259381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 267/515] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 26 16:29:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:25.260223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027d04c-840f-45e8-9b99-53581db8a5ea None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:25.267033 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1613c1-06a5-45b4-bc5c-9a903962c017 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:25.303030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5732c1d-fc15-4090-b6e6-b17c7bdca941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:25.303821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5732c1d-fc15-4090-b6e6-b17c7bdca941 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:25.304106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5732c1d-fc15-4090-b6e6-b17c7bdca941 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:25.304377 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5732c1d-fc15-4090-b6e6-b17c7bdca941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:25.314754 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5732c1d-fc15-4090-b6e6-b17c7bdca941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:25.316253 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5732c1d-fc15-4090-b6e6-b17c7bdca941 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:25.334993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-e5732c1d-fc15-4090-b6e6-b17c7bdca941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:25.334993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:25.334993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:25.334993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:25.334993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:25.334993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:25.334993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:25.334993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:25.334993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:25.334993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:25.334993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:25.334993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:25.334993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:25.334993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:25.334993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:25.336075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:25.336075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:25.336075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:25.336075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:25.336075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:25.336075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:25.336075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:25.336075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:25.336075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:25.336075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:25.336075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:25.336075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:25.336075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:25.336075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:25.336075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:25.336075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:25.336075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:25.336921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:25.336921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:25.336921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:25.336921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:25.336921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 249/516] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:25.337387 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5732c1d-fc15-4090-b6e6-b17c7bdca941 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:25.373332 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027d04c-840f-45e8-9b99-53581db8a5ea None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:25.408191 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645b1cf-9927-49a8-abf1-8a63503d986d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:25.409551 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645b1cf-9927-49a8-abf1-8a63503d986d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:25.409834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645b1cf-9927-49a8-abf1-8a63503d986d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:25.410105 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645b1cf-9927-49a8-abf1-8a63503d986d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:25.417274 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645b1cf-9927-49a8-abf1-8a63503d986d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:25.418751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645b1cf-9927-49a8-abf1-8a63503d986d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:25.433854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e645b1cf-9927-49a8-abf1-8a63503d986d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:25.433854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:25.433854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:25.433854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:25.433854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:25.433854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:25.433854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:25.433854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:25.433854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:25.433854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:25.433854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:25.433854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:25.433854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:25.433854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:25.433854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:25.435015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:25.435015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:25.435015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:25.435015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:25.435015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:25.435015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:25.435015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:25.435015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:25.435015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:25.435015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:25.435015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:25.435015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:25.435015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:25.435015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:25.435015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:25.435015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:25.435015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:25.436039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:25.436039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:25.436039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:25.436039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:25.436039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:25.436039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:25.436039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:25.436039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:25.436039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 268/517] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:25.436039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645b1cf-9927-49a8-abf1-8a63503d986d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:25.449912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5732c1d-fc15-4090-b6e6-b17c7bdca941 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:25.492120 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae895ce4-4728-4452-8d3c-a52c67857702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:25.492780 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae895ce4-4728-4452-8d3c-a52c67857702 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:25.493064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae895ce4-4728-4452-8d3c-a52c67857702 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:25.493370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae895ce4-4728-4452-8d3c-a52c67857702 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:25.495309 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:25.496315 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:25.566786 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645b1cf-9927-49a8-abf1-8a63503d986d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:25.591330 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae895ce4-4728-4452-8d3c-a52c67857702 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:25.593676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae895ce4-4728-4452-8d3c-a52c67857702 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:25.611315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f9648-2a2a-46e2-b917-d128b0f75dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:25.612123 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f9648-2a2a-46e2-b917-d128b0f75dd8 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:25.612529 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f9648-2a2a-46e2-b917-d128b0f75dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:25.612874 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f9648-2a2a-46e2-b917-d128b0f75dd8 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:25.613882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f9648-2a2a-46e2-b917-d128b0f75dd8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:25.615898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f9648-2a2a-46e2-b917-d128b0f75dd8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:25.704854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 269/518] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 16:29:25 2022] POST /identity/v3/users => generated 247 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:29:25.704854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f9648-2a2a-46e2-b917-d128b0f75dd8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:25.759033 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 250/519] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:29:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:25.759978 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae895ce4-4728-4452-8d3c-a52c67857702 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:25.808516 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:25.848718 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f9648-2a2a-46e2-b917-d128b0f75dd8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:25.855314 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:25.905494 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae895ce4-4728-4452-8d3c-a52c67857702 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:25.911404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3307e9-2d90-4dbe-96d8-41d8c7f861c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:25.912184 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3307e9-2d90-4dbe-96d8-41d8c7f861c6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:25.912334 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3307e9-2d90-4dbe-96d8-41d8c7f861c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:25.912610 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3307e9-2d90-4dbe-96d8-41d8c7f861c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:25.982197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8a695-35f9-49c3-b3db-78c7af4d4233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:25.982197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8a695-35f9-49c3-b3db-78c7af4d4233 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:25.982197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8a695-35f9-49c3-b3db-78c7af4d4233 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:25.982197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8a695-35f9-49c3-b3db-78c7af4d4233 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:25.983127 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8a695-35f9-49c3-b3db-78c7af4d4233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:25.983127 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8a695-35f9-49c3-b3db-78c7af4d4233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:25.983785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8a695-35f9-49c3-b3db-78c7af4d4233 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:26.003261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 251/520] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:26.003940 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8a695-35f9-49c3-b3db-78c7af4d4233 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:26.035927 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3307e9-2d90-4dbe-96d8-41d8c7f861c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:26.037472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3307e9-2d90-4dbe-96d8-41d8c7f861c6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:26.139948 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:26.149592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8a695-35f9-49c3-b3db-78c7af4d4233 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:26.170844 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 270/521] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:29:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:26.171826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3307e9-2d90-4dbe-96d8-41d8c7f861c6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:26.176456 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:26.189761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745692a-fe42-4660-b518-ccb16cf526ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:26.190388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745692a-fe42-4660-b518-ccb16cf526ee None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:26.190667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745692a-fe42-4660-b518-ccb16cf526ee None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:26.190957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745692a-fe42-4660-b518-ccb16cf526ee None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:26.191736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745692a-fe42-4660-b518-ccb16cf526ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:26.192036 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745692a-fe42-4660-b518-ccb16cf526ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:26.193864 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745692a-fe42-4660-b518-ccb16cf526ee None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:26.219104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 252/522] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:29:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:26.220547 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745692a-fe42-4660-b518-ccb16cf526ee None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:26.323027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3307e9-2d90-4dbe-96d8-41d8c7f861c6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:26.353412 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745692a-fe42-4660-b518-ccb16cf526ee None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:26.364684 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3a67a-2e84-4982-972a-fb9c4ea4ff15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:26.365647 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3a67a-2e84-4982-972a-fb9c4ea4ff15 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:26.365997 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3a67a-2e84-4982-972a-fb9c4ea4ff15 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:26.366427 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3a67a-2e84-4982-972a-fb9c4ea4ff15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:26.381720 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3a67a-2e84-4982-972a-fb9c4ea4ff15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:26.385901 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3a67a-2e84-4982-972a-fb9c4ea4ff15 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:26.404862 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e6fb5-b5e2-4b65-a1f3-37ec5a0a3fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:26.405769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e6fb5-b5e2-4b65-a1f3-37ec5a0a3fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:26.406065 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e6fb5-b5e2-4b65-a1f3-37ec5a0a3fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:26.406339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e6fb5-b5e2-4b65-a1f3-37ec5a0a3fd0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:26.411313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-43d3a67a-2e84-4982-972a-fb9c4ea4ff15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:26.411313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:26.411313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:26.411313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:26.411313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:26.411313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:26.411313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:26.411313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:26.411313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:26.411313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:26.411313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:26.411313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:26.411313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:26.411313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:26.411313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:26.412447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:26.412447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:26.412447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:26.412447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:26.412447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:26.412447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:26.412447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:26.412447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:26.412447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:26.412447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:26.412447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:26.412447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:26.412447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:26.412447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:26.412447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:26.412447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:26.412447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:26.418100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:26.418100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:26.418100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:26.418100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:26.418100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 271/523] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:26.418100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3a67a-2e84-4982-972a-fb9c4ea4ff15 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:26.420143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e6fb5-b5e2-4b65-a1f3-37ec5a0a3fd0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:26.421756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e6fb5-b5e2-4b65-a1f3-37ec5a0a3fd0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:26.437647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-2a2e6fb5-b5e2-4b65-a1f3-37ec5a0a3fd0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:29:26.437647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:26.437647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:26.437647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:26.437647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:26.437647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:26.437647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:26.437647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:26.437647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:26.437647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:26.437647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:26.437647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:26.437647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:26.437647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:26.437647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:26.437647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:26.438638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:26.438638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:26.438638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:26.438638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:26.438638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:26.438638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:26.438638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:26.438638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:26.438638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:26.438638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:26.438638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:26.438638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:26.438638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:26.438638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:26.438638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:26.438638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:26.438638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:26.438638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:26.440116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:26.440116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:26.440116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:26.440116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:26.440116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:26.440116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:26.440116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:26.440116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:26.440116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:29:26.440116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:26.440116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 253/524] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:29:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:26.440687 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e6fb5-b5e2-4b65-a1f3-37ec5a0a3fd0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:26.465201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:26.508624 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:26.564062 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e6fb5-b5e2-4b65-a1f3-37ec5a0a3fd0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:26.583051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3a67a-2e84-4982-972a-fb9c4ea4ff15 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:26.618769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea103a9-4b31-4ff6-944b-065019edf99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:26.619439 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea103a9-4b31-4ff6-944b-065019edf99e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:26.619724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea103a9-4b31-4ff6-944b-065019edf99e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:26.619998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea103a9-4b31-4ff6-944b-065019edf99e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:26.620849 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea103a9-4b31-4ff6-944b-065019edf99e None admin] RBAC: Adding query filter params (role.id=d39d16b5286d4e1db63841f4917e08f2, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=35c9fa9c29494ff9b1f749974dca2719) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:26.621141 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea103a9-4b31-4ff6-944b-065019edf99e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:26.622639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea103a9-4b31-4ff6-944b-065019edf99e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:26.624488 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c495250-21ff-46e1-8c4e-eb45e1278564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:26.625743 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c495250-21ff-46e1-8c4e-eb45e1278564 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:26.626258 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c495250-21ff-46e1-8c4e-eb45e1278564 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:26.627258 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c495250-21ff-46e1-8c4e-eb45e1278564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:26.629902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 254/525] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:29:26 2022] GET /identity/v3/role_assignments?user.id=35c9fa9c29494ff9b1f749974dca2719&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=d39d16b5286d4e1db63841f4917e08f2 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:26.630795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea103a9-4b31-4ff6-944b-065019edf99e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:26.649670 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c495250-21ff-46e1-8c4e-eb45e1278564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:26.651660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c495250-21ff-46e1-8c4e-eb45e1278564 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:26.681840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-2c495250-21ff-46e1-8c4e-eb45e1278564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:26.681840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:26.681840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:26.681840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:26.681840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:26.681840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:26.681840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:26.681840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:26.681840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:26.681840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:26.681840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:26.681840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:26.681840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:26.681840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:26.681840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:26.682789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:26.682789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:26.682789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:26.682789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:26.682789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:26.682789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:26.682789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:26.682789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:26.682789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:26.682789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:26.682789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:26.682789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:26.682789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:26.682789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:26.682789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:26.682789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:26.682789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:26.683887 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:26.683887 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:26.683887 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:26.683887 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:26.683887 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 272/526] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:26.684911 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c495250-21ff-46e1-8c4e-eb45e1278564 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:26.751034 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:26.783582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea103a9-4b31-4ff6-944b-065019edf99e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:26.835745 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c495250-21ff-46e1-8c4e-eb45e1278564 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:26.838028 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa989d60-ff33-4e58-9b1e-999d2fff91ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:26.839794 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa989d60-ff33-4e58-9b1e-999d2fff91ca None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:26.840076 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa989d60-ff33-4e58-9b1e-999d2fff91ca None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:26.840352 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa989d60-ff33-4e58-9b1e-999d2fff91ca None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:26.841097 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa989d60-ff33-4e58-9b1e-999d2fff91ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:26.841539 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa989d60-ff33-4e58-9b1e-999d2fff91ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:26.843070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa989d60-ff33-4e58-9b1e-999d2fff91ca None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:26.850108 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:26.872690 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 255/527] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:26.874770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa989d60-ff33-4e58-9b1e-999d2fff91ca None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:26.887300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cfe1c-c3b6-438d-8112-9f7e2713227b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:26.887997 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cfe1c-c3b6-438d-8112-9f7e2713227b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:26.888283 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cfe1c-c3b6-438d-8112-9f7e2713227b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:26.888558 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cfe1c-c3b6-438d-8112-9f7e2713227b None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:26.889466 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cfe1c-c3b6-438d-8112-9f7e2713227b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:26.890071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cfe1c-c3b6-438d-8112-9f7e2713227b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:26.893957 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cfe1c-c3b6-438d-8112-9f7e2713227b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:26.918077 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 273/528] 10.222.0.48 () {56 vars in 1139 bytes} [Thu May 26 16:29:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:26.923876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cfe1c-c3b6-438d-8112-9f7e2713227b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:27.014650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa989d60-ff33-4e58-9b1e-999d2fff91ca None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:27.064242 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5956e3c-2dd2-4c5d-a530-5ce204a3f64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:27.065234 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5956e3c-2dd2-4c5d-a530-5ce204a3f64a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:27.066222 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5956e3c-2dd2-4c5d-a530-5ce204a3f64a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:27.066501 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5956e3c-2dd2-4c5d-a530-5ce204a3f64a None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:27.068035 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5956e3c-2dd2-4c5d-a530-5ce204a3f64a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:27.068373 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5956e3c-2dd2-4c5d-a530-5ce204a3f64a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:27.072802 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5956e3c-2dd2-4c5d-a530-5ce204a3f64a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:27.074179 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cfe1c-c3b6-438d-8112-9f7e2713227b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:27.083626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:27.098791 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 256/529] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:27.098791 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5956e3c-2dd2-4c5d-a530-5ce204a3f64a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:27.131032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238633d4-08fc-4b04-9722-78d8c79e9bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:27.132402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238633d4-08fc-4b04-9722-78d8c79e9bdb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:27.132868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238633d4-08fc-4b04-9722-78d8c79e9bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:27.133598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238633d4-08fc-4b04-9722-78d8c79e9bdb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:27.145487 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238633d4-08fc-4b04-9722-78d8c79e9bdb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:27.147332 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238633d4-08fc-4b04-9722-78d8c79e9bdb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:27.168100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-238633d4-08fc-4b04-9722-78d8c79e9bdb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:27.168100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:27.168100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:27.168100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:27.168100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:27.168100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:27.168100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:27.168100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:27.168100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:27.168100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:27.168100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:27.168100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:27.168100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:27.168100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:27.168100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:27.169213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:27.169213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:27.169213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:27.169213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:27.169213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:27.169213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:27.169213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:27.169213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:27.169213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:27.169213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:27.169213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:27.169213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:27.169213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:27.169213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:27.169213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:27.169213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:27.169213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:27.170290 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:27.170290 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:27.170290 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:27.170290 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:27.170290 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:27.170290 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:27.170290 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:27.170290 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:27.177976 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 274/530] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:27.180167 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238633d4-08fc-4b04-9722-78d8c79e9bdb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:27.231867 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:27.245049 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5956e3c-2dd2-4c5d-a530-5ce204a3f64a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:27.300649 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e066ac-a081-48f3-bca9-6be32d92c389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:27.301735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e066ac-a081-48f3-bca9-6be32d92c389 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:27.302518 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e066ac-a081-48f3-bca9-6be32d92c389 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:27.302987 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e066ac-a081-48f3-bca9-6be32d92c389 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:27.333906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238633d4-08fc-4b04-9722-78d8c79e9bdb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:27.374987 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d20edc-1306-4179-be7a-7821f9aee7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:27.376247 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d20edc-1306-4179-be7a-7821f9aee7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:27.376742 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d20edc-1306-4179-be7a-7821f9aee7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:27.377821 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d20edc-1306-4179-be7a-7821f9aee7e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:27.387954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d20edc-1306-4179-be7a-7821f9aee7e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:27.389469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d20edc-1306-4179-be7a-7821f9aee7e1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:27.404455 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:27.407691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e1d20edc-1306-4179-be7a-7821f9aee7e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:27.407691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:27.407691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:27.407691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:27.407691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:27.407691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:27.407691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:27.407691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:27.407691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:27.407691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:27.407691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:27.407691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:27.407691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:27.407691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:27.407691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:27.408597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:27.408597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:27.408597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:27.408597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:27.408597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:27.408597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:27.408597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:27.408597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:27.408597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:27.408597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:27.408597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:27.408597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:27.408597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:27.408597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:27.408597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:27.408597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:27.408597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:27.409471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:27.409471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:27.409471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:27.409471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:27.409471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:27.409471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:27.409471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:27.409471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:27.413152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e066ac-a081-48f3-bca9-6be32d92c389 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:27.414352 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 275/531] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:27.415317 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d20edc-1306-4179-be7a-7821f9aee7e1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:27.416159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e066ac-a081-48f3-bca9-6be32d92c389 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:27.542399 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 257/532] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:29:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:27.542921 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:27.543411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e066ac-a081-48f3-bca9-6be32d92c389 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:27.568467 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d20edc-1306-4179-be7a-7821f9aee7e1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:27.617737 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a15349-8bc8-445c-be05-73e2de45dc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:27.618874 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a15349-8bc8-445c-be05-73e2de45dc06 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:27.619475 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a15349-8bc8-445c-be05-73e2de45dc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:27.619990 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a15349-8bc8-445c-be05-73e2de45dc06 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:27.621081 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a15349-8bc8-445c-be05-73e2de45dc06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:27.621613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a15349-8bc8-445c-be05-73e2de45dc06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:27.623831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a15349-8bc8-445c-be05-73e2de45dc06 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:27.647614 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 276/533] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:29:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:27.649014 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a15349-8bc8-445c-be05-73e2de45dc06 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:27.655053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:27.660709 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e066ac-a081-48f3-bca9-6be32d92c389 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:27.704460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ce096-24ce-489e-a96a-ba26a2fc50e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:27.705143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ce096-24ce-489e-a96a-ba26a2fc50e7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:27.705495 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ce096-24ce-489e-a96a-ba26a2fc50e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:27.705771 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ce096-24ce-489e-a96a-ba26a2fc50e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:27.706597 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ce096-24ce-489e-a96a-ba26a2fc50e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:27.707535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ce096-24ce-489e-a96a-ba26a2fc50e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:27.708381 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ce096-24ce-489e-a96a-ba26a2fc50e7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:27.722186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 258/534] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:29:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:27.723069 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ce096-24ce-489e-a96a-ba26a2fc50e7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:27.797840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a15349-8bc8-445c-be05-73e2de45dc06 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:27.838850 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ce096-24ce-489e-a96a-ba26a2fc50e7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:27.856811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3033d7-b243-486d-82b5-fcbdc161e378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:27.858565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3033d7-b243-486d-82b5-fcbdc161e378 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:27.859284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3033d7-b243-486d-82b5-fcbdc161e378 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:27.859950 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3033d7-b243-486d-82b5-fcbdc161e378 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:27.877022 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fda1a6-8e5f-4e3d-9d86-fce6db43791a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:27.878361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fda1a6-8e5f-4e3d-9d86-fce6db43791a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:27.878648 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fda1a6-8e5f-4e3d-9d86-fce6db43791a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:27.878972 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fda1a6-8e5f-4e3d-9d86-fce6db43791a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:27.879817 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fda1a6-8e5f-4e3d-9d86-fce6db43791a None admin] RBAC: Adding query filter params (role.id=d39d16b5286d4e1db63841f4917e08f2, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=7701907eb3b24c3681352c91ad6a3aeb) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:27.880121 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fda1a6-8e5f-4e3d-9d86-fce6db43791a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:27.881761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fda1a6-8e5f-4e3d-9d86-fce6db43791a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:27.882234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3033d7-b243-486d-82b5-fcbdc161e378 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:27.884910 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3033d7-b243-486d-82b5-fcbdc161e378 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:27.889312 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 259/535] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:29:27 2022] GET /identity/v3/role_assignments?user.id=7701907eb3b24c3681352c91ad6a3aeb&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=d39d16b5286d4e1db63841f4917e08f2 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:27.890301 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fda1a6-8e5f-4e3d-9d86-fce6db43791a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:27.899062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:27.920307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-9d3033d7-b243-486d-82b5-fcbdc161e378 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:27.920307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:27.920307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:27.920307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:27.920307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:27.920307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:27.920307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:27.920307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:27.920307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:27.920307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:27.920307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:27.920307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:27.920307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:27.920307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:27.920307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:27.922701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:27.922701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:27.922701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:27.922701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:27.922701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:27.922701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:27.922701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:27.922701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:27.922701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:27.922701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:27.922701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:27.922701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:27.922701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:27.922701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:27.922701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:27.922701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:27.922701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:27.924715 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:27.924715 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:27.924715 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:27.924715 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:27.927553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:27.929697 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 277/536] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:27.936532 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3033d7-b243-486d-82b5-fcbdc161e378 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:28.029966 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fda1a6-8e5f-4e3d-9d86-fce6db43791a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:28.085597 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52194c-c26f-4512-be04-576acc1cf4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:28.086421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52194c-c26f-4512-be04-576acc1cf4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:28.086915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52194c-c26f-4512-be04-576acc1cf4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:28.087333 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52194c-c26f-4512-be04-576acc1cf4f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:28.088265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52194c-c26f-4512-be04-576acc1cf4f7 None admin] RBAC: Adding query filter params (role.id=d39d16b5286d4e1db63841f4917e08f2, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=8be9c9fb92c049c18a54b25725a34a74) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:28.088584 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52194c-c26f-4512-be04-576acc1cf4f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:28.090403 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52194c-c26f-4512-be04-576acc1cf4f7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:28.098137 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 260/537] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:29:27 2022] GET /identity/v3/role_assignments?user.id=8be9c9fb92c049c18a54b25725a34a74&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=d39d16b5286d4e1db63841f4917e08f2 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:28.197568 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3033d7-b243-486d-82b5-fcbdc161e378 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:28.227240 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066c985-6b6e-457c-8c85-93619e91349b None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:28.227531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066c985-6b6e-457c-8c85-93619e91349b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:28.227817 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066c985-6b6e-457c-8c85-93619e91349b None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:28.229759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 261/538] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:29:28.235758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2580184-d1b8-47d8-9038-a0e09c2e8d3b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:28.236037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2580184-d1b8-47d8-9038-a0e09c2e8d3b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:28.236319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2580184-d1b8-47d8-9038-a0e09c2e8d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:28.255053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c2580184-d1b8-47d8-9038-a0e09c2e8d3b None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:28.256762 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c2580184-d1b8-47d8-9038-a0e09c2e8d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:28.266777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba61de-be06-4520-a0ff-cdf534500d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:28.268318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba61de-be06-4520-a0ff-cdf534500d12 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:28.268758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba61de-be06-4520-a0ff-cdf534500d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:28.269174 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba61de-be06-4520-a0ff-cdf534500d12 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:28.270083 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba61de-be06-4520-a0ff-cdf534500d12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:28.270545 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba61de-be06-4520-a0ff-cdf534500d12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:28.272136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba61de-be06-4520-a0ff-cdf534500d12 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:28.288420 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 278/539] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:28.295510 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba61de-be06-4520-a0ff-cdf534500d12 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:28.352130 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 262/540] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:29:28.374524 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:28.404712 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2580184-d1b8-47d8-9038-a0e09c2e8d3b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:28.434619 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:28.452143 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba61de-be06-4520-a0ff-cdf534500d12 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:28.528189 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b42dbf-f8ad-4e95-9897-afd2d1f5f16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:28.529190 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b42dbf-f8ad-4e95-9897-afd2d1f5f16c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:28.529525 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b42dbf-f8ad-4e95-9897-afd2d1f5f16c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:28.529803 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b42dbf-f8ad-4e95-9897-afd2d1f5f16c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:28.544336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b42dbf-f8ad-4e95-9897-afd2d1f5f16c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:28.545856 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b42dbf-f8ad-4e95-9897-afd2d1f5f16c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:28.576603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-c6b42dbf-f8ad-4e95-9897-afd2d1f5f16c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:28.576603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:28.576603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:28.576603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:28.576603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:28.576603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:28.576603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:28.576603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:28.576603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:28.576603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:28.576603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:28.576603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:28.576603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:28.576603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:28.576603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:28.577576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:28.577576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:28.577576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:28.577576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:28.577576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:28.577576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:28.577576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:28.577576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:28.577576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:28.577576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:28.577576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:28.577576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:28.577576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:28.577576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:28.577576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:28.577576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:28.577576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:28.578413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:28.578413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:28.578413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:28.578413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:28.578413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:28.578413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:28.578413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:28.578413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:28.578413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 279/541] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:28.584993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b42dbf-f8ad-4e95-9897-afd2d1f5f16c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:28.635354 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2580184-d1b8-47d8-9038-a0e09c2e8d3b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:28.706977 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33617c-6cb3-4536-9291-892a604f9407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:28.708062 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33617c-6cb3-4536-9291-892a604f9407 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:28.708486 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33617c-6cb3-4536-9291-892a604f9407 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:28.708885 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33617c-6cb3-4536-9291-892a604f9407 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:28.740907 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33617c-6cb3-4536-9291-892a604f9407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:28.762433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b42dbf-f8ad-4e95-9897-afd2d1f5f16c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:28.768905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-cc33617c-6cb3-4536-9291-892a604f9407 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:28.768905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:28.768905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:28.768905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:28.768905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:28.768905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:28.768905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:28.768905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:28.768905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:28.768905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:28.768905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:28.768905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:28.768905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:28.768905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:28.768905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:28.768905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:28.771135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:28.771135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:28.771135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:28.771135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:28.771135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:28.771135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:28.771135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:28.771135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:28.771135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:28.771135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:28.771135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:28.771135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:28.771135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:28.771135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:28.771135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:28.771135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:28.773093 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:28.773093 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:28.773093 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:28.773093 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:28.773093 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:28.773093 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:28.773093 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:28.773093 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:28.773093 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:28.773093 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:28.773093 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:28.773093 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:28.773093 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 263/542] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:29:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:28.779558 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33617c-6cb3-4536-9291-892a604f9407 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:28.806170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:28.838567 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aaca3a-20eb-4b39-9798-355051f23b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:28.839296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aaca3a-20eb-4b39-9798-355051f23b66 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:28.839610 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aaca3a-20eb-4b39-9798-355051f23b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:28.839916 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aaca3a-20eb-4b39-9798-355051f23b66 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:28.840948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aaca3a-20eb-4b39-9798-355051f23b66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:28.841310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aaca3a-20eb-4b39-9798-355051f23b66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:28.843093 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aaca3a-20eb-4b39-9798-355051f23b66 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:28.868332 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 280/543] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:29:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:28.869461 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aaca3a-20eb-4b39-9798-355051f23b66 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:28.925320 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:28.957356 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33617c-6cb3-4536-9291-892a604f9407 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:29.039149 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5b0cd-e4e1-452c-b9be-98f1e44d3496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:29.039921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5b0cd-e4e1-452c-b9be-98f1e44d3496 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:29.040194 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5b0cd-e4e1-452c-b9be-98f1e44d3496 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:29.040635 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5b0cd-e4e1-452c-b9be-98f1e44d3496 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:29.041958 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5b0cd-e4e1-452c-b9be-98f1e44d3496 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:29.042492 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5b0cd-e4e1-452c-b9be-98f1e44d3496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:29.043965 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5b0cd-e4e1-452c-b9be-98f1e44d3496 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:29.064866 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 264/544] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 16:29:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:29.071708 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5b0cd-e4e1-452c-b9be-98f1e44d3496 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:29.108469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aaca3a-20eb-4b39-9798-355051f23b66 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:29.188686 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620b70b-af88-4d5c-bbee-41a6bdb9a51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:29.189399 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620b70b-af88-4d5c-bbee-41a6bdb9a51f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:29.190298 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620b70b-af88-4d5c-bbee-41a6bdb9a51f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:29.190571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620b70b-af88-4d5c-bbee-41a6bdb9a51f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:29.191509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620b70b-af88-4d5c-bbee-41a6bdb9a51f None admin] RBAC: Adding query filter params (role.id=d39d16b5286d4e1db63841f4917e08f2, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=d577b5295f9e4a4388bb6293d1c33d0b) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:29.191847 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620b70b-af88-4d5c-bbee-41a6bdb9a51f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:29.193427 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620b70b-af88-4d5c-bbee-41a6bdb9a51f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:29.213534 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 281/545] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:29:28 2022] GET /identity/v3/role_assignments?user.id=d577b5295f9e4a4388bb6293d1c33d0b&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=d39d16b5286d4e1db63841f4917e08f2 => generated 259 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:29.277961 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5b0cd-e4e1-452c-b9be-98f1e44d3496 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:29.338189 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de26832-a646-4490-8a75-ee6b54131f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:29.339185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de26832-a646-4490-8a75-ee6b54131f00 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:29.339469 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de26832-a646-4490-8a75-ee6b54131f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:29.339722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de26832-a646-4490-8a75-ee6b54131f00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:29.350334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:29.358638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de26832-a646-4490-8a75-ee6b54131f00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:29.360417 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de26832-a646-4490-8a75-ee6b54131f00 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:29.381573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-2de26832-a646-4490-8a75-ee6b54131f00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:29.381573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:29.381573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:29.381573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:29.381573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:29.381573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:29.381573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:29.381573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:29.381573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:29.381573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:29.381573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:29.381573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:29.381573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:29.381573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:29.381573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:29.382487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:29.382487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:29.382487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:29.382487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:29.382487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:29.382487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:29.382487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:29.382487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:29.382487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:29.382487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:29.382487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:29.382487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:29.382487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:29.382487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:29.382487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:29.382487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:29.382487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:29.384054 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:29.384054 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:29.384054 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:29.384054 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:29.388000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 265/546] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:29.389586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620b70b-af88-4d5c-bbee-41a6bdb9a51f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:29.479765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:29.565658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620b70b-af88-4d5c-bbee-41a6bdb9a51f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:29.613150 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d0391-b2ff-4463-ba2f-281bf22f2e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:29.614158 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d0391-b2ff-4463-ba2f-281bf22f2e5b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:29.614585 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d0391-b2ff-4463-ba2f-281bf22f2e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:29.615038 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d0391-b2ff-4463-ba2f-281bf22f2e5b None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:29.615911 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d0391-b2ff-4463-ba2f-281bf22f2e5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:29.616361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d0391-b2ff-4463-ba2f-281bf22f2e5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:29.618428 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d0391-b2ff-4463-ba2f-281bf22f2e5b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:29.636720 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 282/547] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:29.638910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de26832-a646-4490-8a75-ee6b54131f00 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:29.779842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1122ff-26bf-4bf5-a8e6-5ac1bf468a4f None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:29.780639 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1122ff-26bf-4bf5-a8e6-5ac1bf468a4f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:29.781112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1122ff-26bf-4bf5-a8e6-5ac1bf468a4f None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:29.784998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 283/548] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:29.790137 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebf652-c640-4fec-9b44-66c6540e8cb6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:29.790785 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebf652-c640-4fec-9b44-66c6540e8cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:29.791275 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebf652-c640-4fec-9b44-66c6540e8cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:29.811225 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9bebf652-c640-4fec-9b44-66c6540e8cb6 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:29.812815 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9bebf652-c640-4fec-9b44-66c6540e8cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:29.823208 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de26832-a646-4490-8a75-ee6b54131f00 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:29.910858 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33087f7f-d858-4871-8158-b14865bcee17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:29.912467 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33087f7f-d858-4871-8158-b14865bcee17 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:29.912950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33087f7f-d858-4871-8158-b14865bcee17 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:29.913537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33087f7f-d858-4871-8158-b14865bcee17 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:29.929458 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 284/549] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:29:29.946267 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33087f7f-d858-4871-8158-b14865bcee17 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:29.948188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33087f7f-d858-4871-8158-b14865bcee17 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:29.970328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-33087f7f-d858-4871-8158-b14865bcee17 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:29:29.970328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:29.970328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:29.970328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:29.970328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:29.970328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:29.970328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:29.970328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:29.970328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:29.970328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:29.970328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:29.970328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:29.970328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:29.970328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:29.970328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:29.970328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:29.971839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:29.971839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:29.971839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:29.971839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:29.971839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:29.971839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:29.971839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:29.971839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:29.971839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:29.971839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:29.971839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:29.971839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:29.971839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:29.971839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:29.971839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:29.971839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:29.971839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:29.971839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:29.972881 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:29.972881 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:29.972881 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:29.972881 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:29.972881 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:29.972881 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:29.972881 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:29.972881 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:29.972881 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:29:29.972881 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:29.983349 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 266/550] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:29:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:29.985075 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebf652-c640-4fec-9b44-66c6540e8cb6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:29.995725 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33087f7f-d858-4871-8158-b14865bcee17 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:30.045595 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:30.122229 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:30.192750 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33087f7f-d858-4871-8158-b14865bcee17 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:30.240944 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebf652-c640-4fec-9b44-66c6540e8cb6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:30.242300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c16020-4c34-4764-b8d1-5e33f4ab2dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:30.243534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c16020-4c34-4764-b8d1-5e33f4ab2dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:30.244043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c16020-4c34-4764-b8d1-5e33f4ab2dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:30.244545 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c16020-4c34-4764-b8d1-5e33f4ab2dc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:30.268755 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c16020-4c34-4764-b8d1-5e33f4ab2dc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:30.285668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-f2c16020-4c34-4764-b8d1-5e33f4ab2dc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:30.285668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:30.285668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:30.285668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:30.285668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:30.285668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:30.285668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:30.285668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:30.285668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:30.285668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:30.285668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:30.285668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:30.285668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:30.285668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:30.285668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:30.285668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:30.286667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:30.286667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:30.286667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:30.286667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:30.286667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:30.286667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:30.286667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:30.286667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:30.286667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:30.286667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:30.286667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:30.286667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:30.286667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:30.286667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:30.286667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:30.286667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:30.287476 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:30.287476 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:30.287476 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:30.287476 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:30.287476 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:30.287476 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:30.287476 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:30.287476 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:30.287476 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:30.287476 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:30.287476 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:30.287476 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:30.296483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 267/551] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:29:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:30.305728 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c16020-4c34-4764-b8d1-5e33f4ab2dc6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:30.305915 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1a8a0-b603-4c49-af48-a8b294f2d51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:30.306610 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1a8a0-b603-4c49-af48-a8b294f2d51f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:30.306893 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1a8a0-b603-4c49-af48-a8b294f2d51f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:30.307164 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1a8a0-b603-4c49-af48-a8b294f2d51f None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:30.308031 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1a8a0-b603-4c49-af48-a8b294f2d51f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:30.308342 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1a8a0-b603-4c49-af48-a8b294f2d51f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:30.309940 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1a8a0-b603-4c49-af48-a8b294f2d51f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:30.331833 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 285/552] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 26 16:29:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:30.351415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1a8a0-b603-4c49-af48-a8b294f2d51f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:30.447893 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c16020-4c34-4764-b8d1-5e33f4ab2dc6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:30.462142 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:30.518350 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:30.519697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717f4c6-b78e-4bf7-8aac-b44a82a35757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:30.520393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717f4c6-b78e-4bf7-8aac-b44a82a35757 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:30.520678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717f4c6-b78e-4bf7-8aac-b44a82a35757 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:30.520953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717f4c6-b78e-4bf7-8aac-b44a82a35757 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:30.521758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717f4c6-b78e-4bf7-8aac-b44a82a35757 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:30.523579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717f4c6-b78e-4bf7-8aac-b44a82a35757 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:30.525089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717f4c6-b78e-4bf7-8aac-b44a82a35757 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:30.538414 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1a8a0-b603-4c49-af48-a8b294f2d51f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:30.542765 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 268/553] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 16:29:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:30.549001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717f4c6-b78e-4bf7-8aac-b44a82a35757 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:30.602636 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ffaac-48fe-4cdc-9d07-7931382900b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:30.609288 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ffaac-48fe-4cdc-9d07-7931382900b4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:30.609288 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ffaac-48fe-4cdc-9d07-7931382900b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:30.609288 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ffaac-48fe-4cdc-9d07-7931382900b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:30.745676 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ffaac-48fe-4cdc-9d07-7931382900b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:30.747197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ffaac-48fe-4cdc-9d07-7931382900b4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:30.783924 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717f4c6-b78e-4bf7-8aac-b44a82a35757 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:30.867375 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f113958-66ea-4d48-9314-f4d633004f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:30.868153 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f113958-66ea-4d48-9314-f4d633004f7f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:30.868433 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f113958-66ea-4d48-9314-f4d633004f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:30.868708 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f113958-66ea-4d48-9314-f4d633004f7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:30.893591 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f113958-66ea-4d48-9314-f4d633004f7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:30.896080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f113958-66ea-4d48-9314-f4d633004f7f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:30.930298 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:30.932132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-6f113958-66ea-4d48-9314-f4d633004f7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:30.932132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:30.932132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:30.932132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:30.932132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:30.932132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:30.932132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:30.932132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:30.932132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:30.932132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:30.932132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:30.932132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:30.932132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:30.932132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:30.932132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:30.933411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:30.933411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:30.933411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:30.933411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:30.933411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:30.933411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:30.933411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:30.933411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:30.933411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:30.933411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:30.933411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:30.933411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:30.933411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:30.933411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:30.933411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:30.933411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:30.933411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:30.935152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:30.935152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:30.935152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:30.935152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:30.935152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 269/554] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:30.935152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabbb9e-2eca-46e1-addc-72dfeb6e5dfc None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:30.935485 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabbb9e-2eca-46e1-addc-72dfeb6e5dfc None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:30.935887 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabbb9e-2eca-46e1-addc-72dfeb6e5dfc None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:30.937297 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 270/555] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:30.940136 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabbb9e-2eca-46e1-addc-72dfeb6e5dfc None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:30.954162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 286/556] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:29:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:30.956216 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7e1f5-f783-431d-91ed-f15427245680 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:30.956697 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7e1f5-f783-431d-91ed-f15427245680 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:30.957158 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7e1f5-f783-431d-91ed-f15427245680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:30.980137 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c9b7e1f5-f783-431d-91ed-f15427245680 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:30.982662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c9b7e1f5-f783-431d-91ed-f15427245680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:30.992686 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:31.095415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 287/557] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:31.097190 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7e1f5-f783-431d-91ed-f15427245680 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:31.118707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabbb9e-2eca-46e1-addc-72dfeb6e5dfc None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:31.160595 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd271e29-96b3-45f3-8795-fe73d8d09f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:31.161437 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd271e29-96b3-45f3-8795-fe73d8d09f25 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:31.161652 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd271e29-96b3-45f3-8795-fe73d8d09f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:31.162061 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd271e29-96b3-45f3-8795-fe73d8d09f25 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:31.162826 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd271e29-96b3-45f3-8795-fe73d8d09f25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:31.163129 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd271e29-96b3-45f3-8795-fe73d8d09f25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:31.164561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd271e29-96b3-45f3-8795-fe73d8d09f25 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:31.182044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 271/558] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:31.182044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fdce9-02f0-4d80-98f0-f17f935b229a None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:31.182044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fdce9-02f0-4d80-98f0-f17f935b229a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:31.182044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fdce9-02f0-4d80-98f0-f17f935b229a None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:31.182044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 272/559] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:31.182485 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fdce9-02f0-4d80-98f0-f17f935b229a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:31.240390 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7e1f5-f783-431d-91ed-f15427245680 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:31.262903 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:31.278166 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:31.278681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03998ce0-2139-452a-bfdf-6f0ac53a7ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:31.279787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03998ce0-2139-452a-bfdf-6f0ac53a7ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:31.280298 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03998ce0-2139-452a-bfdf-6f0ac53a7ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:31.280298 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03998ce0-2139-452a-bfdf-6f0ac53a7ca1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:31.295533 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03998ce0-2139-452a-bfdf-6f0ac53a7ca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:31.297001 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03998ce0-2139-452a-bfdf-6f0ac53a7ca1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:31.299922 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fdce9-02f0-4d80-98f0-f17f935b229a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:31.316678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-03998ce0-2139-452a-bfdf-6f0ac53a7ca1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:31.316678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:31.316678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:31.316678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:31.316678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:31.316678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:31.316678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:31.316678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:31.316678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:31.316678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:31.316678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:31.316678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:31.316678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:31.316678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:31.316678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:31.317850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:31.317850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:31.317850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:31.317850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:31.317850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:31.317850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:31.317850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:31.317850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:31.317850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:31.317850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:31.317850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:31.317850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:31.317850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:31.317850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:31.317850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:31.317850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:31.317850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:31.318824 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:31.318824 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:31.318824 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:31.318824 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:31.318824 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 288/560] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:31.319725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03998ce0-2139-452a-bfdf-6f0ac53a7ca1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:31.352193 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f11ef-5c22-4d8a-baf7-869467638a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:31.353556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f11ef-5c22-4d8a-baf7-869467638a9a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:31.354168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f11ef-5c22-4d8a-baf7-869467638a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:31.354915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f11ef-5c22-4d8a-baf7-869467638a9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:31.368568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f11ef-5c22-4d8a-baf7-869467638a9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:31.376799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-034f11ef-5c22-4d8a-baf7-869467638a9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:31.376799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:31.376799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:31.376799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:31.376799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:31.376799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:31.376799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:31.376799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:31.376799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:31.376799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:31.376799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:31.376799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:31.376799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:31.376799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:31.376799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:31.376799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:31.377931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:31.377931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:31.377931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:31.377931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:31.377931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:31.377931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:31.377931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:31.377931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:31.377931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:31.377931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:31.377931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:31.377931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:31.377931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:31.377931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:31.377931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:31.377931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:31.378933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:31.378933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:31.378933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:31.378933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:31.378933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:31.378933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:31.378933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:31.378933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:31.378933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:31.378933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:31.378933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:31.378933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:31.382844 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 273/561] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:29:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:31.384127 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f46678-03f9-4142-a94a-1e48883e4331 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:31.384127 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f46678-03f9-4142-a94a-1e48883e4331 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:31.384127 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f46678-03f9-4142-a94a-1e48883e4331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:31.404374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-07f46678-03f9-4142-a94a-1e48883e4331 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:31.405723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-07f46678-03f9-4142-a94a-1e48883e4331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:31.456263 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03998ce0-2139-452a-bfdf-6f0ac53a7ca1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:31.496604 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 274/562] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:31.497877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f46678-03f9-4142-a94a-1e48883e4331 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:31.512837 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d68ec-9720-42a6-b886-c05888abadd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:31.514170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d68ec-9720-42a6-b886-c05888abadd2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:31.514715 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d68ec-9720-42a6-b886-c05888abadd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:31.515416 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d68ec-9720-42a6-b886-c05888abadd2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:31.525151 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d68ec-9720-42a6-b886-c05888abadd2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:31.526956 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d68ec-9720-42a6-b886-c05888abadd2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:31.544169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-1e7d68ec-9720-42a6-b886-c05888abadd2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:29:31.544169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:31.544169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:31.544169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:31.544169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:31.544169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:31.544169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:31.544169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:31.544169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:31.544169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:31.544169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:31.544169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:31.544169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:31.544169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:31.544169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:31.544169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:31.545187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:31.545187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:31.545187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:31.545187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:31.545187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:31.545187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:31.545187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:31.545187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:31.545187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:31.545187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:31.545187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:31.545187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:31.545187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:31.545187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:31.545187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:31.545187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:31.545187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:31.545187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:31.546244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:31.546244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:31.546244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:31.546244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:31.546244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:31.546244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:31.546244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:31.546244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:31.546244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:29:31.546244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:31.553118 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 289/563] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 26 16:29:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:31.553118 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d68ec-9720-42a6-b886-c05888abadd2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:31.585768 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:31.592859 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:31.620368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f46678-03f9-4142-a94a-1e48883e4331 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:31.656540 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b02f3-1646-49d3-9b6c-cca5364ee936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:31.657124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b02f3-1646-49d3-9b6c-cca5364ee936 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:31.657454 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b02f3-1646-49d3-9b6c-cca5364ee936 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:31.657731 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b02f3-1646-49d3-9b6c-cca5364ee936 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:31.658496 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b02f3-1646-49d3-9b6c-cca5364ee936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:31.658800 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b02f3-1646-49d3-9b6c-cca5364ee936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:31.660242 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b02f3-1646-49d3-9b6c-cca5364ee936 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:31.663555 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d68ec-9720-42a6-b886-c05888abadd2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:31.671691 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 275/564] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:31.672335 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b02f3-1646-49d3-9b6c-cca5364ee936 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:31.708881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c275359-83f1-47ec-8dfa-a68bd24ae917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:31.709608 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275359-83f1-47ec-8dfa-a68bd24ae917 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:31.709911 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275359-83f1-47ec-8dfa-a68bd24ae917 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:31.710205 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275359-83f1-47ec-8dfa-a68bd24ae917 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:31.710979 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c275359-83f1-47ec-8dfa-a68bd24ae917 None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:31.711299 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c275359-83f1-47ec-8dfa-a68bd24ae917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:31.712867 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c275359-83f1-47ec-8dfa-a68bd24ae917 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:31.721827 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 290/565] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 16:29:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:31.722647 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c275359-83f1-47ec-8dfa-a68bd24ae917 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:31.788668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b02f3-1646-49d3-9b6c-cca5364ee936 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:31.825340 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:31.831326 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d3bf0-d085-4c1e-818e-1b2d3766cf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:31.832291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d3bf0-d085-4c1e-818e-1b2d3766cf10 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:31.832603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d3bf0-d085-4c1e-818e-1b2d3766cf10 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:31.832873 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d3bf0-d085-4c1e-818e-1b2d3766cf10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:31.834894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c275359-83f1-47ec-8dfa-a68bd24ae917 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:31.836621 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:31.845411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d3bf0-d085-4c1e-818e-1b2d3766cf10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:31.854441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-693d3bf0-d085-4c1e-818e-1b2d3766cf10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:31.854441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:31.854441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:31.854441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:31.854441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:31.854441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:31.854441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:31.854441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:31.854441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:31.854441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:31.854441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:31.854441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:31.854441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:31.854441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:31.854441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:31.854441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:31.855392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:31.855392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:31.855392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:31.855392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:31.855392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:31.855392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:31.855392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:31.855392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:31.855392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:31.855392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:31.855392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:31.855392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:31.855392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:31.855392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:31.855392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:31.855392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:31.856238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:31.856238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:31.856238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:31.856238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:31.856238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:31.856238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:31.856238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:31.856238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:31.856238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:31.856238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:31.856238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:31.856238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:31.856238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 276/566] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:29:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:31.857928 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d3bf0-d085-4c1e-818e-1b2d3766cf10 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:31.883381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db7e37-42a6-489b-a8d3-224b2f9f23df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:31.884782 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db7e37-42a6-489b-a8d3-224b2f9f23df None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:31.885285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db7e37-42a6-489b-a8d3-224b2f9f23df None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:31.885708 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db7e37-42a6-489b-a8d3-224b2f9f23df None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:31.886742 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db7e37-42a6-489b-a8d3-224b2f9f23df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:31.887193 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db7e37-42a6-489b-a8d3-224b2f9f23df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:31.888930 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db7e37-42a6-489b-a8d3-224b2f9f23df None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:31.910669 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 291/567] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 26 16:29:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:31.911556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db7e37-42a6-489b-a8d3-224b2f9f23df None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:31.978724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d3bf0-d085-4c1e-818e-1b2d3766cf10 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:32.017449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2721c-59a3-4e2f-8f05-acc44fa2ebdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:32.018849 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2721c-59a3-4e2f-8f05-acc44fa2ebdf None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:32.019128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2721c-59a3-4e2f-8f05-acc44fa2ebdf None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:32.019401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2721c-59a3-4e2f-8f05-acc44fa2ebdf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:32.024203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db7e37-42a6-489b-a8d3-224b2f9f23df None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:32.026599 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2721c-59a3-4e2f-8f05-acc44fa2ebdf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:32.028062 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2721c-59a3-4e2f-8f05-acc44fa2ebdf None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:32.043484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-5ff2721c-59a3-4e2f-8f05-acc44fa2ebdf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:32.043484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:32.043484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:32.043484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:32.043484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:32.043484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:32.043484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:32.043484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:32.043484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:32.043484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:32.043484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:32.043484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:32.043484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:32.043484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:32.043484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:32.044605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:32.044605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:32.044605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:32.044605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:32.044605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:32.044605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:32.044605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:32.044605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:32.044605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:32.044605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:32.044605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:32.044605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:32.044605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:32.044605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:32.044605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:32.044605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:32.044605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:32.045557 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:32.045557 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:32.045557 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:32.045557 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:32.045557 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:32.045557 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:32.045557 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:32.045557 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:32.045557 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 277/568] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:32.045557 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2721c-59a3-4e2f-8f05-acc44fa2ebdf None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:32.063905 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9938ee-a867-4473-bba3-c96256d57c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:32.064711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9938ee-a867-4473-bba3-c96256d57c1e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:32.064992 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9938ee-a867-4473-bba3-c96256d57c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:32.065464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9938ee-a867-4473-bba3-c96256d57c1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:32.082525 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9938ee-a867-4473-bba3-c96256d57c1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:32.091225 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9938ee-a867-4473-bba3-c96256d57c1e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:32.112785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:32.114738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-1d9938ee-a867-4473-bba3-c96256d57c1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:32.114738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:32.114738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:32.114738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:32.114738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:32.114738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:32.114738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:32.114738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:32.114738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:32.114738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:32.114738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:32.114738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:32.114738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:32.114738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:32.114738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:32.115801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:32.115801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:32.115801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:32.115801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:32.115801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:32.115801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:32.115801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:32.115801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:32.115801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:32.115801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:32.115801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:32.115801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:32.115801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:32.115801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:32.115801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:32.115801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:32.115801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:32.116874 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:32.116874 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:32.116874 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:32.116874 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:32.116874 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 292/569] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:32.117146 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9938ee-a867-4473-bba3-c96256d57c1e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:32.124364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:32.163900 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2721c-59a3-4e2f-8f05-acc44fa2ebdf None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:32.200720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260804a-e507-4591-916d-528245bfeff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:32.201425 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260804a-e507-4591-916d-528245bfeff4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:32.201707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260804a-e507-4591-916d-528245bfeff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:32.202098 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260804a-e507-4591-916d-528245bfeff4 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:32.202961 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260804a-e507-4591-916d-528245bfeff4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:32.205832 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260804a-e507-4591-916d-528245bfeff4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:32.205832 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260804a-e507-4591-916d-528245bfeff4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:32.214034 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 278/570] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 16:29:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:32.215147 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13003d5c-5f70-47b9-9e6f-1d257c60b041 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:32.215433 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13003d5c-5f70-47b9-9e6f-1d257c60b041 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:32.215708 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13003d5c-5f70-47b9-9e6f-1d257c60b041 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:32.217083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 279/571] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:32.217660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13003d5c-5f70-47b9-9e6f-1d257c60b041 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:32.227635 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9938ee-a867-4473-bba3-c96256d57c1e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:32.262553 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107be54-0b0f-449e-a0b0-ebd70fa82b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:32.263361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107be54-0b0f-449e-a0b0-ebd70fa82b3f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:32.263887 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107be54-0b0f-449e-a0b0-ebd70fa82b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:32.263887 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107be54-0b0f-449e-a0b0-ebd70fa82b3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:32.275859 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107be54-0b0f-449e-a0b0-ebd70fa82b3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:32.277365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107be54-0b0f-449e-a0b0-ebd70fa82b3f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:32.296065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-8107be54-0b0f-449e-a0b0-ebd70fa82b3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:32.296065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:32.296065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:32.296065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:32.296065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:32.296065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:32.296065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:32.296065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:32.296065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:32.296065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:32.296065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:32.296065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:32.296065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:32.296065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:32.296065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:32.297157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:32.297157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:32.297157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:32.297157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:32.297157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:32.297157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:32.297157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:32.297157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:32.297157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:32.297157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:32.297157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:32.297157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:32.297157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:32.297157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:32.297157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:32.297157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:32.297157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:32.298653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:32.298653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:32.298653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:32.298653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:32.298653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 293/572] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:32.298653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107be54-0b0f-449e-a0b0-ebd70fa82b3f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:32.348071 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13003d5c-5f70-47b9-9e6f-1d257c60b041 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:32.359170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:32.368003 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:32.386762 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f09a4-8ca9-4def-98b7-bd69c4b38d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:32.387423 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f09a4-8ca9-4def-98b7-bd69c4b38d87 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:32.387699 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f09a4-8ca9-4def-98b7-bd69c4b38d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:32.387971 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f09a4-8ca9-4def-98b7-bd69c4b38d87 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:32.388743 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f09a4-8ca9-4def-98b7-bd69c4b38d87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:32.389041 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f09a4-8ca9-4def-98b7-bd69c4b38d87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:32.390508 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f09a4-8ca9-4def-98b7-bd69c4b38d87 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:32.403833 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 280/573] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:29:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:32.404678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f09a4-8ca9-4def-98b7-bd69c4b38d87 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:32.407013 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107be54-0b0f-449e-a0b0-ebd70fa82b3f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:32.442265 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2400a64-0f5c-402c-945e-ba80c81755a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:32.442480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2400a64-0f5c-402c-945e-ba80c81755a4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:32.442749 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2400a64-0f5c-402c-945e-ba80c81755a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:32.443066 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2400a64-0f5c-402c-945e-ba80c81755a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:32.443745 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2400a64-0f5c-402c-945e-ba80c81755a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:32.444066 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2400a64-0f5c-402c-945e-ba80c81755a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:32.445495 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2400a64-0f5c-402c-945e-ba80c81755a4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:32.466187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 294/574] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:32.466187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14d5b2-49ba-4318-88b0-522ce4f31c64 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:32.466187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14d5b2-49ba-4318-88b0-522ce4f31c64 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:32.466187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14d5b2-49ba-4318-88b0-522ce4f31c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:32.478959 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2a14d5b2-49ba-4318-88b0-522ce4f31c64 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:32.480159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2a14d5b2-49ba-4318-88b0-522ce4f31c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:32.561202 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f09a4-8ca9-4def-98b7-bd69c4b38d87 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:32.562458 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 295/575] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:32.563309 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14d5b2-49ba-4318-88b0-522ce4f31c64 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:32.609835 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4d144-afe9-4056-9c7b-5e2a7f7e661c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:32.611008 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4d144-afe9-4056-9c7b-5e2a7f7e661c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:32.611008 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4d144-afe9-4056-9c7b-5e2a7f7e661c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:32.611209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4d144-afe9-4056-9c7b-5e2a7f7e661c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:32.619246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:32.624303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4d144-afe9-4056-9c7b-5e2a7f7e661c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:32.626207 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4d144-afe9-4056-9c7b-5e2a7f7e661c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:32.647178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-24a4d144-afe9-4056-9c7b-5e2a7f7e661c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:32.647178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:32.647178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:32.647178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:32.647178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:32.647178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:32.647178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:32.647178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:32.647178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:32.647178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:32.647178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:32.647178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:32.647178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:32.647178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:32.647178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:32.648347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:32.648347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:32.648347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:32.648347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:32.648347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:32.648347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:32.648347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:32.648347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:32.648347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:32.648347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:32.648347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:32.648347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:32.648347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:32.648347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:32.648347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:32.648347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:32.648347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:32.649502 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:32.649502 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:32.649502 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:32.649502 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:32.649502 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 281/576] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:32.649502 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4d144-afe9-4056-9c7b-5e2a7f7e661c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:32.679861 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:32.695369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14d5b2-49ba-4318-88b0-522ce4f31c64 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:32.736831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06d266-5e2c-40d4-893e-fb311d27c189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:32.737539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06d266-5e2c-40d4-893e-fb311d27c189 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:32.737823 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06d266-5e2c-40d4-893e-fb311d27c189 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:32.738095 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06d266-5e2c-40d4-893e-fb311d27c189 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:32.738825 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06d266-5e2c-40d4-893e-fb311d27c189 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:32.739130 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06d266-5e2c-40d4-893e-fb311d27c189 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:32.741024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06d266-5e2c-40d4-893e-fb311d27c189 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:32.752883 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 296/577] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:32.754324 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06d266-5e2c-40d4-893e-fb311d27c189 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:32.771896 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4d144-afe9-4056-9c7b-5e2a7f7e661c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:32.810522 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca293f1-58b9-44c0-a0c4-283bcd456f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:32.811193 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca293f1-58b9-44c0-a0c4-283bcd456f27 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:32.811477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca293f1-58b9-44c0-a0c4-283bcd456f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:32.811754 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca293f1-58b9-44c0-a0c4-283bcd456f27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:32.812591 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca293f1-58b9-44c0-a0c4-283bcd456f27 None admin] RBAC: Adding query filter params (role.id=d39d16b5286d4e1db63841f4917e08f2, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=07cc455638fb4db4939af3657ab4203e) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:32.812900 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca293f1-58b9-44c0-a0c4-283bcd456f27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:32.814420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca293f1-58b9-44c0-a0c4-283bcd456f27 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:32.821215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 282/578] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:29:32 2022] GET /identity/v3/role_assignments?user.id=07cc455638fb4db4939af3657ab4203e&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=d39d16b5286d4e1db63841f4917e08f2 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:32.822089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca293f1-58b9-44c0-a0c4-283bcd456f27 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:32.870816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06d266-5e2c-40d4-893e-fb311d27c189 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:32.879700 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:32.922261 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7dafb-6aa4-4df0-9a20-b07da2934d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:32.923551 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7dafb-6aa4-4df0-9a20-b07da2934d25 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:32.924420 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7dafb-6aa4-4df0-9a20-b07da2934d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:32.924672 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7dafb-6aa4-4df0-9a20-b07da2934d25 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:32.935604 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7dafb-6aa4-4df0-9a20-b07da2934d25 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:32.937801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7dafb-6aa4-4df0-9a20-b07da2934d25 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:32.955173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-19c7dafb-6aa4-4df0-9a20-b07da2934d25 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 16:29:32.955173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:32.955173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:32.955173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:32.955173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:32.955173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:32.955173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:32.955173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:32.955173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:32.955173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:32.955173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:32.955173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:32.955173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:32.955173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:32.955173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:32.955173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:32.956425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:32.956425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:32.956425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:32.956425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:32.956425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:32.956425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:32.956425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:32.956425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:32.956425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:32.956425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:32.956425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:32.956425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:32.956425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:32.956425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:32.956425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:32.956425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:32.956425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:32.956425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:32.957600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:32.957600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:32.957600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:32.957600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:32.957600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:32.957600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:32.957600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:32.957600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:32.957600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 16:29:32.957600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:32.957600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 297/579] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:29:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:32.958186 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7dafb-6aa4-4df0-9a20-b07da2934d25 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:32.958620 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:32.974986 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca293f1-58b9-44c0-a0c4-283bcd456f27 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:33.013534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a59d03-6c1e-465b-863e-3cb86319a6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:33.014238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a59d03-6c1e-465b-863e-3cb86319a6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:33.014818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a59d03-6c1e-465b-863e-3cb86319a6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:33.015090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a59d03-6c1e-465b-863e-3cb86319a6a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:33.026922 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a59d03-6c1e-465b-863e-3cb86319a6a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:33.035081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-13a59d03-6c1e-465b-863e-3cb86319a6a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:33.035081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:33.035081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:33.035081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:33.035081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:33.035081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:33.035081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:33.035081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:33.035081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:33.035081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:33.035081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:33.035081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:33.035081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:33.035081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:33.035081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:33.035081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:33.036056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:33.036056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:33.036056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:33.036056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:33.036056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:33.036056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:33.036056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:33.036056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:33.036056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:33.036056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:33.036056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:33.036056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:33.036056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:33.036056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:33.036056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:33.036056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:33.036903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:33.036903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:33.036903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:33.036903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:33.036903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:33.036903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:33.036903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:33.036903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:33.036903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:33.036903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:33.036903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:33.036903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:33.041156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 283/580] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:29:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:33.042129 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a59d03-6c1e-465b-863e-3cb86319a6a5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:33.089536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7dafb-6aa4-4df0-9a20-b07da2934d25 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:33.140071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9774f-ee54-420f-a165-a0f1e0e33a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:33.141107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9774f-ee54-420f-a165-a0f1e0e33a1b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:33.141765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9774f-ee54-420f-a165-a0f1e0e33a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:33.142110 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9774f-ee54-420f-a165-a0f1e0e33a1b None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:33.143407 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9774f-ee54-420f-a165-a0f1e0e33a1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:33.143925 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9774f-ee54-420f-a165-a0f1e0e33a1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:33.146268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9774f-ee54-420f-a165-a0f1e0e33a1b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:33.166479 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 298/581] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:33.167674 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9774f-ee54-420f-a165-a0f1e0e33a1b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:33.184641 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a59d03-6c1e-465b-863e-3cb86319a6a5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:33.212464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:33.230147 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62957271-fc14-4073-a09b-0fb529d6dfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:33.230959 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62957271-fc14-4073-a09b-0fb529d6dfc0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:33.231236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62957271-fc14-4073-a09b-0fb529d6dfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:33.231510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62957271-fc14-4073-a09b-0fb529d6dfc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:33.239859 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62957271-fc14-4073-a09b-0fb529d6dfc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:33.241358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62957271-fc14-4073-a09b-0fb529d6dfc0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:33.257786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-62957271-fc14-4073-a09b-0fb529d6dfc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:33.257786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:33.257786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:33.257786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:33.257786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:33.257786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:33.257786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:33.257786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:33.257786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:33.257786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:33.257786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:33.257786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:33.257786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:33.257786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:33.257786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:33.259416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:33.259416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:33.259416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:33.259416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:33.259416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:33.259416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:33.259416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:33.259416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:33.259416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:33.259416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:33.259416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:33.259416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:33.259416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:33.259416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:33.259416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:33.259416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:33.259416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:33.261226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:33.261226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:33.261226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:33.261226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:33.261226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:33.261226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:33.261226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:33.261226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:33.264080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 284/582] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:33.264898 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62957271-fc14-4073-a09b-0fb529d6dfc0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:33.288339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:33.329313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9774f-ee54-420f-a165-a0f1e0e33a1b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:33.374646 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f77c4-5c83-4864-9121-89fa05c52ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:33.375327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f77c4-5c83-4864-9121-89fa05c52ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:33.375613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f77c4-5c83-4864-9121-89fa05c52ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:33.375891 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f77c4-5c83-4864-9121-89fa05c52ad3 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:33.376739 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f77c4-5c83-4864-9121-89fa05c52ad3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:33.377068 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f77c4-5c83-4864-9121-89fa05c52ad3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:33.378547 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f77c4-5c83-4864-9121-89fa05c52ad3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:33.398865 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62957271-fc14-4073-a09b-0fb529d6dfc0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:33.405711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 299/583] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 26 16:29:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:33.405711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f77c4-5c83-4864-9121-89fa05c52ad3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:33.453113 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74847dd-b70c-4a38-b279-52036d88b2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:33.453810 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74847dd-b70c-4a38-b279-52036d88b2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:33.454107 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74847dd-b70c-4a38-b279-52036d88b2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:33.454594 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74847dd-b70c-4a38-b279-52036d88b2f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:33.455258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74847dd-b70c-4a38-b279-52036d88b2f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:33.455566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74847dd-b70c-4a38-b279-52036d88b2f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:33.457019 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74847dd-b70c-4a38-b279-52036d88b2f3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:33.466786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 285/584] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 16:29:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:33.467546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74847dd-b70c-4a38-b279-52036d88b2f3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:33.592253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:33.612334 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f77c4-5c83-4864-9121-89fa05c52ad3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:33.633368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:33.656507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2109a-a1f9-40ee-afc1-4bb758654590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:33.657352 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2109a-a1f9-40ee-afc1-4bb758654590 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:33.657645 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2109a-a1f9-40ee-afc1-4bb758654590 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:33.657925 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2109a-a1f9-40ee-afc1-4bb758654590 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:33.661983 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74847dd-b70c-4a38-b279-52036d88b2f3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:33.666863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2109a-a1f9-40ee-afc1-4bb758654590 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:33.668341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2109a-a1f9-40ee-afc1-4bb758654590 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:33.683967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-19c2109a-a1f9-40ee-afc1-4bb758654590 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:29:33.683967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:33.683967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:33.683967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:33.683967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:33.683967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:33.683967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:33.683967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:33.683967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:33.683967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:33.683967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:33.683967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:33.683967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:33.683967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:33.683967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:33.683967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:33.684963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:33.684963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:33.684963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:33.684963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:33.684963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:33.684963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:33.684963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:33.684963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:33.684963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:33.684963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:33.684963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:33.684963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:33.684963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:33.684963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:33.684963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:33.684963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:33.684963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:33.684963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:33.685932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:33.685932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:33.685932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:33.685932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:33.685932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:33.685932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:33.685932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:33.685932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:33.685932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:29:33.685932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:33.685932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 300/585] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:29:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:33.686514 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2109a-a1f9-40ee-afc1-4bb758654590 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:33.705911 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd73bcc-d9e2-46d3-b182-6c9854648a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:33.706593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd73bcc-d9e2-46d3-b182-6c9854648a67 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:33.706875 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd73bcc-d9e2-46d3-b182-6c9854648a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:33.707152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd73bcc-d9e2-46d3-b182-6c9854648a67 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:33.707950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd73bcc-d9e2-46d3-b182-6c9854648a67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:33.708260 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd73bcc-d9e2-46d3-b182-6c9854648a67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:33.709765 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd73bcc-d9e2-46d3-b182-6c9854648a67 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:33.724279 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 286/586] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:29:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:33.725044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd73bcc-d9e2-46d3-b182-6c9854648a67 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:33.817728 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2109a-a1f9-40ee-afc1-4bb758654590 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:33.853992 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd73bcc-d9e2-46d3-b182-6c9854648a67 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:33.857095 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c4716-cd17-4b18-bdc3-3bd8af126c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:33.858437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c4716-cd17-4b18-bdc3-3bd8af126c48 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:33.858864 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c4716-cd17-4b18-bdc3-3bd8af126c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:33.859257 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c4716-cd17-4b18-bdc3-3bd8af126c48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:33.878748 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c4716-cd17-4b18-bdc3-3bd8af126c48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:33.881194 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c4716-cd17-4b18-bdc3-3bd8af126c48 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:33.885491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:33.908772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-2f0c4716-cd17-4b18-bdc3-3bd8af126c48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:33.908772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:33.908772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:33.908772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:33.908772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:33.908772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:33.908772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:33.908772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:33.908772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:33.908772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:33.908772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:33.908772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:33.908772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:33.908772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:33.908772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:33.909777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:33.909777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:33.909777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:33.909777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:33.909777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:33.909777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:33.909777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:33.909777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:33.909777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:33.909777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:33.909777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:33.909777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:33.909777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:33.909777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:33.909777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:33.909777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:33.909777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:33.910857 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:33.910857 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:33.910857 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:33.910857 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:33.915012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 301/587] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:33.916624 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011fd2d-f57e-4620-8e9d-c71142d607e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:33.917402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c4716-cd17-4b18-bdc3-3bd8af126c48 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:33.918370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011fd2d-f57e-4620-8e9d-c71142d607e1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:33.919105 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011fd2d-f57e-4620-8e9d-c71142d607e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:33.919851 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011fd2d-f57e-4620-8e9d-c71142d607e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:33.930863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:33.945564 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011fd2d-f57e-4620-8e9d-c71142d607e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:33.948118 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011fd2d-f57e-4620-8e9d-c71142d607e1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:33.981770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-8011fd2d-f57e-4620-8e9d-c71142d607e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:33.981770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:33.981770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:33.981770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:33.981770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:33.981770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:33.981770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:33.981770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:33.981770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:33.981770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:33.981770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:33.981770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:33.981770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:33.981770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:33.981770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:33.983286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:33.983286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:33.983286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:33.983286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:33.983286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:33.983286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:33.983286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:33.983286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:33.983286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:33.983286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:33.983286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:33.983286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:33.983286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:33.983286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:33.983286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:33.983286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:33.983286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:33.984809 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:33.984809 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:33.984809 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:33.984809 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:33.984809 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 287/588] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:33.985319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011fd2d-f57e-4620-8e9d-c71142d607e1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:34.078644 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c4716-cd17-4b18-bdc3-3bd8af126c48 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:34.133145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011fd2d-f57e-4620-8e9d-c71142d607e1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:34.136772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71259ab-a112-405e-bf93-aaad87512008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:34.137572 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71259ab-a112-405e-bf93-aaad87512008 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:34.137850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71259ab-a112-405e-bf93-aaad87512008 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:34.138171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71259ab-a112-405e-bf93-aaad87512008 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:34.139028 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71259ab-a112-405e-bf93-aaad87512008 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:34.139332 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71259ab-a112-405e-bf93-aaad87512008 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:34.140799 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71259ab-a112-405e-bf93-aaad87512008 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:34.166393 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 302/589] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 26 16:29:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:34.166393 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71259ab-a112-405e-bf93-aaad87512008 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:34.196997 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7faee63-e714-4fa4-842c-403d7017cd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:34.198649 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7faee63-e714-4fa4-842c-403d7017cd46 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:34.199114 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7faee63-e714-4fa4-842c-403d7017cd46 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:34.199560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7faee63-e714-4fa4-842c-403d7017cd46 None admin] PATH_INFO: `/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/35c9fa9c29494ff9b1f749974dca2719/roles/d39d16b5286d4e1db63841f4917e08f2` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:34.224564 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7faee63-e714-4fa4-842c-403d7017cd46 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3379cdd914747758e71b3b05c5921b1, user_id=35c9fa9c29494ff9b1f749974dca2719, role_id=d39d16b5286d4e1db63841f4917e08f2)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:34.227237 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7faee63-e714-4fa4-842c-403d7017cd46 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:34.245771 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:34.297173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71259ab-a112-405e-bf93-aaad87512008 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:34.341298 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 288/590] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:29:33 2022] PUT /identity/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/35c9fa9c29494ff9b1f749974dca2719/roles/d39d16b5286d4e1db63841f4917e08f2 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:29:34.341298 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7faee63-e714-4fa4-842c-403d7017cd46 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:34.365880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797c5a6-37c2-4e9b-85b7-07111e16de6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:34.366978 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797c5a6-37c2-4e9b-85b7-07111e16de6d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:34.367465 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797c5a6-37c2-4e9b-85b7-07111e16de6d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:34.367924 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797c5a6-37c2-4e9b-85b7-07111e16de6d None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:34.369248 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797c5a6-37c2-4e9b-85b7-07111e16de6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:34.369767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797c5a6-37c2-4e9b-85b7-07111e16de6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:34.372238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797c5a6-37c2-4e9b-85b7-07111e16de6d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:34.401197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 303/591] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:34.402985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:34.404304 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797c5a6-37c2-4e9b-85b7-07111e16de6d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:34.540429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7faee63-e714-4fa4-842c-403d7017cd46 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:34.606717 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797c5a6-37c2-4e9b-85b7-07111e16de6d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:34.613802 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ad49e-4ae5-4d76-9fd5-474969626acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:34.614853 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ad49e-4ae5-4d76-9fd5-474969626acf None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:34.615344 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ad49e-4ae5-4d76-9fd5-474969626acf None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:34.615844 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ad49e-4ae5-4d76-9fd5-474969626acf None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:34.616661 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ad49e-4ae5-4d76-9fd5-474969626acf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:34.617038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ad49e-4ae5-4d76-9fd5-474969626acf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:34.619273 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ad49e-4ae5-4d76-9fd5-474969626acf None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:34.627435 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:34.649352 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 289/592] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:34.652676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ad49e-4ae5-4d76-9fd5-474969626acf None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:34.669166 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349abde-2c00-4162-88a3-3d51c2251bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:34.671123 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349abde-2c00-4162-88a3-3d51c2251bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:34.671636 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349abde-2c00-4162-88a3-3d51c2251bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:34.672080 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349abde-2c00-4162-88a3-3d51c2251bf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:34.684612 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349abde-2c00-4162-88a3-3d51c2251bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:34.686173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349abde-2c00-4162-88a3-3d51c2251bf9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:34.705999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-9349abde-2c00-4162-88a3-3d51c2251bf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:34.705999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:34.705999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:34.705999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:34.705999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:34.705999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:34.705999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:34.705999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:34.705999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:34.705999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:34.705999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:34.705999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:34.705999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:34.705999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:34.705999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:34.706998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:34.706998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:34.706998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:34.706998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:34.706998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:34.706998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:34.706998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:34.706998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:34.706998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:34.706998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:34.706998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:34.706998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:34.706998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:34.706998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:34.706998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:34.706998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:34.706998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:34.707880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:34.707880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:34.707880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:34.707880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:34.707880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 304/593] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:34.708167 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349abde-2c00-4162-88a3-3d51c2251bf9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:34.788972 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:34.793956 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ad49e-4ae5-4d76-9fd5-474969626acf None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:34.830145 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349abde-2c00-4162-88a3-3d51c2251bf9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:34.835328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce59736-ec8a-437b-8d75-b47ff4bc9cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:34.836488 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce59736-ec8a-437b-8d75-b47ff4bc9cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:34.837072 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce59736-ec8a-437b-8d75-b47ff4bc9cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:34.837577 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce59736-ec8a-437b-8d75-b47ff4bc9cb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:34.846906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce59736-ec8a-437b-8d75-b47ff4bc9cb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:34.849889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce59736-ec8a-437b-8d75-b47ff4bc9cb3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:34.872989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-6ce59736-ec8a-437b-8d75-b47ff4bc9cb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:34.872989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:34.872989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:34.872989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:34.872989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:34.872989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:34.872989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:34.872989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:34.872989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:34.872989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:34.872989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:34.872989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:34.872989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:34.872989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:34.872989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:34.874088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:34.874088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:34.874088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:34.874088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:34.874088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:34.874088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:34.874088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:34.874088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:34.874088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:34.874088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:34.874088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:34.874088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:34.874088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:34.874088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:34.874088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:34.874088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:34.874088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:34.875195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:34.875195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:34.875195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:34.875195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:34.875195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:34.875195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:34.875195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:34.875195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:34.875833 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d83fc9-6754-4805-94c9-d9294ee7a7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:34.876676 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d83fc9-6754-4805-94c9-d9294ee7a7ca None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:34.877548 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d83fc9-6754-4805-94c9-d9294ee7a7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:34.877881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d83fc9-6754-4805-94c9-d9294ee7a7ca None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:34.883178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 290/594] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:34.884407 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce59736-ec8a-437b-8d75-b47ff4bc9cb3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:34.888112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d83fc9-6754-4805-94c9-d9294ee7a7ca None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:34.889650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d83fc9-6754-4805-94c9-d9294ee7a7ca None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:34.914046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-74d83fc9-6754-4805-94c9-d9294ee7a7ca None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:29:34.914046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:34.914046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:34.914046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:34.914046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:34.914046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:34.914046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:34.914046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:34.914046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:34.914046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:34.914046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:34.914046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:34.914046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:34.914046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:34.914046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:34.914046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:34.915866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:34.915866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:34.915866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:34.915866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:34.915866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:34.915866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:34.915866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:34.915866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:34.915866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:34.915866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:34.915866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:34.915866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:34.915866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:34.915866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:34.915866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:34.915866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:34.915866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:34.915866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:34.917740 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:34.917740 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:34.917740 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:34.917740 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:34.917740 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:34.917740 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:34.917740 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:34.917740 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:34.917740 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:29:34.917740 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:34.920612 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 305/595] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:29:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:34.921678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d83fc9-6754-4805-94c9-d9294ee7a7ca None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:34.961419 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:35.051142 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce59736-ec8a-437b-8d75-b47ff4bc9cb3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:35.078317 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d83fc9-6754-4805-94c9-d9294ee7a7ca None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:35.106418 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26833e5d-5f43-4c04-8d18-a7304944ee8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:35.107657 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26833e5d-5f43-4c04-8d18-a7304944ee8e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:35.108098 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26833e5d-5f43-4c04-8d18-a7304944ee8e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:35.108524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26833e5d-5f43-4c04-8d18-a7304944ee8e None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:35.109475 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26833e5d-5f43-4c04-8d18-a7304944ee8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:35.109931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26833e5d-5f43-4c04-8d18-a7304944ee8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:35.112067 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26833e5d-5f43-4c04-8d18-a7304944ee8e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:35.124091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ca9fa-7202-46ee-9508-2eed7505ecc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:35.124812 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ca9fa-7202-46ee-9508-2eed7505ecc2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:35.125106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ca9fa-7202-46ee-9508-2eed7505ecc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:35.125417 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ca9fa-7202-46ee-9508-2eed7505ecc2 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:35.126216 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ca9fa-7202-46ee-9508-2eed7505ecc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:35.126528 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ca9fa-7202-46ee-9508-2eed7505ecc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:35.131858 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ca9fa-7202-46ee-9508-2eed7505ecc2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:35.132477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 291/596] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:35.133601 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26833e5d-5f43-4c04-8d18-a7304944ee8e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:35.148243 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 306/597] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:29:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:35.148243 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ca9fa-7202-46ee-9508-2eed7505ecc2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:35.177643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:35.291848 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:35.298049 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26833e5d-5f43-4c04-8d18-a7304944ee8e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:35.323011 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ca9fa-7202-46ee-9508-2eed7505ecc2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:35.375766 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03056823-4711-4a5c-8722-e2eba2881eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:35.376933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03056823-4711-4a5c-8722-e2eba2881eed None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:35.378341 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03056823-4711-4a5c-8722-e2eba2881eed None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:35.378823 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03056823-4711-4a5c-8722-e2eba2881eed None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:35.381386 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03056823-4711-4a5c-8722-e2eba2881eed None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:35.382029 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03056823-4711-4a5c-8722-e2eba2881eed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:35.384580 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03056823-4711-4a5c-8722-e2eba2881eed None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:35.396204 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e5980-3a31-440e-b926-24daaa7be35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:35.398800 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e5980-3a31-440e-b926-24daaa7be35f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:35.399329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e5980-3a31-440e-b926-24daaa7be35f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:35.399818 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e5980-3a31-440e-b926-24daaa7be35f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:35.409202 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e5980-3a31-440e-b926-24daaa7be35f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:35.411442 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e5980-3a31-440e-b926-24daaa7be35f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:35.413658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 292/598] 10.222.0.48 () {56 vars in 1139 bytes} [Thu May 26 16:29:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:35.414957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03056823-4711-4a5c-8722-e2eba2881eed None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:35.429725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-982e5980-3a31-440e-b926-24daaa7be35f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:35.429725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:35.429725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:35.429725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:35.429725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:35.429725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:35.429725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:35.429725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:35.429725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:35.429725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:35.429725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:35.429725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:35.429725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:35.429725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:35.429725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:35.430881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:35.430881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:35.430881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:35.430881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:35.430881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:35.430881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:35.430881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:35.430881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:35.430881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:35.430881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:35.430881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:35.430881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:35.430881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:35.430881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:35.430881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:35.430881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:35.430881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:35.432062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:35.432062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:35.432062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:35.432062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:35.432062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:35.432062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:35.432062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:35.432062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:35.437637 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 307/599] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:35.437637 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e5980-3a31-440e-b926-24daaa7be35f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:35.519705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:35.546210 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03056823-4711-4a5c-8722-e2eba2881eed None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:35.558992 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e5980-3a31-440e-b926-24daaa7be35f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:35.585652 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd775e53-1c9c-4911-84a8-2765429af01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:35.586871 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd775e53-1c9c-4911-84a8-2765429af01a None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:35.587266 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd775e53-1c9c-4911-84a8-2765429af01a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:35.587680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd775e53-1c9c-4911-84a8-2765429af01a None admin] PATH_INFO: `/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/7701907eb3b24c3681352c91ad6a3aeb/roles/d39d16b5286d4e1db63841f4917e08f2` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:35.599447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b580a6-c1fc-4150-98f7-e43c10a04948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:35.600295 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b580a6-c1fc-4150-98f7-e43c10a04948 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:35.600582 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b580a6-c1fc-4150-98f7-e43c10a04948 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:35.600870 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b580a6-c1fc-4150-98f7-e43c10a04948 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:35.606703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd775e53-1c9c-4911-84a8-2765429af01a None admin] RBAC: Authorizing `identity:create_grant(project_id=a3379cdd914747758e71b3b05c5921b1, user_id=7701907eb3b24c3681352c91ad6a3aeb, role_id=d39d16b5286d4e1db63841f4917e08f2)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:35.608508 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd775e53-1c9c-4911-84a8-2765429af01a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:35.613411 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b580a6-c1fc-4150-98f7-e43c10a04948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:35.615016 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b580a6-c1fc-4150-98f7-e43c10a04948 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:35.622027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:35.634048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d4b580a6-c1fc-4150-98f7-e43c10a04948 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:35.634048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:35.634048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:35.634048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:35.634048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:35.634048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:35.634048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:35.634048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:35.634048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:35.634048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:35.634048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:35.634048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:35.634048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:35.634048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:35.634048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:35.635197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:35.635197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:35.635197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:35.635197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:35.635197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:35.635197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:35.635197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:35.635197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:35.635197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:35.635197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:35.635197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:35.635197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:35.635197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:35.635197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:35.635197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:35.635197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:35.635197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:35.636413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:35.636413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:35.636413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:35.636413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:35.637420 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 308/600] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:35.639072 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34fcc4-1a2f-4a24-8034-eff9463dfcab None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:35.639360 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34fcc4-1a2f-4a24-8034-eff9463dfcab None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:35.639734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34fcc4-1a2f-4a24-8034-eff9463dfcab None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:35.641117 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 309/601] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:35.641933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34fcc4-1a2f-4a24-8034-eff9463dfcab None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:35.693855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 293/602] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:29:35 2022] PUT /identity/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/7701907eb3b24c3681352c91ad6a3aeb/roles/d39d16b5286d4e1db63841f4917e08f2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:29:35.694785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd775e53-1c9c-4911-84a8-2765429af01a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:35.785922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34fcc4-1a2f-4a24-8034-eff9463dfcab None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:35.824880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb035f-8a90-4aa8-ab4b-951327b92d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:35.825619 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb035f-8a90-4aa8-ab4b-951327b92d75 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:35.825963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb035f-8a90-4aa8-ab4b-951327b92d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:35.826285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb035f-8a90-4aa8-ab4b-951327b92d75 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:35.827345 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb035f-8a90-4aa8-ab4b-951327b92d75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:35.827660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb035f-8a90-4aa8-ab4b-951327b92d75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:35.829426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb035f-8a90-4aa8-ab4b-951327b92d75 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:35.839379 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd775e53-1c9c-4911-84a8-2765429af01a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:35.849454 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 310/603] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:29:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:35.853351 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafabf6-81f9-4001-aea3-bb23fb3f2169 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:35.853948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafabf6-81f9-4001-aea3-bb23fb3f2169 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:35.854434 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafabf6-81f9-4001-aea3-bb23fb3f2169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:35.874959 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-beafabf6-81f9-4001-aea3-bb23fb3f2169 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:35.876852 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:35.878325 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-beafabf6-81f9-4001-aea3-bb23fb3f2169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:35.893480 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fc9b7-e323-4346-ad11-47cd92d2b31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:35.894561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fc9b7-e323-4346-ad11-47cd92d2b31d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:35.901385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fc9b7-e323-4346-ad11-47cd92d2b31d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:35.901385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fc9b7-e323-4346-ad11-47cd92d2b31d None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:35.901385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fc9b7-e323-4346-ad11-47cd92d2b31d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:35.901385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fc9b7-e323-4346-ad11-47cd92d2b31d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:35.901385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fc9b7-e323-4346-ad11-47cd92d2b31d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:35.917647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 294/604] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:35.919151 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fc9b7-e323-4346-ad11-47cd92d2b31d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:35.975662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:35.996987 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 311/605] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:36.001475 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafabf6-81f9-4001-aea3-bb23fb3f2169 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:36.079418 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fc9b7-e323-4346-ad11-47cd92d2b31d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:36.137371 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae760db5-d7b9-4137-a66c-d33bace91132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:36.138365 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae760db5-d7b9-4137-a66c-d33bace91132 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:36.138656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae760db5-d7b9-4137-a66c-d33bace91132 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:36.139314 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae760db5-d7b9-4137-a66c-d33bace91132 None admin] PATH_INFO: `/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/8be9c9fb92c049c18a54b25725a34a74/roles/d39d16b5286d4e1db63841f4917e08f2` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:36.143356 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafabf6-81f9-4001-aea3-bb23fb3f2169 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:36.158276 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae760db5-d7b9-4137-a66c-d33bace91132 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3379cdd914747758e71b3b05c5921b1, user_id=8be9c9fb92c049c18a54b25725a34a74, role_id=d39d16b5286d4e1db63841f4917e08f2)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:36.160533 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae760db5-d7b9-4137-a66c-d33bace91132 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:36.188420 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56280d-f214-4397-82a3-170db7e701a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:36.195585 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56280d-f214-4397-82a3-170db7e701a7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:36.195585 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56280d-f214-4397-82a3-170db7e701a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:36.195585 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56280d-f214-4397-82a3-170db7e701a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:36.202096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56280d-f214-4397-82a3-170db7e701a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:36.203551 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56280d-f214-4397-82a3-170db7e701a7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:36.221835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-5e56280d-f214-4397-82a3-170db7e701a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:36.221835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:36.221835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:36.221835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:36.221835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:36.221835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:36.221835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:36.221835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:36.221835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:36.221835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:36.221835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:36.221835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:36.221835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:36.221835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:36.221835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:36.228807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:36.228807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:36.228807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:36.228807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:36.228807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:36.228807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:36.228807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:36.228807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:36.228807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:36.228807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:36.228807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:36.228807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:36.228807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:36.228807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:36.228807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:36.228807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:36.228807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:36.231233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:36.231233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:36.231233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:36.231233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:36.231233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:36.231233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:36.231233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:36.231233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:36.231233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 312/606] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:36.231233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56280d-f214-4397-82a3-170db7e701a7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:36.248240 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 295/607] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:29:35 2022] PUT /identity/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/8be9c9fb92c049c18a54b25725a34a74/roles/d39d16b5286d4e1db63841f4917e08f2 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:29:36.249597 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae760db5-d7b9-4137-a66c-d33bace91132 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:36.298503 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:36.332503 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:36.406432 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae760db5-d7b9-4137-a66c-d33bace91132 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:36.464371 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db83186-c038-4705-81e7-048ff1a9e1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:36.466098 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db83186-c038-4705-81e7-048ff1a9e1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:36.467078 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db83186-c038-4705-81e7-048ff1a9e1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:36.467742 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db83186-c038-4705-81e7-048ff1a9e1b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:36.469391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db83186-c038-4705-81e7-048ff1a9e1b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:36.469974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db83186-c038-4705-81e7-048ff1a9e1b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:36.472485 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db83186-c038-4705-81e7-048ff1a9e1b0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:36.494943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 296/608] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:29:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:36.501810 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db83186-c038-4705-81e7-048ff1a9e1b0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:36.502422 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56280d-f214-4397-82a3-170db7e701a7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:36.590474 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4348fcf-e81a-49a6-bfdc-ebc0b6d2e147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:36.591309 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4348fcf-e81a-49a6-bfdc-ebc0b6d2e147 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:36.591584 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4348fcf-e81a-49a6-bfdc-ebc0b6d2e147 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:36.591864 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4348fcf-e81a-49a6-bfdc-ebc0b6d2e147 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:36.612581 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4348fcf-e81a-49a6-bfdc-ebc0b6d2e147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:36.625009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-f4348fcf-e81a-49a6-bfdc-ebc0b6d2e147 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:36.625009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:36.625009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:36.625009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:36.625009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:36.625009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:36.625009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:36.625009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:36.625009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:36.625009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:36.625009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:36.625009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:36.625009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:36.625009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:36.625009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:36.625009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:36.626058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:36.626058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:36.626058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:36.626058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:36.626058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:36.626058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:36.626058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:36.626058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:36.626058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:36.626058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:36.626058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:36.626058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:36.626058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:36.626058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:36.626058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:36.626058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:36.627035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:36.627035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:36.627035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:36.627035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:36.627035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:36.627035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:36.627035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:36.627035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:36.627035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:36.627035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:36.627035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:36.627035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:36.627035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 313/609] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:29:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:36.632444 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4348fcf-e81a-49a6-bfdc-ebc0b6d2e147 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:36.636872 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:36.645140 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db83186-c038-4705-81e7-048ff1a9e1b0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:36.687022 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80962c25-157c-41a2-9644-c7e5dbf772ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:36.688275 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80962c25-157c-41a2-9644-c7e5dbf772ba None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:36.688769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80962c25-157c-41a2-9644-c7e5dbf772ba None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:36.689419 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80962c25-157c-41a2-9644-c7e5dbf772ba None admin] PATH_INFO: `/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/d577b5295f9e4a4388bb6293d1c33d0b/roles/d39d16b5286d4e1db63841f4917e08f2` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:36.709789 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80962c25-157c-41a2-9644-c7e5dbf772ba None admin] RBAC: Authorizing `identity:create_grant(project_id=a3379cdd914747758e71b3b05c5921b1, user_id=d577b5295f9e4a4388bb6293d1c33d0b, role_id=d39d16b5286d4e1db63841f4917e08f2)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:36.711899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80962c25-157c-41a2-9644-c7e5dbf772ba None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:36.781375 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 297/610] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:29:36 2022] PUT /identity/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/d577b5295f9e4a4388bb6293d1c33d0b/roles/d39d16b5286d4e1db63841f4917e08f2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:29:36.799046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4348fcf-e81a-49a6-bfdc-ebc0b6d2e147 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:36.810398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:36.850741 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca1d18-e49c-4a2c-9304-eb1350e92788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:36.851746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca1d18-e49c-4a2c-9304-eb1350e92788 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:36.852187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca1d18-e49c-4a2c-9304-eb1350e92788 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:36.852628 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca1d18-e49c-4a2c-9304-eb1350e92788 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:36.853633 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca1d18-e49c-4a2c-9304-eb1350e92788 None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:36.854138 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca1d18-e49c-4a2c-9304-eb1350e92788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:36.855782 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca1d18-e49c-4a2c-9304-eb1350e92788 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:36.870089 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 314/611] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 16:29:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:36.877405 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80962c25-157c-41a2-9644-c7e5dbf772ba None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:37.051808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80962c25-157c-41a2-9644-c7e5dbf772ba None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:37.102217 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71133f9-5144-4f22-8aed-29ac296e0e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:37.103328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71133f9-5144-4f22-8aed-29ac296e0e78 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:37.103764 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71133f9-5144-4f22-8aed-29ac296e0e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:37.104185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71133f9-5144-4f22-8aed-29ac296e0e78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:37.123865 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71133f9-5144-4f22-8aed-29ac296e0e78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:37.125872 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71133f9-5144-4f22-8aed-29ac296e0e78 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:37.129485 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:37.149626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-e71133f9-5144-4f22-8aed-29ac296e0e78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:37.149626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:37.149626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:37.149626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:37.149626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:37.149626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:37.149626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:37.149626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:37.149626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:37.149626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:37.149626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:37.149626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:37.149626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:37.149626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:37.149626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:37.150763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:37.150763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:37.150763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:37.150763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:37.150763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:37.150763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:37.150763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:37.150763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:37.150763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:37.150763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:37.150763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:37.150763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:37.150763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:37.150763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:37.150763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:37.150763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:37.150763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:37.152020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:37.152020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:37.152020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:37.152020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:37.152020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 298/612] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:37.159804 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca1d18-e49c-4a2c-9304-eb1350e92788 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:37.280265 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca1d18-e49c-4a2c-9304-eb1350e92788 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:37.320394 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6c680-6ca3-4cb2-8516-f59ec476d744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:37.321013 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6c680-6ca3-4cb2-8516-f59ec476d744 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:37.321344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6c680-6ca3-4cb2-8516-f59ec476d744 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:37.321645 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6c680-6ca3-4cb2-8516-f59ec476d744 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:37.322483 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6c680-6ca3-4cb2-8516-f59ec476d744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:37.322785 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6c680-6ca3-4cb2-8516-f59ec476d744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:37.324238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6c680-6ca3-4cb2-8516-f59ec476d744 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:37.339518 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 315/613] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:37.344713 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc26738-2446-4e71-a30f-7469b4bd956a None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:37.345239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc26738-2446-4e71-a30f-7469b4bd956a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:37.345239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc26738-2446-4e71-a30f-7469b4bd956a None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:37.347551 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 299/614] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:37.349973 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6c680-6ca3-4cb2-8516-f59ec476d744 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:37.353682 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea8ac3-9b8b-44be-8571-4b342e311316 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:37.353940 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea8ac3-9b8b-44be-8571-4b342e311316 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:37.354219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea8ac3-9b8b-44be-8571-4b342e311316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:37.382110 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f0ea8ac3-9b8b-44be-8571-4b342e311316 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:37.383802 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f0ea8ac3-9b8b-44be-8571-4b342e311316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:37.413633 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:37.476922 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 300/615] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:37.517974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea8ac3-9b8b-44be-8571-4b342e311316 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:37.543576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6c680-6ca3-4cb2-8516-f59ec476d744 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:37.650109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba964c-a95c-4c8f-8c22-d1484af525c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:37.650858 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba964c-a95c-4c8f-8c22-d1484af525c7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:37.651143 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba964c-a95c-4c8f-8c22-d1484af525c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:37.651420 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba964c-a95c-4c8f-8c22-d1484af525c7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:37.652297 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea8ac3-9b8b-44be-8571-4b342e311316 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:37.682236 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba964c-a95c-4c8f-8c22-d1484af525c7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:37.683734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba964c-a95c-4c8f-8c22-d1484af525c7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:37.691249 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:37.693016 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6368755-5c08-46f4-91dd-76851c38b663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:37.693957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6368755-5c08-46f4-91dd-76851c38b663 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:37.694915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6368755-5c08-46f4-91dd-76851c38b663 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:37.695300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6368755-5c08-46f4-91dd-76851c38b663 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:37.707786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6368755-5c08-46f4-91dd-76851c38b663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:37.716168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d6368755-5c08-46f4-91dd-76851c38b663 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:37.716168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:37.716168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:37.716168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:37.716168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:37.716168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:37.716168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:37.716168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:37.716168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:37.716168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:37.716168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:37.716168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:37.716168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:37.716168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:37.716168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:37.716168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:37.717427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:37.717427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:37.717427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:37.717427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:37.717427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:37.717427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:37.717427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:37.717427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:37.717427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:37.717427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:37.717427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:37.717427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:37.717427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:37.717427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:37.717427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:37.717427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:37.719243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:37.719243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:37.719243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:37.719243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:37.719243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:37.719243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:37.719243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:37.719243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:37.719243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:37.719243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:37.719243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:37.719243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:37.721593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-1dba964c-a95c-4c8f-8c22-d1484af525c7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:29:37.721593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:37.721593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:37.721593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:37.721593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:37.721593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:37.721593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:37.721593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:37.721593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:37.721593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:37.721593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:37.721593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:37.721593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:37.721593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:37.721593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:37.721593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:37.723750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:37.723750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:37.723750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:37.723750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:37.723750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:37.723750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:37.723750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:37.723750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:37.723750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:37.723750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:37.723750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:37.723750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:37.723750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:37.723750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:37.723750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:37.723750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:37.723750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:37.723750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:37.733466 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:37.733466 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:37.733466 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:37.733466 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:37.733466 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:37.733466 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:37.733466 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:37.733466 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:37.733466 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:29:37.733466 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:37.734834 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 301/616] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:29:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:37.734982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 316/617] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:29:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:37.735126 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6368755-5c08-46f4-91dd-76851c38b663 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:37.735270 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba964c-a95c-4c8f-8c22-d1484af525c7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:37.848658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:37.859408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba964c-a95c-4c8f-8c22-d1484af525c7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:37.903820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648ddc8-723a-43a7-85bb-04afe5caf7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:37.904413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648ddc8-723a-43a7-85bb-04afe5caf7af None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:37.904691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648ddc8-723a-43a7-85bb-04afe5caf7af None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:37.904962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648ddc8-723a-43a7-85bb-04afe5caf7af None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:37.905943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648ddc8-723a-43a7-85bb-04afe5caf7af None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:37.906256 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648ddc8-723a-43a7-85bb-04afe5caf7af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:37.907686 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648ddc8-723a-43a7-85bb-04afe5caf7af None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:37.928190 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 317/618] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 26 16:29:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:37.933628 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648ddc8-723a-43a7-85bb-04afe5caf7af None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:38.003263 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6368755-5c08-46f4-91dd-76851c38b663 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:38.060345 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648ddc8-723a-43a7-85bb-04afe5caf7af None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:38.093458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673d3c1-21a7-4f47-a01f-178c7d92d71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:38.094234 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673d3c1-21a7-4f47-a01f-178c7d92d71b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:38.094513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673d3c1-21a7-4f47-a01f-178c7d92d71b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:38.094793 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673d3c1-21a7-4f47-a01f-178c7d92d71b None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:38.095657 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673d3c1-21a7-4f47-a01f-178c7d92d71b None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:38.095968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673d3c1-21a7-4f47-a01f-178c7d92d71b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:38.097654 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673d3c1-21a7-4f47-a01f-178c7d92d71b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:38.099549 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ade88f-fee9-4417-a16b-0c40504cfb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:38.100418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ade88f-fee9-4417-a16b-0c40504cfb21 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:38.100761 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ade88f-fee9-4417-a16b-0c40504cfb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:38.101094 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ade88f-fee9-4417-a16b-0c40504cfb21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:38.113116 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ade88f-fee9-4417-a16b-0c40504cfb21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:38.115064 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ade88f-fee9-4417-a16b-0c40504cfb21 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:38.117234 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 302/619] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 16:29:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:38.122816 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673d3c1-21a7-4f47-a01f-178c7d92d71b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:38.124938 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:38.139601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-78ade88f-fee9-4417-a16b-0c40504cfb21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:38.139601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:38.139601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:38.139601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:38.139601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:38.139601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:38.139601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:38.139601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:38.139601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:38.139601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:38.139601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:38.139601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:38.139601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:38.139601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:38.139601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:38.140601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:38.140601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:38.140601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:38.140601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:38.140601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:38.140601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:38.140601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:38.140601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:38.140601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:38.140601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:38.140601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:38.140601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:38.140601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:38.140601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:38.140601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:38.140601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:38.140601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:38.141520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:38.141520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:38.141520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:38.141520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:38.142192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 318/620] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:38.150495 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ade88f-fee9-4417-a16b-0c40504cfb21 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:38.226716 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:38.312951 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673d3c1-21a7-4f47-a01f-178c7d92d71b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:38.330599 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ade88f-fee9-4417-a16b-0c40504cfb21 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:38.370363 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60b0de-bcd4-4179-9e82-9ae413496a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:38.371046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60b0de-bcd4-4179-9e82-9ae413496a8e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:38.371327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60b0de-bcd4-4179-9e82-9ae413496a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:38.371597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60b0de-bcd4-4179-9e82-9ae413496a8e None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:38.372341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60b0de-bcd4-4179-9e82-9ae413496a8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:38.372646 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60b0de-bcd4-4179-9e82-9ae413496a8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:38.374152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60b0de-bcd4-4179-9e82-9ae413496a8e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:38.389216 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 319/621] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:38.395755 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60b0de-bcd4-4179-9e82-9ae413496a8e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:38.398027 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd818e-d316-4e29-99db-64f8c9ab7bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:38.398984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd818e-d316-4e29-99db-64f8c9ab7bff None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:38.399275 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd818e-d316-4e29-99db-64f8c9ab7bff None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:38.399557 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd818e-d316-4e29-99db-64f8c9ab7bff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:38.412308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd818e-d316-4e29-99db-64f8c9ab7bff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:38.414035 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd818e-d316-4e29-99db-64f8c9ab7bff None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:38.447684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-32fd818e-d316-4e29-99db-64f8c9ab7bff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:38.447684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:38.447684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:38.447684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:38.447684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:38.447684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:38.447684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:38.447684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:38.447684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:38.447684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:38.447684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:38.447684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:38.447684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:38.447684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:38.447684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:38.448640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:38.448640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:38.448640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:38.448640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:38.448640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:38.448640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:38.448640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:38.448640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:38.448640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:38.448640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:38.448640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:38.448640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:38.448640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:38.448640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:38.448640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:38.448640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:38.448640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:38.449556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:38.449556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:38.449556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:38.449556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:38.453288 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 303/622] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:38.456835 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd818e-d316-4e29-99db-64f8c9ab7bff None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:38.467122 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:38.519431 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60b0de-bcd4-4179-9e82-9ae413496a8e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:38.564588 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921fcc7-8a57-4e84-953f-a910ffc09865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:38.565751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921fcc7-8a57-4e84-953f-a910ffc09865 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:38.565751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921fcc7-8a57-4e84-953f-a910ffc09865 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:38.566269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921fcc7-8a57-4e84-953f-a910ffc09865 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:38.579581 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921fcc7-8a57-4e84-953f-a910ffc09865 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:38.581658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921fcc7-8a57-4e84-953f-a910ffc09865 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:38.609300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-5921fcc7-8a57-4e84-953f-a910ffc09865 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:38.609300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:38.609300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:38.609300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:38.609300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:38.609300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:38.609300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:38.609300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:38.609300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:38.609300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:38.609300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:38.609300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:38.609300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:38.609300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:38.609300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:38.610292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:38.610292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:38.610292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:38.610292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:38.610292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:38.610292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:38.610292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:38.610292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:38.610292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:38.610292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:38.610292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:38.610292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:38.610292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:38.610292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:38.610292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:38.610292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:38.610292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:38.611228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:38.611228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:38.611228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:38.611228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:38.611228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:38.611228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:38.611228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:38.611228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:38.611228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 320/623] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:38.611228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bf80b-7230-4029-be09-e7fb24bff83e None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:38.611775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bf80b-7230-4029-be09-e7fb24bff83e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:38.611775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bf80b-7230-4029-be09-e7fb24bff83e None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:38.613360 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 321/624] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:38.614864 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4bf80b-7230-4029-be09-e7fb24bff83e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:38.635798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:38.639260 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd818e-d316-4e29-99db-64f8c9ab7bff None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:38.676615 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dd5cd-efc5-4b68-82cc-10db5172bade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:38.677311 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dd5cd-efc5-4b68-82cc-10db5172bade None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:38.677601 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dd5cd-efc5-4b68-82cc-10db5172bade None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:38.677880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dd5cd-efc5-4b68-82cc-10db5172bade None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:38.678602 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6dd5cd-efc5-4b68-82cc-10db5172bade None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:38.678906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6dd5cd-efc5-4b68-82cc-10db5172bade None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:38.680283 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6dd5cd-efc5-4b68-82cc-10db5172bade None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:38.693559 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 304/625] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:38.694905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc1d7e-7b21-45ba-864a-2aa9d584a114 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:38.695190 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc1d7e-7b21-45ba-864a-2aa9d584a114 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:38.695463 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc1d7e-7b21-45ba-864a-2aa9d584a114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:38.713552 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-35cc1d7e-7b21-45ba-864a-2aa9d584a114 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:38.714755 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-35cc1d7e-7b21-45ba-864a-2aa9d584a114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:38.723416 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4bf80b-7230-4029-be09-e7fb24bff83e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:38.746499 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:38.761897 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fab68-15e2-4cb3-9205-bbc26b80fd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:38.762581 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fab68-15e2-4cb3-9205-bbc26b80fd38 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:38.762862 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fab68-15e2-4cb3-9205-bbc26b80fd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:38.763144 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fab68-15e2-4cb3-9205-bbc26b80fd38 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:38.763934 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fab68-15e2-4cb3-9205-bbc26b80fd38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:38.764245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fab68-15e2-4cb3-9205-bbc26b80fd38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:38.765736 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fab68-15e2-4cb3-9205-bbc26b80fd38 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:38.783937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 322/626] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:29:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:38.784871 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fab68-15e2-4cb3-9205-bbc26b80fd38 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:38.793403 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 305/627] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:38.794263 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc1d7e-7b21-45ba-864a-2aa9d584a114 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:38.919101 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:38.930045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc1d7e-7b21-45ba-864a-2aa9d584a114 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:38.941224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fab68-15e2-4cb3-9205-bbc26b80fd38 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:38.981616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ff174-ce11-4a73-bca2-06344e5740d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:38.982220 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092e27d-7737-48ec-aa70-a623a6e6ab71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:38.982638 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ff174-ce11-4a73-bca2-06344e5740d1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:38.982990 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ff174-ce11-4a73-bca2-06344e5740d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:38.983359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ff174-ce11-4a73-bca2-06344e5740d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:38.983800 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092e27d-7737-48ec-aa70-a623a6e6ab71 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:38.984239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092e27d-7737-48ec-aa70-a623a6e6ab71 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:38.984657 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092e27d-7737-48ec-aa70-a623a6e6ab71 None admin] PATH_INFO: `/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/07cc455638fb4db4939af3657ab4203e/roles/d39d16b5286d4e1db63841f4917e08f2` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:38.993297 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ff174-ce11-4a73-bca2-06344e5740d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:38.994840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ff174-ce11-4a73-bca2-06344e5740d1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:39.006401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092e27d-7737-48ec-aa70-a623a6e6ab71 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3379cdd914747758e71b3b05c5921b1, user_id=07cc455638fb4db4939af3657ab4203e, role_id=d39d16b5286d4e1db63841f4917e08f2)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:39.008191 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092e27d-7737-48ec-aa70-a623a6e6ab71 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:39.011662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-354ff174-ce11-4a73-bca2-06344e5740d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:29:39.011662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:39.011662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:39.011662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:39.011662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:39.011662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:39.011662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:39.011662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:39.011662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:39.011662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:39.011662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:39.011662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:39.011662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:39.011662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:39.011662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:39.011662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:39.012853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:39.012853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:39.012853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:39.012853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:39.012853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:39.012853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:39.012853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:39.012853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:39.012853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:39.012853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:39.012853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:39.012853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:39.012853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:39.012853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:39.012853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:39.012853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:39.012853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:39.012853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:39.013982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:39.013982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:39.013982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:39.013982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:39.013982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:39.013982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:39.013982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:39.013982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:39.013982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:29:39.013982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:39.013982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 323/628] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 26 16:29:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:39.014656 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ff174-ce11-4a73-bca2-06344e5740d1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:39.065321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:39.125160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 306/629] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:29:38 2022] PUT /identity/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/07cc455638fb4db4939af3657ab4203e/roles/d39d16b5286d4e1db63841f4917e08f2 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:29:39.127279 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092e27d-7737-48ec-aa70-a623a6e6ab71 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:39.169755 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ff174-ce11-4a73-bca2-06344e5740d1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:39.263328 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137012bf-b56b-404a-9f59-eef6682426c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:39.264641 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137012bf-b56b-404a-9f59-eef6682426c0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:39.265146 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137012bf-b56b-404a-9f59-eef6682426c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:39.265656 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137012bf-b56b-404a-9f59-eef6682426c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:39.284485 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137012bf-b56b-404a-9f59-eef6682426c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:39.301554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-137012bf-b56b-404a-9f59-eef6682426c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:39.301554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:39.301554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:39.301554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:39.301554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:39.301554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:39.301554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:39.301554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:39.301554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:39.301554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:39.301554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:39.301554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:39.301554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:39.301554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:39.301554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:39.301554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:39.302571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:39.302571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:39.302571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:39.302571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:39.302571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:39.302571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:39.302571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:39.302571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:39.302571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:39.302571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:39.302571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:39.302571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:39.302571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:39.302571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:39.302571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:39.302571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:39.303432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:39.303432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:39.303432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:39.303432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:39.303432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:39.303432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:39.303432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:39.303432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:39.303432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:39.303432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:39.303432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:39.303432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:39.314743 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 324/630] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:29:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:39.315878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092e27d-7737-48ec-aa70-a623a6e6ab71 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:39.320607 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137012bf-b56b-404a-9f59-eef6682426c0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:39.356179 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679cc96-a018-44cf-a5f9-2db5ff88d033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:39.356812 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679cc96-a018-44cf-a5f9-2db5ff88d033 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:39.357091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679cc96-a018-44cf-a5f9-2db5ff88d033 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:39.357506 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679cc96-a018-44cf-a5f9-2db5ff88d033 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:39.358263 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679cc96-a018-44cf-a5f9-2db5ff88d033 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:39.358625 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679cc96-a018-44cf-a5f9-2db5ff88d033 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:39.360184 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679cc96-a018-44cf-a5f9-2db5ff88d033 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:39.370992 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:39.383008 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 307/631] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 26 16:29:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:39.384432 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8d546-92bd-4f32-b43a-534f5e21783e None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:39.384714 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8d546-92bd-4f32-b43a-534f5e21783e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:39.391496 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8d546-92bd-4f32-b43a-534f5e21783e None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:39.391496 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 308/632] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:39.391496 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8d546-92bd-4f32-b43a-534f5e21783e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:39.484582 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:39.490143 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137012bf-b56b-404a-9f59-eef6682426c0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:39.539835 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8d546-92bd-4f32-b43a-534f5e21783e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:39.543063 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585257a-b2f0-4f11-8ad9-96e5c5008cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:39.544808 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585257a-b2f0-4f11-8ad9-96e5c5008cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:39.545099 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585257a-b2f0-4f11-8ad9-96e5c5008cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:39.545410 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585257a-b2f0-4f11-8ad9-96e5c5008cc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:39.546184 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585257a-b2f0-4f11-8ad9-96e5c5008cc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:39.546497 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585257a-b2f0-4f11-8ad9-96e5c5008cc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:39.547887 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585257a-b2f0-4f11-8ad9-96e5c5008cc6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:39.560370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 325/633] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 16:29:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:39.565062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675676c-9225-4a84-8b4d-429d6e6fb910 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:39.565062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675676c-9225-4a84-8b4d-429d6e6fb910 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:39.565062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675676c-9225-4a84-8b4d-429d6e6fb910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:39.587226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fe3e1-2212-40ca-bdfc-9061ca1d42b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:39.587422 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f675676c-9225-4a84-8b4d-429d6e6fb910 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:39.588288 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fe3e1-2212-40ca-bdfc-9061ca1d42b2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:39.588418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f675676c-9225-4a84-8b4d-429d6e6fb910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:39.588872 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fe3e1-2212-40ca-bdfc-9061ca1d42b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:39.589370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fe3e1-2212-40ca-bdfc-9061ca1d42b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:39.678799 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 326/634] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:39.679779 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675676c-9225-4a84-8b4d-429d6e6fb910 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:39.689697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:39.696150 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fe3e1-2212-40ca-bdfc-9061ca1d42b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:39.699481 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fe3e1-2212-40ca-bdfc-9061ca1d42b2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:39.825128 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:39.846926 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 309/635] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:29:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:39.847132 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675676c-9225-4a84-8b4d-429d6e6fb910 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:39.847244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c64e61-5a9f-4679-b324-b1d837f87cb6 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:39.847244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c64e61-5a9f-4679-b324-b1d837f87cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:39.847244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c64e61-5a9f-4679-b324-b1d837f87cb6 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:39.847244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 310/636] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:39.847244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c64e61-5a9f-4679-b324-b1d837f87cb6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:39.885911 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d6b1d-9e31-4794-8486-634aab27e675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:39.887043 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d6b1d-9e31-4794-8486-634aab27e675 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:39.887512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d6b1d-9e31-4794-8486-634aab27e675 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:39.887946 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d6b1d-9e31-4794-8486-634aab27e675 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:39.900826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d6b1d-9e31-4794-8486-634aab27e675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:39.902290 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d6b1d-9e31-4794-8486-634aab27e675 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:39.921828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-707d6b1d-9e31-4794-8486-634aab27e675 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:39.921828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:39.921828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:39.921828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:39.921828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:39.921828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:39.921828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:39.921828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:39.921828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:39.921828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:39.921828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:39.921828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:39.921828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:39.921828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:39.921828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:39.922811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:39.922811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:39.922811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:39.922811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:39.922811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:39.922811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:39.922811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:39.922811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:39.922811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:39.922811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:39.922811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:39.922811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:39.922811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:39.922811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:39.922811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:39.922811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:39.922811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:39.924489 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:39.924489 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:39.924489 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:39.924489 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:39.924489 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 327/637] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:39.924489 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d6b1d-9e31-4794-8486-634aab27e675 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:39.963689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:39.968760 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c64e61-5a9f-4679-b324-b1d837f87cb6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:40.009458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addae06f-c58e-4eaa-8abc-f007b07ae13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:40.010289 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addae06f-c58e-4eaa-8abc-f007b07ae13c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:40.010933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addae06f-c58e-4eaa-8abc-f007b07ae13c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:40.011210 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addae06f-c58e-4eaa-8abc-f007b07ae13c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:40.023406 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addae06f-c58e-4eaa-8abc-f007b07ae13c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:40.031451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-addae06f-c58e-4eaa-8abc-f007b07ae13c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:40.031451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:40.031451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:40.031451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:40.031451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:40.031451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:40.031451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:40.031451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:40.031451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:40.031451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:40.031451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:40.031451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:40.031451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:40.031451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:40.031451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:40.031451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:40.032477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:40.032477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:40.032477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:40.032477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:40.032477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:40.032477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:40.032477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:40.032477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:40.032477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:40.032477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:40.032477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:40.032477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:40.032477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:40.032477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:40.032477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:40.032477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:40.033880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:40.033880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:40.033880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:40.033880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:40.033880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:40.033880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:40.033880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:40.033880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:40.033880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:40.033880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:40.033880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:40.033880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:40.033880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 311/638] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:29:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:40.034579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494f60a-1e8a-489f-a230-7e58383f84f4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:40.034992 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494f60a-1e8a-489f-a230-7e58383f84f4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:40.035113 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494f60a-1e8a-489f-a230-7e58383f84f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:40.051870 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d6b1d-9e31-4794-8486-634aab27e675 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:40.059012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2494f60a-1e8a-489f-a230-7e58383f84f4 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:40.060929 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2494f60a-1e8a-489f-a230-7e58383f84f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:40.099229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad441766-56e0-42e9-8994-16a57dc6ec63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:40.099956 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad441766-56e0-42e9-8994-16a57dc6ec63 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:40.100240 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad441766-56e0-42e9-8994-16a57dc6ec63 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:40.100514 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad441766-56e0-42e9-8994-16a57dc6ec63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:40.111951 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad441766-56e0-42e9-8994-16a57dc6ec63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:40.113478 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad441766-56e0-42e9-8994-16a57dc6ec63 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:40.116972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:40.138292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-ad441766-56e0-42e9-8994-16a57dc6ec63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:40.138292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:40.138292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:40.138292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:40.138292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:40.138292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:40.138292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:40.138292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:40.138292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:40.138292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:40.138292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:40.138292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:40.138292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:40.138292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:40.138292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:40.139678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:40.139678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:40.139678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:40.139678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:40.139678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:40.139678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:40.139678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:40.139678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:40.139678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:40.139678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:40.139678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:40.139678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:40.139678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:40.139678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:40.139678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:40.139678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:40.139678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:40.150306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:40.150306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:40.150306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:40.150306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:40.150539 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 312/639] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:40.150539 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494f60a-1e8a-489f-a230-7e58383f84f4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:40.150681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 328/640] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:40.150681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad441766-56e0-42e9-8994-16a57dc6ec63 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:40.239133 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:40.252545 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494f60a-1e8a-489f-a230-7e58383f84f4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:40.268176 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad441766-56e0-42e9-8994-16a57dc6ec63 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:40.293341 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48994ca-7dc1-4e02-8bce-bb5983166c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:40.294011 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48994ca-7dc1-4e02-8bce-bb5983166c2a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:40.294291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48994ca-7dc1-4e02-8bce-bb5983166c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:40.294562 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48994ca-7dc1-4e02-8bce-bb5983166c2a None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:40.295302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48994ca-7dc1-4e02-8bce-bb5983166c2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:40.295602 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48994ca-7dc1-4e02-8bce-bb5983166c2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:40.296979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48994ca-7dc1-4e02-8bce-bb5983166c2a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:40.304945 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ebc22-bc97-488e-9996-4da4d37d86c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:40.305658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ebc22-bc97-488e-9996-4da4d37d86c1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:40.305942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ebc22-bc97-488e-9996-4da4d37d86c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:40.306214 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ebc22-bc97-488e-9996-4da4d37d86c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:40.306970 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ebc22-bc97-488e-9996-4da4d37d86c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:40.307268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ebc22-bc97-488e-9996-4da4d37d86c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:40.308662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ebc22-bc97-488e-9996-4da4d37d86c1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:40.317859 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 313/641] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:40.317859 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48994ca-7dc1-4e02-8bce-bb5983166c2a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:40.320417 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 329/642] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 16:29:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:40.321607 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ebc22-bc97-488e-9996-4da4d37d86c1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:40.393654 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:40.438203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ebc22-bc97-488e-9996-4da4d37d86c1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:40.441381 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48994ca-7dc1-4e02-8bce-bb5983166c2a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:40.477248 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e89d6a-2810-40c8-945e-11f9858ddeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:40.478639 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e89d6a-2810-40c8-945e-11f9858ddeca None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:40.479536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e89d6a-2810-40c8-945e-11f9858ddeca None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:40.480262 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e89d6a-2810-40c8-945e-11f9858ddeca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:40.483964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569e1f1-0acd-4f9f-8caf-d8407937a9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:40.484628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569e1f1-0acd-4f9f-8caf-d8407937a9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:40.484907 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569e1f1-0acd-4f9f-8caf-d8407937a9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:40.485182 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569e1f1-0acd-4f9f-8caf-d8407937a9a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:40.486457 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569e1f1-0acd-4f9f-8caf-d8407937a9a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:40.486758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569e1f1-0acd-4f9f-8caf-d8407937a9a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:40.488176 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569e1f1-0acd-4f9f-8caf-d8407937a9a0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:40.494880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e89d6a-2810-40c8-945e-11f9858ddeca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:40.501251 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 314/643] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:40.502707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569e1f1-0acd-4f9f-8caf-d8407937a9a0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:40.505306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-14e89d6a-2810-40c8-945e-11f9858ddeca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:40.505306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:40.505306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:40.505306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:40.505306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:40.505306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:40.505306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:40.505306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:40.505306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:40.505306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:40.505306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:40.505306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:40.505306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:40.505306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:40.505306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:40.505306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:40.506520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:40.506520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:40.506520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:40.506520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:40.506520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:40.506520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:40.506520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:40.506520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:40.506520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:40.506520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:40.506520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:40.506520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:40.506520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:40.506520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:40.506520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:40.506520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:40.507512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:40.507512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:40.507512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:40.507512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:40.507512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:40.507512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:40.507512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:40.507512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:40.507512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:40.507512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:40.507512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:40.507512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:40.507512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 330/644] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:29:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:40.508361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e89d6a-2810-40c8-945e-11f9858ddeca None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:40.524981 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:40.623117 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e89d6a-2810-40c8-945e-11f9858ddeca None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:40.632521 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569e1f1-0acd-4f9f-8caf-d8407937a9a0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:40.642077 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:40.663594 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9bc42-117a-47ad-9493-465f0659e9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:40.664336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9bc42-117a-47ad-9493-465f0659e9cd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:40.664889 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9bc42-117a-47ad-9493-465f0659e9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:40.664889 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9bc42-117a-47ad-9493-465f0659e9cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:40.675866 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ff352-0dcd-4279-b55c-0b04c29ab446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:40.676317 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9bc42-117a-47ad-9493-465f0659e9cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:40.677115 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ff352-0dcd-4279-b55c-0b04c29ab446 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:40.677427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ff352-0dcd-4279-b55c-0b04c29ab446 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:40.677697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ff352-0dcd-4279-b55c-0b04c29ab446 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:40.678054 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9bc42-117a-47ad-9493-465f0659e9cd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:40.686792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ff352-0dcd-4279-b55c-0b04c29ab446 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:40.688678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ff352-0dcd-4279-b55c-0b04c29ab446 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:40.698515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-dbb9bc42-117a-47ad-9493-465f0659e9cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:40.698515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:40.698515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:40.698515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:40.698515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:40.698515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:40.698515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:40.698515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:40.698515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:40.698515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:40.698515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:40.698515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:40.698515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:40.698515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:40.698515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:40.699695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:40.699695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:40.699695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:40.699695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:40.699695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:40.699695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:40.699695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:40.699695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:40.699695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:40.699695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:40.699695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:40.699695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:40.699695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:40.699695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:40.699695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:40.699695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:40.699695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:40.700932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:40.700932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:40.700932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:40.700932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:40.702882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 331/645] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:40.703950 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9bc42-117a-47ad-9493-465f0659e9cd None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:40.705482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-168ff352-0dcd-4279-b55c-0b04c29ab446 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 16:29:40.705482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:40.705482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:40.705482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:40.705482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:40.705482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:40.705482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:40.705482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:40.705482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:40.705482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:40.705482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:40.705482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:40.705482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:40.705482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:40.705482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:40.705482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:40.706401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:40.706401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:40.706401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:40.706401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:40.706401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:40.706401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:40.706401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:40.706401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:40.706401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:40.706401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:40.706401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:40.706401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:40.706401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:40.706401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:40.706401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:40.706401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:40.706401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:40.706401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:40.707427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:40.707427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:40.707427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:40.707427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:40.707427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:40.707427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:40.707427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:40.707427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:40.707427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 16:29:40.707427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:40.711538 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 315/646] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:29:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:40.712440 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ff352-0dcd-4279-b55c-0b04c29ab446 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:40.793465 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:40.823373 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9bc42-117a-47ad-9493-465f0659e9cd None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:40.829305 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ff352-0dcd-4279-b55c-0b04c29ab446 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:40.865506 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56eff6-9d18-44a2-ace5-e0e6bcda54e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:40.866621 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56eff6-9d18-44a2-ace5-e0e6bcda54e7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:40.867103 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56eff6-9d18-44a2-ace5-e0e6bcda54e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:40.867571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56eff6-9d18-44a2-ace5-e0e6bcda54e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:40.870866 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2ed00-7961-4330-b8c6-a1dabc06d233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:40.871550 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2ed00-7961-4330-b8c6-a1dabc06d233 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:40.871833 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2ed00-7961-4330-b8c6-a1dabc06d233 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:40.872110 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2ed00-7961-4330-b8c6-a1dabc06d233 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:40.872863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2ed00-7961-4330-b8c6-a1dabc06d233 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:40.873171 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2ed00-7961-4330-b8c6-a1dabc06d233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:40.874601 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2ed00-7961-4330-b8c6-a1dabc06d233 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:40.877197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56eff6-9d18-44a2-ace5-e0e6bcda54e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:40.878931 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56eff6-9d18-44a2-ace5-e0e6bcda54e7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:40.885014 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 316/647] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 16:29:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:40.885896 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2ed00-7961-4330-b8c6-a1dabc06d233 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:40.895907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-8a56eff6-9d18-44a2-ace5-e0e6bcda54e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:40.895907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:40.895907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:40.895907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:40.895907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:40.895907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:40.895907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:40.895907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:40.895907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:40.895907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:40.895907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:40.895907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:40.895907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:40.895907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:40.895907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:40.896894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:40.896894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:40.896894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:40.896894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:40.896894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:40.896894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:40.896894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:40.896894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:40.896894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:40.896894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:40.896894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:40.896894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:40.896894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:40.896894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:40.896894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:40.896894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:40.896894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:40.897844 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:40.897844 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:40.897844 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:40.897844 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:40.897844 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:40.897844 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:40.897844 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:40.897844 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:40.904904 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 332/648] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:40.904904 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56eff6-9d18-44a2-ace5-e0e6bcda54e7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:40.938511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:41.015159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2ed00-7961-4330-b8c6-a1dabc06d233 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:41.034957 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56eff6-9d18-44a2-ace5-e0e6bcda54e7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:41.056393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:41.064743 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d32c4e-2971-491e-b500-2e8e0c2a7ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:41.065849 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d32c4e-2971-491e-b500-2e8e0c2a7ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:41.066336 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d32c4e-2971-491e-b500-2e8e0c2a7ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:41.066863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d32c4e-2971-491e-b500-2e8e0c2a7ec4 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:41.071548 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d32c4e-2971-491e-b500-2e8e0c2a7ec4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:41.072322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d32c4e-2971-491e-b500-2e8e0c2a7ec4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:41.076347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d32c4e-2971-491e-b500-2e8e0c2a7ec4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:41.076592 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4d3d9-6b13-4287-b8e7-15238d4f6b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:41.077448 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4d3d9-6b13-4287-b8e7-15238d4f6b41 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:41.077793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4d3d9-6b13-4287-b8e7-15238d4f6b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:41.078128 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4d3d9-6b13-4287-b8e7-15238d4f6b41 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:41.079059 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4d3d9-6b13-4287-b8e7-15238d4f6b41 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:41.079363 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4d3d9-6b13-4287-b8e7-15238d4f6b41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:41.081341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4d3d9-6b13-4287-b8e7-15238d4f6b41 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:41.100644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 317/649] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:41.100644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d32c4e-2971-491e-b500-2e8e0c2a7ec4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:41.106518 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 333/650] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 26 16:29:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:41.107392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4d3d9-6b13-4287-b8e7-15238d4f6b41 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:41.213661 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:41.225966 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d32c4e-2971-491e-b500-2e8e0c2a7ec4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:41.227083 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4d3d9-6b13-4287-b8e7-15238d4f6b41 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:41.267548 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e4a17-490a-4e64-8bbf-c4dee565efed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:41.268355 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4d494-d891-4c26-9af8-ebe250214f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:41.268476 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e4a17-490a-4e64-8bbf-c4dee565efed None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:41.268661 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e4a17-490a-4e64-8bbf-c4dee565efed None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:41.268907 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e4a17-490a-4e64-8bbf-c4dee565efed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:41.269507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4d494-d891-4c26-9af8-ebe250214f45 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:41.269939 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4d494-d891-4c26-9af8-ebe250214f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:41.270427 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4d494-d891-4c26-9af8-ebe250214f45 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:41.271901 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4d494-d891-4c26-9af8-ebe250214f45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:41.273385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4d494-d891-4c26-9af8-ebe250214f45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:41.276702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4d494-d891-4c26-9af8-ebe250214f45 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:41.281837 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e4a17-490a-4e64-8bbf-c4dee565efed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:41.283339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e4a17-490a-4e64-8bbf-c4dee565efed None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:41.297195 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 334/651] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:29:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:41.298960 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4d494-d891-4c26-9af8-ebe250214f45 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:41.313084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-9d1e4a17-490a-4e64-8bbf-c4dee565efed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:41.313084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:41.313084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:41.313084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:41.313084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:41.313084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:41.313084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:41.313084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:41.313084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:41.313084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:41.313084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:41.313084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:41.313084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:41.313084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:41.313084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:41.314163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:41.314163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:41.314163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:41.314163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:41.314163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:41.314163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:41.314163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:41.314163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:41.314163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:41.314163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:41.314163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:41.314163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:41.314163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:41.314163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:41.314163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:41.314163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:41.314163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:41.315110 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:41.315110 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:41.315110 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:41.315110 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:41.315344 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 318/652] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:41.316760 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e4a17-490a-4e64-8bbf-c4dee565efed None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:41.388065 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:41.432704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4d494-d891-4c26-9af8-ebe250214f45 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:41.456821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e4a17-490a-4e64-8bbf-c4dee565efed None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:41.473879 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923235d6-6361-4102-a202-860c1071b228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:41.474616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923235d6-6361-4102-a202-860c1071b228 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:41.474893 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923235d6-6361-4102-a202-860c1071b228 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:41.475160 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923235d6-6361-4102-a202-860c1071b228 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:41.483704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923235d6-6361-4102-a202-860c1071b228 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:41.485360 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923235d6-6361-4102-a202-860c1071b228 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:41.494683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d7616-8bb6-4798-915e-c54d14269148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:41.495339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d7616-8bb6-4798-915e-c54d14269148 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:41.495689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d7616-8bb6-4798-915e-c54d14269148 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:41.495965 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d7616-8bb6-4798-915e-c54d14269148 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:41.500463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-923235d6-6361-4102-a202-860c1071b228 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:29:41.500463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:41.500463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:41.500463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:41.500463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:41.500463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:41.500463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:41.500463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:41.500463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:41.500463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:41.500463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:41.500463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:41.500463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:41.500463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:41.500463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:41.500463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:41.502171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:41.502171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:41.502171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:41.502171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:41.502171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:41.502171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:41.502171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:41.502171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:41.502171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:41.502171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:41.502171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:41.502171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:41.502171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:41.502171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:41.502171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:41.502171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:41.502171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:41.502171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:41.508629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:41.508629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:41.508629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:41.508629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:41.508629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:41.508629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:41.508629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:41.508629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:41.508629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:29:41.508629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:41.508629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 335/653] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:29:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:41.508629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923235d6-6361-4102-a202-860c1071b228 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:41.527049 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:41.580489 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d7616-8bb6-4798-915e-c54d14269148 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:41.582132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d7616-8bb6-4798-915e-c54d14269148 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:41.625537 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923235d6-6361-4102-a202-860c1071b228 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:41.660076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5fbd6-f893-4eea-9256-fd96936acb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:41.660840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5fbd6-f893-4eea-9256-fd96936acb1b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:41.661395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5fbd6-f893-4eea-9256-fd96936acb1b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:41.661674 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5fbd6-f893-4eea-9256-fd96936acb1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:41.662534 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5fbd6-f893-4eea-9256-fd96936acb1b None admin] RBAC: Adding query filter params (role.id=d39d16b5286d4e1db63841f4917e08f2, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=35c9fa9c29494ff9b1f749974dca2719) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:41.662842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5fbd6-f893-4eea-9256-fd96936acb1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:41.664285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5fbd6-f893-4eea-9256-fd96936acb1b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:41.670779 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 336/654] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:29:41 2022] GET /identity/v3/role_assignments?user.id=35c9fa9c29494ff9b1f749974dca2719&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=d39d16b5286d4e1db63841f4917e08f2 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:41.671590 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5fbd6-f893-4eea-9256-fd96936acb1b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:41.699104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 319/655] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:29:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:41.699104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d7616-8bb6-4798-915e-c54d14269148 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:41.710004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:41.769303 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:41.804673 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5fbd6-f893-4eea-9256-fd96936acb1b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:41.824298 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d7616-8bb6-4798-915e-c54d14269148 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:41.843899 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80597c-7c18-4f26-bfdd-468952c282cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:41.850765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80597c-7c18-4f26-bfdd-468952c282cb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:41.850765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80597c-7c18-4f26-bfdd-468952c282cb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:41.850765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80597c-7c18-4f26-bfdd-468952c282cb None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:41.850765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80597c-7c18-4f26-bfdd-468952c282cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:41.850765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80597c-7c18-4f26-bfdd-468952c282cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:41.850765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80597c-7c18-4f26-bfdd-468952c282cb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:41.868017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 337/656] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:41.868017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08590f-a547-4e1b-8c43-953ce1621cd0 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:41.868017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08590f-a547-4e1b-8c43-953ce1621cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:41.868017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08590f-a547-4e1b-8c43-953ce1621cd0 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:41.868017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 338/657] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:41.868017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08590f-a547-4e1b-8c43-953ce1621cd0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:41.870934 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea925e96-d641-4c87-aacf-16b0cdbe89c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:41.870934 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea925e96-d641-4c87-aacf-16b0cdbe89c1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:41.870934 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea925e96-d641-4c87-aacf-16b0cdbe89c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:41.871220 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea925e96-d641-4c87-aacf-16b0cdbe89c1 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:41.872271 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea925e96-d641-4c87-aacf-16b0cdbe89c1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:41.872592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea925e96-d641-4c87-aacf-16b0cdbe89c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:41.874200 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea925e96-d641-4c87-aacf-16b0cdbe89c1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:41.893721 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:41.906934 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 320/658] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 26 16:29:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:41.906934 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea925e96-d641-4c87-aacf-16b0cdbe89c1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:41.999805 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08590f-a547-4e1b-8c43-953ce1621cd0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:42.028397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea925e96-d641-4c87-aacf-16b0cdbe89c1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:42.032928 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:42.038442 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8dfdec-bab4-4f80-91f5-73925f78b884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:42.039483 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dfdec-bab4-4f80-91f5-73925f78b884 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:42.039860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dfdec-bab4-4f80-91f5-73925f78b884 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:42.040205 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dfdec-bab4-4f80-91f5-73925f78b884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:42.052276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8dfdec-bab4-4f80-91f5-73925f78b884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:42.054771 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8dfdec-bab4-4f80-91f5-73925f78b884 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:42.070491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2d0a4-81bb-4bbd-9996-0aabcf90b838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:42.071396 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2d0a4-81bb-4bbd-9996-0aabcf90b838 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:42.071630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2d0a4-81bb-4bbd-9996-0aabcf90b838 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:42.071897 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2d0a4-81bb-4bbd-9996-0aabcf90b838 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:42.080348 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2d0a4-81bb-4bbd-9996-0aabcf90b838 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:42.081833 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2d0a4-81bb-4bbd-9996-0aabcf90b838 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:42.084437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6e8dfdec-bab4-4f80-91f5-73925f78b884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:42.084437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:42.084437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:42.084437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:42.084437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:42.084437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:42.084437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:42.084437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:42.084437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:42.084437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:42.084437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:42.084437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:42.084437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:42.084437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:42.084437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:42.085540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:42.085540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:42.085540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:42.085540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:42.085540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:42.085540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:42.085540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:42.085540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:42.085540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:42.085540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:42.085540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:42.085540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:42.085540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:42.085540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:42.085540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:42.085540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:42.085540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:42.086591 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:42.086591 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:42.086591 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:42.086591 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:42.086899 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 339/659] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:42.088001 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c7eb1-129b-41b3-babd-3aeda67414c2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:42.088285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c7eb1-129b-41b3-babd-3aeda67414c2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:42.088559 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c7eb1-129b-41b3-babd-3aeda67414c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:42.103786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-71b2d0a4-81bb-4bbd-9996-0aabcf90b838 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:29:42.103786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:42.103786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:42.103786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:42.103786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:42.103786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:42.103786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:42.103786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:42.103786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:42.103786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:42.103786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:42.103786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:42.103786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:42.103786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:42.103786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:42.103786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:42.104821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:42.104821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:42.104821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:42.104821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:42.104821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:42.104821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:42.104821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:42.104821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:42.104821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:42.104821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:42.104821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:42.104821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:42.104821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:42.104821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:42.104821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:42.104821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:42.104821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:42.104821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:42.110368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:42.110368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:42.110368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:42.110368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:42.110368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:42.110368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:42.110368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:42.110368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:42.110368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:29:42.110368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:42.110368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 321/660] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:29:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:42.110368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2d0a4-81bb-4bbd-9996-0aabcf90b838 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:42.111711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1a8c7eb1-129b-41b3-babd-3aeda67414c2 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:42.112660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1a8c7eb1-129b-41b3-babd-3aeda67414c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:42.186112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:42.216728 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 340/661] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:42.216728 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c7eb1-129b-41b3-babd-3aeda67414c2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:42.253677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2d0a4-81bb-4bbd-9996-0aabcf90b838 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:42.293459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fa04f-70c0-48c8-a5dd-c088867061dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:42.294045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fa04f-70c0-48c8-a5dd-c088867061dd None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:42.294377 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fa04f-70c0-48c8-a5dd-c088867061dd None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:42.294650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fa04f-70c0-48c8-a5dd-c088867061dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:42.353410 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c7eb1-129b-41b3-babd-3aeda67414c2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:42.370188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:42.384239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fa04f-70c0-48c8-a5dd-c088867061dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:42.385864 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fa04f-70c0-48c8-a5dd-c088867061dd None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:42.396540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b913aa-a961-445e-a524-6b142cb54e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:42.397365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b913aa-a961-445e-a524-6b142cb54e41 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:42.397722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b913aa-a961-445e-a524-6b142cb54e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:42.398069 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b913aa-a961-445e-a524-6b142cb54e41 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:42.398889 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b913aa-a961-445e-a524-6b142cb54e41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:42.399264 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b913aa-a961-445e-a524-6b142cb54e41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:42.400719 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b913aa-a961-445e-a524-6b142cb54e41 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:42.418264 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 341/662] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:42.419221 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b913aa-a961-445e-a524-6b142cb54e41 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:42.455641 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:42.509706 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 322/663] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:29:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:42.509706 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fa04f-70c0-48c8-a5dd-c088867061dd None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:42.535602 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b913aa-a961-445e-a524-6b142cb54e41 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:42.573945 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35894a-d13c-4569-9ad6-eac1d8f3f95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:42.574744 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35894a-d13c-4569-9ad6-eac1d8f3f95a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:42.575310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35894a-d13c-4569-9ad6-eac1d8f3f95a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:42.575855 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35894a-d13c-4569-9ad6-eac1d8f3f95a None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:42.576714 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35894a-d13c-4569-9ad6-eac1d8f3f95a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:42.577029 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35894a-d13c-4569-9ad6-eac1d8f3f95a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:42.578714 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35894a-d13c-4569-9ad6-eac1d8f3f95a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:42.613029 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 342/664] 10.222.0.48 () {56 vars in 1139 bytes} [Thu May 26 16:29:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:42.614269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35894a-d13c-4569-9ad6-eac1d8f3f95a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:42.616207 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fa04f-70c0-48c8-a5dd-c088867061dd None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:42.648865 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:42.655406 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4501e25-5a9e-4dd2-a3d7-7cf9216864ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:42.656215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4501e25-5a9e-4dd2-a3d7-7cf9216864ba None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:42.661876 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4501e25-5a9e-4dd2-a3d7-7cf9216864ba None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:42.661876 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4501e25-5a9e-4dd2-a3d7-7cf9216864ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:42.669032 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4501e25-5a9e-4dd2-a3d7-7cf9216864ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:42.677119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d4501e25-5a9e-4dd2-a3d7-7cf9216864ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:42.677119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:42.677119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:42.677119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:42.677119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:42.677119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:42.677119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:42.677119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:42.677119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:42.677119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:42.677119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:42.677119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:42.677119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:42.677119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:42.677119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:42.677119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:42.678420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:42.678420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:42.678420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:42.678420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:42.678420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:42.678420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:42.678420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:42.678420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:42.678420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:42.678420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:42.678420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:42.678420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:42.678420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:42.678420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:42.678420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:42.678420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:42.679491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:42.679491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:42.679491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:42.679491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:42.679491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:42.679491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:42.679491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:42.679491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:42.679491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:42.679491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:42.679491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:42.679491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:42.683568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 323/665] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:29:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:42.684322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4501e25-5a9e-4dd2-a3d7-7cf9216864ba None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:42.708110 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:42.732855 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35894a-d13c-4569-9ad6-eac1d8f3f95a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:42.773018 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07882c8-9b46-4d33-88ed-b8370a9eaf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:42.773876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07882c8-9b46-4d33-88ed-b8370a9eaf49 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:42.774166 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07882c8-9b46-4d33-88ed-b8370a9eaf49 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:42.774437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07882c8-9b46-4d33-88ed-b8370a9eaf49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:42.782147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07882c8-9b46-4d33-88ed-b8370a9eaf49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:42.783669 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07882c8-9b46-4d33-88ed-b8370a9eaf49 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:42.798787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-b07882c8-9b46-4d33-88ed-b8370a9eaf49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:42.798787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:42.798787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:42.798787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:42.798787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:42.798787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:42.798787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:42.798787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:42.798787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:42.798787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:42.798787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:42.798787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:42.798787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:42.798787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:42.798787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:42.799826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:42.799826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:42.799826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:42.799826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:42.799826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:42.799826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:42.799826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:42.799826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:42.799826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:42.799826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:42.799826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:42.799826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:42.799826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:42.799826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:42.799826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:42.799826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:42.799826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:42.800758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:42.800758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:42.800758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:42.800758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:42.800758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:42.800758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:42.800758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:42.800758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:42.804790 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 343/666] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:42.805761 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07882c8-9b46-4d33-88ed-b8370a9eaf49 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:42.815527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4501e25-5a9e-4dd2-a3d7-7cf9216864ba None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:42.855450 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec793c5e-ff0f-4fba-aa6d-7a9f0262593d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:42.856488 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec793c5e-ff0f-4fba-aa6d-7a9f0262593d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:42.856776 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec793c5e-ff0f-4fba-aa6d-7a9f0262593d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:42.857050 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec793c5e-ff0f-4fba-aa6d-7a9f0262593d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:42.869280 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec793c5e-ff0f-4fba-aa6d-7a9f0262593d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:42.870800 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec793c5e-ff0f-4fba-aa6d-7a9f0262593d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:42.891053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-ec793c5e-ff0f-4fba-aa6d-7a9f0262593d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:42.891053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:42.891053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:42.891053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:42.891053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:42.891053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:42.891053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:42.891053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:42.891053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:42.891053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:42.891053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:42.891053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:42.891053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:42.891053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:42.891053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:42.892258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:42.892258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:42.892258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:42.892258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:42.892258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:42.892258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:42.892258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:42.892258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:42.892258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:42.892258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:42.892258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:42.892258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:42.892258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:42.892258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:42.892258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:42.892258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:42.892258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:42.893374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:42.893374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:42.893374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:42.893374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:42.897448 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 324/667] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:42.898373 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec793c5e-ff0f-4fba-aa6d-7a9f0262593d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:42.917845 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:42.927037 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07882c8-9b46-4d33-88ed-b8370a9eaf49 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:42.964089 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482f3c4-5792-43ec-b3d4-03013c876daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:42.965381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482f3c4-5792-43ec-b3d4-03013c876daf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:42.965989 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482f3c4-5792-43ec-b3d4-03013c876daf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:42.968933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482f3c4-5792-43ec-b3d4-03013c876daf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:42.980482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:43.017786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec793c5e-ff0f-4fba-aa6d-7a9f0262593d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:43.046632 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482f3c4-5792-43ec-b3d4-03013c876daf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:43.048927 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482f3c4-5792-43ec-b3d4-03013c876daf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:43.056340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42ed7c-1fe6-45a3-9e7e-3d6dbc76cf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:43.057021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42ed7c-1fe6-45a3-9e7e-3d6dbc76cf3c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:43.057331 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42ed7c-1fe6-45a3-9e7e-3d6dbc76cf3c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:43.057613 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42ed7c-1fe6-45a3-9e7e-3d6dbc76cf3c None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:43.058366 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42ed7c-1fe6-45a3-9e7e-3d6dbc76cf3c None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:43.058672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42ed7c-1fe6-45a3-9e7e-3d6dbc76cf3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:43.060054 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42ed7c-1fe6-45a3-9e7e-3d6dbc76cf3c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:43.077734 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 325/668] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 16:29:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:43.078706 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42ed7c-1fe6-45a3-9e7e-3d6dbc76cf3c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:43.162374 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:43.171870 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 344/669] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:29:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:43.172896 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482f3c4-5792-43ec-b3d4-03013c876daf None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:43.222954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42ed7c-1fe6-45a3-9e7e-3d6dbc76cf3c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:43.269973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd755b2-681d-456f-bed1-ae86b7499df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:43.270565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd755b2-681d-456f-bed1-ae86b7499df9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:43.270851 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd755b2-681d-456f-bed1-ae86b7499df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:43.271127 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd755b2-681d-456f-bed1-ae86b7499df9 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:43.271967 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd755b2-681d-456f-bed1-ae86b7499df9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:43.272318 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd755b2-681d-456f-bed1-ae86b7499df9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:43.273780 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd755b2-681d-456f-bed1-ae86b7499df9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:43.276137 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:43.284143 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482f3c4-5792-43ec-b3d4-03013c876daf None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:43.293507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 326/670] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:29:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:43.296859 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd755b2-681d-456f-bed1-ae86b7499df9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:43.323778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c752ce-2ab3-4646-8719-708858ea04f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:43.324596 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c752ce-2ab3-4646-8719-708858ea04f7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:43.325009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c752ce-2ab3-4646-8719-708858ea04f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:43.325422 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c752ce-2ab3-4646-8719-708858ea04f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:43.326253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c752ce-2ab3-4646-8719-708858ea04f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:43.326661 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c752ce-2ab3-4646-8719-708858ea04f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:43.328161 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c752ce-2ab3-4646-8719-708858ea04f7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:43.340998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 345/671] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:43.342051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c752ce-2ab3-4646-8719-708858ea04f7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:43.403978 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:43.414131 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd755b2-681d-456f-bed1-ae86b7499df9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:43.455421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fe3c0-5960-490c-8db5-bb41f9377a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:43.456493 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fe3c0-5960-490c-8db5-bb41f9377a80 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:43.456782 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fe3c0-5960-490c-8db5-bb41f9377a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:43.457060 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fe3c0-5960-490c-8db5-bb41f9377a80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:43.459888 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c752ce-2ab3-4646-8719-708858ea04f7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:43.468522 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fe3c0-5960-490c-8db5-bb41f9377a80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:43.470076 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fe3c0-5960-490c-8db5-bb41f9377a80 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:43.490888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-1b2fe3c0-5960-490c-8db5-bb41f9377a80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:43.490888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:43.490888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:43.490888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:43.490888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:43.490888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:43.490888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:43.490888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:43.490888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:43.490888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:43.490888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:43.490888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:43.490888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:43.490888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:43.490888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:43.491888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:43.491888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:43.491888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:43.491888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:43.491888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:43.491888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:43.491888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:43.491888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:43.491888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:43.491888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:43.491888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:43.491888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:43.491888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:43.491888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:43.491888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:43.491888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:43.491888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:43.492801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:43.492801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:43.492801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:43.492801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:43.492801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 327/672] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:43.493912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fe3c0-5960-490c-8db5-bb41f9377a80 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:43.504550 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895cf66-41e7-43b0-b28a-53babc2eac37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:43.505446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895cf66-41e7-43b0-b28a-53babc2eac37 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:43.505764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895cf66-41e7-43b0-b28a-53babc2eac37 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:43.506085 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895cf66-41e7-43b0-b28a-53babc2eac37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:43.519500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895cf66-41e7-43b0-b28a-53babc2eac37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:43.521126 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895cf66-41e7-43b0-b28a-53babc2eac37 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:43.541141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-b895cf66-41e7-43b0-b28a-53babc2eac37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:43.541141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:43.541141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:43.541141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:43.541141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:43.541141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:43.541141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:43.541141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:43.541141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:43.541141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:43.541141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:43.541141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:43.541141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:43.541141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:43.541141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:43.542168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:43.542168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:43.542168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:43.542168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:43.542168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:43.542168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:43.542168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:43.542168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:43.542168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:43.542168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:43.542168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:43.542168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:43.542168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:43.542168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:43.542168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:43.542168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:43.542168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:43.543110 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:43.543110 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:43.543110 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:43.543110 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:43.543110 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 346/673] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:43.543426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895cf66-41e7-43b0-b28a-53babc2eac37 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:43.551103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:43.615863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fe3c0-5960-490c-8db5-bb41f9377a80 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:43.658531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5588e98-d111-46c0-bd0f-2c0ddfac26f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:43.659204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5588e98-d111-46c0-bd0f-2c0ddfac26f4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:43.659524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5588e98-d111-46c0-bd0f-2c0ddfac26f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:43.659757 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5588e98-d111-46c0-bd0f-2c0ddfac26f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:43.660599 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5588e98-d111-46c0-bd0f-2c0ddfac26f4 None admin] RBAC: Adding query filter params (role.id=d39d16b5286d4e1db63841f4917e08f2, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=7701907eb3b24c3681352c91ad6a3aeb) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:43.660900 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5588e98-d111-46c0-bd0f-2c0ddfac26f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:43.662522 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5588e98-d111-46c0-bd0f-2c0ddfac26f4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:43.669411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 328/674] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:29:43 2022] GET /identity/v3/role_assignments?user.id=7701907eb3b24c3681352c91ad6a3aeb&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=d39d16b5286d4e1db63841f4917e08f2 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:43.672259 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895cf66-41e7-43b0-b28a-53babc2eac37 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:43.676039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:43.682402 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5588e98-d111-46c0-bd0f-2c0ddfac26f4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:43.727684 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1db77a-6c18-4027-b77f-bc3430c1639d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:43.729853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1db77a-6c18-4027-b77f-bc3430c1639d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:43.730739 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1db77a-6c18-4027-b77f-bc3430c1639d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:43.731464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1db77a-6c18-4027-b77f-bc3430c1639d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:43.750065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1db77a-6c18-4027-b77f-bc3430c1639d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:43.752135 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1db77a-6c18-4027-b77f-bc3430c1639d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:43.769626 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-8e1db77a-6c18-4027-b77f-bc3430c1639d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:43.769626 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:43.769626 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:43.769626 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:43.769626 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:43.769626 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:43.769626 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:43.769626 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:43.769626 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:43.769626 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:43.769626 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:43.769626 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:43.769626 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:43.769626 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:43.769626 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:43.770605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:43.770605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:43.770605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:43.770605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:43.770605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:43.770605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:43.770605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:43.770605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:43.770605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:43.770605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:43.770605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:43.770605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:43.770605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:43.770605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:43.770605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:43.770605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:43.770605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:43.771494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:43.771494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:43.771494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:43.771494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:43.771494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:43.771494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:43.771494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:43.771494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:43.776041 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 347/675] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:43.777038 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1db77a-6c18-4027-b77f-bc3430c1639d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:43.829495 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5588e98-d111-46c0-bd0f-2c0ddfac26f4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:43.848527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:43.881658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64d6d9-de45-445a-b8c3-6b8cc15fa23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:43.882349 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64d6d9-de45-445a-b8c3-6b8cc15fa23a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:43.883118 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64d6d9-de45-445a-b8c3-6b8cc15fa23a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:43.883118 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64d6d9-de45-445a-b8c3-6b8cc15fa23a None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:43.883641 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64d6d9-de45-445a-b8c3-6b8cc15fa23a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:43.883947 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64d6d9-de45-445a-b8c3-6b8cc15fa23a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:43.886715 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64d6d9-de45-445a-b8c3-6b8cc15fa23a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:43.907538 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 329/676] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:43.908451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64d6d9-de45-445a-b8c3-6b8cc15fa23a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:43.925626 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1db77a-6c18-4027-b77f-bc3430c1639d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:43.963380 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44518fc-a68a-404b-bdc4-befa5540ed35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:43.964061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44518fc-a68a-404b-bdc4-befa5540ed35 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:43.964347 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44518fc-a68a-404b-bdc4-befa5540ed35 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:43.964627 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44518fc-a68a-404b-bdc4-befa5540ed35 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:43.965435 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44518fc-a68a-404b-bdc4-befa5540ed35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:43.965743 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44518fc-a68a-404b-bdc4-befa5540ed35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:43.967138 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44518fc-a68a-404b-bdc4-befa5540ed35 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:43.981010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 348/677] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:43.981995 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44518fc-a68a-404b-bdc4-befa5540ed35 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:44.012479 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:44.056216 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64d6d9-de45-445a-b8c3-6b8cc15fa23a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:44.101564 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31d97a-53f9-44f6-ad9d-51d7d3d3c97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:44.102558 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31d97a-53f9-44f6-ad9d-51d7d3d3c97b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:44.102847 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31d97a-53f9-44f6-ad9d-51d7d3d3c97b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:44.103121 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31d97a-53f9-44f6-ad9d-51d7d3d3c97b None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:44.103951 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31d97a-53f9-44f6-ad9d-51d7d3d3c97b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:44.104260 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31d97a-53f9-44f6-ad9d-51d7d3d3c97b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:44.106530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31d97a-53f9-44f6-ad9d-51d7d3d3c97b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:44.118821 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44518fc-a68a-404b-bdc4-befa5540ed35 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:44.125041 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 330/678] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:29:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:44.125041 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31d97a-53f9-44f6-ad9d-51d7d3d3c97b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:44.164322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:44.169786 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91dbc9-2c21-4562-8628-d83f58d8945c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:44.170771 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91dbc9-2c21-4562-8628-d83f58d8945c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:44.171049 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91dbc9-2c21-4562-8628-d83f58d8945c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:44.171320 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91dbc9-2c21-4562-8628-d83f58d8945c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:44.180915 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91dbc9-2c21-4562-8628-d83f58d8945c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:44.182322 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91dbc9-2c21-4562-8628-d83f58d8945c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:44.197668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-4a91dbc9-2c21-4562-8628-d83f58d8945c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:29:44.197668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:44.197668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:44.197668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:44.197668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:44.197668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:44.197668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:44.197668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:44.197668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:44.197668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:44.197668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:44.197668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:44.197668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:44.197668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:44.197668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:44.197668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:44.198723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:44.198723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:44.198723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:44.198723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:44.198723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:44.198723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:44.198723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:44.198723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:44.198723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:44.198723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:44.198723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:44.198723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:44.198723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:44.198723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:44.198723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:44.198723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:44.198723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:44.198723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:44.199702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:44.199702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:44.199702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:44.199702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:44.199702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:44.199702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:44.199702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:44.199702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:44.199702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:29:44.199702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:44.199702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 349/679] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:29:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:44.200861 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f57a34-e25f-4367-89f1-cfe46536f4b4 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:44.200861 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f57a34-e25f-4367-89f1-cfe46536f4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:44.200861 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f57a34-e25f-4367-89f1-cfe46536f4b4 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:44.202199 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 350/680] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:44.202719 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f57a34-e25f-4367-89f1-cfe46536f4b4 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:44.255172 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31d97a-53f9-44f6-ad9d-51d7d3d3c97b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:44.292124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbf7e6-81d6-4b2b-8a6b-3474c6fa0b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:44.292922 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbf7e6-81d6-4b2b-8a6b-3474c6fa0b2d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:44.293197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbf7e6-81d6-4b2b-8a6b-3474c6fa0b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:44.293490 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbf7e6-81d6-4b2b-8a6b-3474c6fa0b2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:44.299591 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:44.302062 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbf7e6-81d6-4b2b-8a6b-3474c6fa0b2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:44.303671 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbf7e6-81d6-4b2b-8a6b-3474c6fa0b2d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:44.319337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-6bfbf7e6-81d6-4b2b-8a6b-3474c6fa0b2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:44.319337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:44.319337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:44.319337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:44.319337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:44.319337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:44.319337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:44.319337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:44.319337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:44.319337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:44.319337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:44.319337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:44.319337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:44.319337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:44.319337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:44.320953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:44.320953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:44.320953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:44.320953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:44.320953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:44.320953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:44.320953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:44.320953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:44.320953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:44.320953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:44.320953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:44.320953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:44.320953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:44.320953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:44.320953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:44.320953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:44.320953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:44.322201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:44.322201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:44.322201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:44.322201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:44.322201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:44.322201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:44.322201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:44.322201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:44.323740 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f57a34-e25f-4367-89f1-cfe46536f4b4 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:44.326862 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 331/681] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:44.327757 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbf7e6-81d6-4b2b-8a6b-3474c6fa0b2d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:44.364359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a4e9e-10ec-4d0b-9d00-a4b22ddcf976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:44.365489 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a4e9e-10ec-4d0b-9d00-a4b22ddcf976 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:44.365778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a4e9e-10ec-4d0b-9d00-a4b22ddcf976 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:44.366154 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a4e9e-10ec-4d0b-9d00-a4b22ddcf976 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:44.367150 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a4e9e-10ec-4d0b-9d00-a4b22ddcf976 None admin] RBAC: Adding query filter params (role.id=d39d16b5286d4e1db63841f4917e08f2, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=8be9c9fb92c049c18a54b25725a34a74) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:44.367465 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a4e9e-10ec-4d0b-9d00-a4b22ddcf976 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:44.368943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a4e9e-10ec-4d0b-9d00-a4b22ddcf976 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:44.385308 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 351/682] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:29:44 2022] GET /identity/v3/role_assignments?user.id=8be9c9fb92c049c18a54b25725a34a74&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=d39d16b5286d4e1db63841f4917e08f2 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:44.385308 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c221c-bc81-4c09-96bc-3bd418f84fe5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:44.385308 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c221c-bc81-4c09-96bc-3bd418f84fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:44.385308 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c221c-bc81-4c09-96bc-3bd418f84fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:44.410247 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-195c221c-bc81-4c09-96bc-3bd418f84fe5 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:44.411963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-195c221c-bc81-4c09-96bc-3bd418f84fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:44.461068 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:44.479697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbf7e6-81d6-4b2b-8a6b-3474c6fa0b2d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:44.516331 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 352/683] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:44.518187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c221c-bc81-4c09-96bc-3bd418f84fe5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:44.530923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3376e5-5b66-4a58-b85c-b5fb5c648862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:44.531622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3376e5-5b66-4a58-b85c-b5fb5c648862 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:44.531905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3376e5-5b66-4a58-b85c-b5fb5c648862 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:44.532179 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3376e5-5b66-4a58-b85c-b5fb5c648862 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:44.533084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3376e5-5b66-4a58-b85c-b5fb5c648862 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:44.533454 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3376e5-5b66-4a58-b85c-b5fb5c648862 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:44.534956 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3376e5-5b66-4a58-b85c-b5fb5c648862 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:44.557632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 332/684] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 26 16:29:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:44.563366 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3376e5-5b66-4a58-b85c-b5fb5c648862 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:44.644070 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:44.677430 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c221c-bc81-4c09-96bc-3bd418f84fe5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:44.707974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3376e5-5b66-4a58-b85c-b5fb5c648862 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:44.722162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b87c6a-d3cd-4b3b-80da-c4f94ccad5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:44.723215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b87c6a-d3cd-4b3b-80da-c4f94ccad5ca None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:44.723801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b87c6a-d3cd-4b3b-80da-c4f94ccad5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:44.724291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b87c6a-d3cd-4b3b-80da-c4f94ccad5ca None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:44.725339 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b87c6a-d3cd-4b3b-80da-c4f94ccad5ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:44.725891 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b87c6a-d3cd-4b3b-80da-c4f94ccad5ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:44.727729 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b87c6a-d3cd-4b3b-80da-c4f94ccad5ca None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:44.746716 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 353/685] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:29:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:44.746716 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b87c6a-d3cd-4b3b-80da-c4f94ccad5ca None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:44.753323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93379620-4721-4166-8d44-17d2121f219d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:44.754503 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93379620-4721-4166-8d44-17d2121f219d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:44.754999 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93379620-4721-4166-8d44-17d2121f219d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:44.755482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93379620-4721-4166-8d44-17d2121f219d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:44.781852 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:44.849533 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93379620-4721-4166-8d44-17d2121f219d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:44.851882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93379620-4721-4166-8d44-17d2121f219d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:44.884130 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b87c6a-d3cd-4b3b-80da-c4f94ccad5ca None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:44.935328 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786df83-067a-41e2-af20-58a5bf4db9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:44.936542 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786df83-067a-41e2-af20-58a5bf4db9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:44.937054 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786df83-067a-41e2-af20-58a5bf4db9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:44.937584 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786df83-067a-41e2-af20-58a5bf4db9e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:44.946010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:44.951242 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786df83-067a-41e2-af20-58a5bf4db9e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:44.960359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-8786df83-067a-41e2-af20-58a5bf4db9e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:44.960359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:44.960359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:44.960359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:44.960359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:44.960359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:44.960359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:44.960359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:44.960359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:44.960359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:44.960359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:44.960359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:44.960359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:44.960359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:44.960359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:44.960359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:44.965629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:44.965629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:44.965629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:44.965629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:44.965629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:44.965629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:44.965629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:44.965629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:44.965629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:44.965629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:44.965629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:44.965629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:44.965629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:44.965629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:44.965629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:44.965629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:44.966486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:44.966486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:44.966486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:44.966486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:44.966486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:44.966486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:44.966486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:44.966486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:44.966486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:44.966486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:44.966486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:44.966486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:44.966486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 354/686] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:29:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:44.966486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786df83-067a-41e2-af20-58a5bf4db9e6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:44.993494 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 333/687] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:29:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:29:44.994677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93379620-4721-4166-8d44-17d2121f219d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:45.054046 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:45.100837 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786df83-067a-41e2-af20-58a5bf4db9e6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:45.130000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93379620-4721-4166-8d44-17d2121f219d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:45.160365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7c688-e2ca-4e3f-9125-ed8847ba5ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:45.161790 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7c688-e2ca-4e3f-9125-ed8847ba5ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:45.162296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7c688-e2ca-4e3f-9125-ed8847ba5ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:45.162804 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7c688-e2ca-4e3f-9125-ed8847ba5ee0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:45.164369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7c688-e2ca-4e3f-9125-ed8847ba5ee0 None admin] RBAC: Adding query filter params (role.id=d39d16b5286d4e1db63841f4917e08f2, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=d577b5295f9e4a4388bb6293d1c33d0b) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:45.165405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7c688-e2ca-4e3f-9125-ed8847ba5ee0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:45.167449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7c688-e2ca-4e3f-9125-ed8847ba5ee0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:45.179072 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 355/688] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:29:44 2022] GET /identity/v3/role_assignments?user.id=d577b5295f9e4a4388bb6293d1c33d0b&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=d39d16b5286d4e1db63841f4917e08f2 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:45.181225 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7c688-e2ca-4e3f-9125-ed8847ba5ee0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:45.183115 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c444c57-f316-481d-8e83-939a7652686b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:45.183924 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c444c57-f316-481d-8e83-939a7652686b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:45.184246 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c444c57-f316-481d-8e83-939a7652686b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:45.184567 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c444c57-f316-481d-8e83-939a7652686b None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:45.185494 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c444c57-f316-481d-8e83-939a7652686b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:45.185805 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c444c57-f316-481d-8e83-939a7652686b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:45.189940 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c444c57-f316-481d-8e83-939a7652686b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:45.202729 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 334/689] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:29:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:45.209383 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c444c57-f316-481d-8e83-939a7652686b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:45.290989 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:45.386873 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c444c57-f316-481d-8e83-939a7652686b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:45.401687 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:45.406080 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7c688-e2ca-4e3f-9125-ed8847ba5ee0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:45.434132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c680a9e-0706-4fe2-9af3-dd2ad2dccf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:45.435366 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c680a9e-0706-4fe2-9af3-dd2ad2dccf6c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:45.435923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c680a9e-0706-4fe2-9af3-dd2ad2dccf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:45.436411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c680a9e-0706-4fe2-9af3-dd2ad2dccf6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:45.466585 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c680a9e-0706-4fe2-9af3-dd2ad2dccf6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:45.468232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c680a9e-0706-4fe2-9af3-dd2ad2dccf6c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:45.492529 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf2efd-5ca7-45b9-8567-5175b211ccc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:45.493807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf2efd-5ca7-45b9-8567-5175b211ccc4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:45.495374 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf2efd-5ca7-45b9-8567-5175b211ccc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:45.496472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf2efd-5ca7-45b9-8567-5175b211ccc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:45.513716 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf2efd-5ca7-45b9-8567-5175b211ccc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:45.515707 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf2efd-5ca7-45b9-8567-5175b211ccc4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:45.517902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-9c680a9e-0706-4fe2-9af3-dd2ad2dccf6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:45.517902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:45.517902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:45.517902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:45.517902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:45.517902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:45.517902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:45.517902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:45.517902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:45.517902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:45.517902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:45.517902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:45.517902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:45.517902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:45.517902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:45.518806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:45.518806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:45.518806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:45.518806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:45.518806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:45.518806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:45.518806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:45.518806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:45.518806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:45.518806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:45.518806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:45.518806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:45.518806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:45.518806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:45.518806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:45.518806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:45.518806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:45.519699 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:45.519699 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:45.519699 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:45.519699 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:45.521293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 335/690] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:45.527719 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c680a9e-0706-4fe2-9af3-dd2ad2dccf6c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:45.542502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-4baf2efd-5ca7-45b9-8567-5175b211ccc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:45.542502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:45.542502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:45.542502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:45.542502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:45.542502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:45.542502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:45.542502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:45.542502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:45.542502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:45.542502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:45.542502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:45.542502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:45.542502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:45.542502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:45.544371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:45.544371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:45.544371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:45.544371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:45.544371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:45.544371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:45.544371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:45.544371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:45.544371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:45.544371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:45.544371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:45.544371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:45.544371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:45.544371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:45.544371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:45.544371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:45.544371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:45.546137 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:45.546137 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:45.546137 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:45.546137 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:45.546137 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 356/691] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:45.553311 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf2efd-5ca7-45b9-8567-5175b211ccc4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:45.686770 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf2efd-5ca7-45b9-8567-5175b211ccc4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:45.696130 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c680a9e-0706-4fe2-9af3-dd2ad2dccf6c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:45.707049 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:45.738966 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13ca56-dfbd-44f9-836f-754332fadfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:45.740680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13ca56-dfbd-44f9-836f-754332fadfcd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:45.740961 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13ca56-dfbd-44f9-836f-754332fadfcd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:45.741233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13ca56-dfbd-44f9-836f-754332fadfcd None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:45.741989 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13ca56-dfbd-44f9-836f-754332fadfcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:45.742290 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13ca56-dfbd-44f9-836f-754332fadfcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:45.743694 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13ca56-dfbd-44f9-836f-754332fadfcd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:45.754963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41122bc7-4499-456d-babc-3e87fa688f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:45.756195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41122bc7-4499-456d-babc-3e87fa688f65 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:45.756690 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41122bc7-4499-456d-babc-3e87fa688f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:45.757171 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41122bc7-4499-456d-babc-3e87fa688f65 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:45.758154 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41122bc7-4499-456d-babc-3e87fa688f65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:45.758693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41122bc7-4499-456d-babc-3e87fa688f65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:45.759599 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 357/692] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:45.760600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41122bc7-4499-456d-babc-3e87fa688f65 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:45.765756 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13ca56-dfbd-44f9-836f-754332fadfcd None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:45.779366 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 336/693] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:45.788457 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41122bc7-4499-456d-babc-3e87fa688f65 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:45.825727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:45.918737 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41122bc7-4499-456d-babc-3e87fa688f65 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:45.958936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbe2a4-ed24-4ef4-b94b-1e092093fe98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:45.960131 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbe2a4-ed24-4ef4-b94b-1e092093fe98 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:45.960620 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbe2a4-ed24-4ef4-b94b-1e092093fe98 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:45.961126 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbe2a4-ed24-4ef4-b94b-1e092093fe98 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:45.971475 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbe2a4-ed24-4ef4-b94b-1e092093fe98 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:45.973650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbe2a4-ed24-4ef4-b94b-1e092093fe98 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:45.995158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-8ffbe2a4-ed24-4ef4-b94b-1e092093fe98 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:29:45.995158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:45.995158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:45.995158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:45.995158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:45.995158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:45.995158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:45.995158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:45.995158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:45.995158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:45.995158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:45.995158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:45.995158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:45.995158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:45.995158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:45.995158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:45.996197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:45.996197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:45.996197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:45.996197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:45.996197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:45.996197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:45.996197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:45.996197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:45.996197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:45.996197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:45.996197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:45.996197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:45.996197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:45.996197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:45.996197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:45.996197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:45.996197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:45.996197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:45.997178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:45.997178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:45.997178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:45.997178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:45.997178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:45.997178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:45.997178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:45.997178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:45.997178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:29:45.997178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:46.000243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 337/694] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 26 16:29:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:46.006582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbe2a4-ed24-4ef4-b94b-1e092093fe98 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:46.059293 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13ca56-dfbd-44f9-836f-754332fadfcd None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:46.129828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:46.133956 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbe2a4-ed24-4ef4-b94b-1e092093fe98 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:46.167015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a04380-25cb-43bc-91e6-4aad5062f11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:46.169509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a04380-25cb-43bc-91e6-4aad5062f11c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:46.170027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a04380-25cb-43bc-91e6-4aad5062f11c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:46.170550 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a04380-25cb-43bc-91e6-4aad5062f11c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:46.189759 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a04380-25cb-43bc-91e6-4aad5062f11c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:46.191892 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a04380-25cb-43bc-91e6-4aad5062f11c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:46.199557 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f4627-5631-4018-9dc3-7d14d1247f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:46.200686 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f4627-5631-4018-9dc3-7d14d1247f65 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:46.201529 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f4627-5631-4018-9dc3-7d14d1247f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:46.203103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f4627-5631-4018-9dc3-7d14d1247f65 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:46.209564 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f4627-5631-4018-9dc3-7d14d1247f65 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:46.210537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f4627-5631-4018-9dc3-7d14d1247f65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:46.212456 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f4627-5631-4018-9dc3-7d14d1247f65 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:46.228634 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-b2a04380-25cb-43bc-91e6-4aad5062f11c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:46.228634 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:46.228634 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:46.228634 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:46.228634 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:46.228634 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:46.228634 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:46.228634 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:46.228634 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:46.228634 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:46.228634 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:46.228634 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:46.228634 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:46.228634 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:46.228634 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:46.229713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:46.229713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:46.229713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:46.229713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:46.229713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:46.229713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:46.229713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:46.229713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:46.229713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:46.229713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:46.229713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:46.229713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:46.229713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:46.229713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:46.229713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:46.229713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:46.229713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:46.230666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:46.230666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:46.230666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:46.230666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:46.230666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:46.230666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:46.230666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:46.230666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:46.237585 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 358/695] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 471 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:46.247606 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a04380-25cb-43bc-91e6-4aad5062f11c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:46.263687 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 338/696] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 26 16:29:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:46.278426 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f4627-5631-4018-9dc3-7d14d1247f65 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:46.320523 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:46.452527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f4627-5631-4018-9dc3-7d14d1247f65 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:46.501109 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e5ba1-39e9-406c-965c-99ab31da63ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:46.502468 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a04380-25cb-43bc-91e6-4aad5062f11c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:46.503339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e5ba1-39e9-406c-965c-99ab31da63ac None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:46.505398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e5ba1-39e9-406c-965c-99ab31da63ac None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:46.505876 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e5ba1-39e9-406c-965c-99ab31da63ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:46.626945 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c3b6f-4d2b-48f9-ab6b-eea273cc9b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:46.627639 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c3b6f-4d2b-48f9-ab6b-eea273cc9b6c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:46.627930 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c3b6f-4d2b-48f9-ab6b-eea273cc9b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:46.628208 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c3b6f-4d2b-48f9-ab6b-eea273cc9b6c None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:46.629014 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c3b6f-4d2b-48f9-ab6b-eea273cc9b6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:46.629348 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c3b6f-4d2b-48f9-ab6b-eea273cc9b6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:46.630833 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c3b6f-4d2b-48f9-ab6b-eea273cc9b6c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:46.665604 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 359/697] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:29:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:46.672589 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c3b6f-4d2b-48f9-ab6b-eea273cc9b6c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:46.673781 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:46.769168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e5ba1-39e9-406c-965c-99ab31da63ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:46.770635 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e5ba1-39e9-406c-965c-99ab31da63ac None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:46.815161 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:46.823349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c3b6f-4d2b-48f9-ab6b-eea273cc9b6c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:46.866100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6b4c6-5d0d-4784-9c07-335664fc0abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:46.867181 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6b4c6-5d0d-4784-9c07-335664fc0abc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:46.867672 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6b4c6-5d0d-4784-9c07-335664fc0abc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:46.868168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6b4c6-5d0d-4784-9c07-335664fc0abc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:46.869293 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6b4c6-5d0d-4784-9c07-335664fc0abc None admin] RBAC: Adding query filter params (role.id=d39d16b5286d4e1db63841f4917e08f2, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=07cc455638fb4db4939af3657ab4203e) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:46.869814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6b4c6-5d0d-4784-9c07-335664fc0abc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:46.871474 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6b4c6-5d0d-4784-9c07-335664fc0abc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:46.879308 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 360/698] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:29:46 2022] GET /identity/v3/role_assignments?user.id=07cc455638fb4db4939af3657ab4203e&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=d39d16b5286d4e1db63841f4917e08f2 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:46.881067 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe073c2-02be-4a34-8102-831fd7a91366 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:46.881783 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe073c2-02be-4a34-8102-831fd7a91366 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:46.882391 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe073c2-02be-4a34-8102-831fd7a91366 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:46.885217 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 361/699] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:46.896230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a644a-c215-4bad-a535-34b66b56a573 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:46.896230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a644a-c215-4bad-a535-34b66b56a573 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:46.896230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a644a-c215-4bad-a535-34b66b56a573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:46.910453 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 339/700] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:29:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:46.916970 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e5ba1-39e9-406c-965c-99ab31da63ac None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:46.935165 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-795a644a-c215-4bad-a535-34b66b56a573 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:46.937016 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-795a644a-c215-4bad-a535-34b66b56a573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:47.037808 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 362/701] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:47.101915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:47.123906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a644a-c215-4bad-a535-34b66b56a573 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:47.179382 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e5ba1-39e9-406c-965c-99ab31da63ac None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:47.218419 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d41aee-0661-48a8-8bb0-18960866545e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:47.219286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d41aee-0661-48a8-8bb0-18960866545e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:47.219557 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d41aee-0661-48a8-8bb0-18960866545e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:47.219784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d41aee-0661-48a8-8bb0-18960866545e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:47.231511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d41aee-0661-48a8-8bb0-18960866545e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:47.232994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d41aee-0661-48a8-8bb0-18960866545e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:47.253070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d7d41aee-0661-48a8-8bb0-18960866545e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:47.253070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:47.253070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:47.253070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:47.253070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:47.253070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:47.253070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:47.253070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:47.253070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:47.253070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:47.253070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:47.253070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:47.253070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:47.253070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:47.253070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:47.254622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:47.254622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:47.254622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:47.254622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:47.254622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:47.254622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:47.254622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:47.254622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:47.254622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:47.254622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:47.254622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:47.254622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:47.254622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:47.254622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:47.254622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:47.254622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:47.254622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:47.256205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:47.256205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:47.256205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:47.256205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:47.256205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 340/702] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:47.261510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d41aee-0661-48a8-8bb0-18960866545e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:47.300157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:47.323400 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a644a-c215-4bad-a535-34b66b56a573 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:47.377739 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:47.379089 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e45418-f57a-4451-9a39-d40e5db7f770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:47.380043 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e45418-f57a-4451-9a39-d40e5db7f770 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:47.380426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e45418-f57a-4451-9a39-d40e5db7f770 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:47.380802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e45418-f57a-4451-9a39-d40e5db7f770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:47.389639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d41aee-0661-48a8-8bb0-18960866545e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:47.394046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e45418-f57a-4451-9a39-d40e5db7f770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:47.396947 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e45418-f57a-4451-9a39-d40e5db7f770 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:47.420876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-29e45418-f57a-4451-9a39-d40e5db7f770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:47.420876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:47.420876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:47.420876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:47.420876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:47.420876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:47.420876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:47.420876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:47.420876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:47.420876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:47.420876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:47.420876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:47.420876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:47.420876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:47.420876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:47.422653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:47.422653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:47.422653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:47.422653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:47.422653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:47.422653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:47.422653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:47.422653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:47.422653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:47.422653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:47.422653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:47.422653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:47.422653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:47.422653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:47.422653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:47.422653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:47.422653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:47.424698 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:47.424698 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:47.424698 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:47.424698 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:47.424698 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 363/703] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:47.431602 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e45418-f57a-4451-9a39-d40e5db7f770 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:47.461352 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec32cb9-ec61-4a79-98df-aa7b727f6432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:47.462759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec32cb9-ec61-4a79-98df-aa7b727f6432 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:47.463479 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec32cb9-ec61-4a79-98df-aa7b727f6432 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:47.464071 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec32cb9-ec61-4a79-98df-aa7b727f6432 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:47.465574 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec32cb9-ec61-4a79-98df-aa7b727f6432 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:47.466318 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec32cb9-ec61-4a79-98df-aa7b727f6432 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:47.468806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec32cb9-ec61-4a79-98df-aa7b727f6432 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:47.490137 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 341/704] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:47.498922 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec32cb9-ec61-4a79-98df-aa7b727f6432 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:47.607197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e45418-f57a-4451-9a39-d40e5db7f770 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:47.620391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec32cb9-ec61-4a79-98df-aa7b727f6432 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:47.660022 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbdd78-1c7e-4821-997b-b80f5ac2605f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:47.662014 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbdd78-1c7e-4821-997b-b80f5ac2605f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:47.663041 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbdd78-1c7e-4821-997b-b80f5ac2605f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:47.663830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbdd78-1c7e-4821-997b-b80f5ac2605f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:47.665444 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b258d44-c910-43a7-9e5d-3fbebcae9dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:47.666440 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b258d44-c910-43a7-9e5d-3fbebcae9dfd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:47.666728 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b258d44-c910-43a7-9e5d-3fbebcae9dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:47.667003 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b258d44-c910-43a7-9e5d-3fbebcae9dfd None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:47.667936 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b258d44-c910-43a7-9e5d-3fbebcae9dfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:47.668337 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b258d44-c910-43a7-9e5d-3fbebcae9dfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:47.669840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b258d44-c910-43a7-9e5d-3fbebcae9dfd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:47.677955 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbdd78-1c7e-4821-997b-b80f5ac2605f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:47.680700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbdd78-1c7e-4821-997b-b80f5ac2605f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:47.683812 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:47.687848 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 364/705] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:47.690011 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50682a41-8f8a-4a8d-913b-c8cae98a9163 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:47.690300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50682a41-8f8a-4a8d-913b-c8cae98a9163 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:47.690583 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50682a41-8f8a-4a8d-913b-c8cae98a9163 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:47.692587 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 365/706] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:47.693485 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50682a41-8f8a-4a8d-913b-c8cae98a9163 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:47.709747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-bdcbdd78-1c7e-4821-997b-b80f5ac2605f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:47.709747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:47.709747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:47.709747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:47.709747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:47.709747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:47.709747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:47.709747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:47.709747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:47.709747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:47.709747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:47.709747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:47.709747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:47.709747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:47.709747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:47.710963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:47.710963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:47.710963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:47.710963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:47.710963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:47.710963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:47.710963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:47.710963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:47.710963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:47.710963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:47.710963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:47.710963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:47.710963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:47.710963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:47.710963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:47.710963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:47.710963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:47.711988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:47.711988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:47.711988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:47.711988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:47.711988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:47.711988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:47.711988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:47.711988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:47.719952 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 342/707] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:47.722658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b93bce-278a-4736-8495-bb94d31991b0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:47.723246 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b93bce-278a-4736-8495-bb94d31991b0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:47.723811 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b93bce-278a-4736-8495-bb94d31991b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:47.752920 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-49b93bce-278a-4736-8495-bb94d31991b0 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:47.755035 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-49b93bce-278a-4736-8495-bb94d31991b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:47.770262 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:47.835892 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50682a41-8f8a-4a8d-913b-c8cae98a9163 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:47.879491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45b20a-1c8f-42dd-8896-a4d737f64472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:47.880385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45b20a-1c8f-42dd-8896-a4d737f64472 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:47.880739 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45b20a-1c8f-42dd-8896-a4d737f64472 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:47.881121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45b20a-1c8f-42dd-8896-a4d737f64472 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:47.882203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45b20a-1c8f-42dd-8896-a4d737f64472 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:47.884705 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45b20a-1c8f-42dd-8896-a4d737f64472 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:47.888727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 343/708] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:47.890494 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b93bce-278a-4736-8495-bb94d31991b0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:47.981467 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 366/709] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 16:29:47 2022] POST /identity/v3/users => generated 254 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:29:47.983321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45b20a-1c8f-42dd-8896-a4d737f64472 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:48.100230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:48.141231 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b93bce-278a-4736-8495-bb94d31991b0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:48.214219 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45b20a-1c8f-42dd-8896-a4d737f64472 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:48.244782 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1cceb-756e-4d6b-b5d4-2145b7ceed6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:48.244782 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1cceb-756e-4d6b-b5d4-2145b7ceed6e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:48.244782 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1cceb-756e-4d6b-b5d4-2145b7ceed6e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:48.244782 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1cceb-756e-4d6b-b5d4-2145b7ceed6e None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:48.245859 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1cceb-756e-4d6b-b5d4-2145b7ceed6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:48.246180 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1cceb-756e-4d6b-b5d4-2145b7ceed6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:48.248150 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1cceb-756e-4d6b-b5d4-2145b7ceed6e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:48.268446 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 344/710] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:29:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:48.274265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1cceb-756e-4d6b-b5d4-2145b7ceed6e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:48.278199 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:48.291756 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929897d-901b-474c-bc13-dbf1dc34584c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:48.293359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929897d-901b-474c-bc13-dbf1dc34584c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:48.296384 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929897d-901b-474c-bc13-dbf1dc34584c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:48.296384 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929897d-901b-474c-bc13-dbf1dc34584c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:48.296384 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929897d-901b-474c-bc13-dbf1dc34584c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:48.297941 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929897d-901b-474c-bc13-dbf1dc34584c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:48.319344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-f929897d-901b-474c-bc13-dbf1dc34584c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:29:48.319344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:48.319344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:48.319344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:48.319344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:48.319344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:48.319344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:48.319344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:48.319344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:29:48.319344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:48.319344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:48.319344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:48.319344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:48.319344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:48.319344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:48.319344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:48.320491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:48.320491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:48.320491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:48.320491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:48.320491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:48.320491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:48.320491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:48.320491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:48.320491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:48.320491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:48.320491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:48.320491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:48.320491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:48.320491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:48.320491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:48.320491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:48.321381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:48.321381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:48.321381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:48.321381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:48.321381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:48.321381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:48.321381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:48.321381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:48.321381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:48.321381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:48.321381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:48.321381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:48.321381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:48.321381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:29:48.321381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:48.321381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 367/711] 10.222.0.48 () {56 vars in 1129 bytes} [Thu May 26 16:29:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:48.329515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929897d-901b-474c-bc13-dbf1dc34584c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:48.410028 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1cceb-756e-4d6b-b5d4-2145b7ceed6e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:48.451191 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f9b03-ef95-424f-998e-d8345763e6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:48.452425 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f9b03-ef95-424f-998e-d8345763e6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:48.453217 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f9b03-ef95-424f-998e-d8345763e6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:48.454111 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f9b03-ef95-424f-998e-d8345763e6e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:48.456652 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f9b03-ef95-424f-998e-d8345763e6e1 None admin] RBAC: Adding query filter params (role.id=796e313fa8794ac885ccf6300d09332a, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=35c9fa9c29494ff9b1f749974dca2719) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:48.457523 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f9b03-ef95-424f-998e-d8345763e6e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:48.459403 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f9b03-ef95-424f-998e-d8345763e6e1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:48.467493 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 345/712] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:29:48 2022] GET /identity/v3/role_assignments?user.id=35c9fa9c29494ff9b1f749974dca2719&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=796e313fa8794ac885ccf6300d09332a => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:48.478488 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eee9ca-d7b4-4747-8c88-441aa9c52d5c None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:48.478931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eee9ca-d7b4-4747-8c88-441aa9c52d5c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:48.479356 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eee9ca-d7b4-4747-8c88-441aa9c52d5c None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:48.487444 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 346/713] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:48.489665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31fbd9-1cc7-4605-bc03-7823052bbc07 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:48.490001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31fbd9-1cc7-4605-bc03-7823052bbc07 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:48.490236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31fbd9-1cc7-4605-bc03-7823052bbc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:48.513047 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4a31fbd9-1cc7-4605-bc03-7823052bbc07 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:48.514441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4a31fbd9-1cc7-4605-bc03-7823052bbc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:48.628200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929897d-901b-474c-bc13-dbf1dc34584c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:48.628444 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:48.642824 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 347/714] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:29:48.663889 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:48.682641 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31fbd9-1cc7-4605-bc03-7823052bbc07 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:48.686355 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ba2ca-248a-488c-8a9b-a340f64f5d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:48.687279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ba2ca-248a-488c-8a9b-a340f64f5d18 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:48.687654 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ba2ca-248a-488c-8a9b-a340f64f5d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:48.688012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ba2ca-248a-488c-8a9b-a340f64f5d18 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:48.689296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ba2ca-248a-488c-8a9b-a340f64f5d18 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:48.689508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ba2ca-248a-488c-8a9b-a340f64f5d18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:48.691878 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ba2ca-248a-488c-8a9b-a340f64f5d18 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:48.701683 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 368/715] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 26 16:29:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:48.713830 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ba2ca-248a-488c-8a9b-a340f64f5d18 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:48.897528 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ba2ca-248a-488c-8a9b-a340f64f5d18 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:48.940500 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31fbd9-1cc7-4605-bc03-7823052bbc07 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:48.986560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9b2c4-bb74-466f-90fc-c2356b14c5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:48.987387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9b2c4-bb74-466f-90fc-c2356b14c5aa None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:48.987850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9b2c4-bb74-466f-90fc-c2356b14c5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:48.988329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9b2c4-bb74-466f-90fc-c2356b14c5aa None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:48.989624 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9b2c4-bb74-466f-90fc-c2356b14c5aa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:48.990282 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9b2c4-bb74-466f-90fc-c2356b14c5aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:48.992309 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9b2c4-bb74-466f-90fc-c2356b14c5aa None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:48.995869 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f51872-5a64-4ce9-b4b1-48686b01b52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:48.997009 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f51872-5a64-4ce9-b4b1-48686b01b52c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:48.997562 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f51872-5a64-4ce9-b4b1-48686b01b52c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:48.998102 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f51872-5a64-4ce9-b4b1-48686b01b52c None admin] PATH_INFO: `/v3/services/network` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:48.998978 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f51872-5a64-4ce9-b4b1-48686b01b52c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:49.000629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f51872-5a64-4ce9-b4b1-48686b01b52c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:49.008488 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 369/716] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 26 16:29:48 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:49.016088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-a9f51872-5a64-4ce9-b4b1-48686b01b52c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:29:49.016088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:49.016088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:49.016088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:49.016088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:49.016088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:49.016088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:49.016088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:49.016088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:29:49.016088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:49.016088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:49.016088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:49.016088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:49.016088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:49.016088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:49.016088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:49.016088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:49.017209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:49.017209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:49.017209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:49.017209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:49.017209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:49.017209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:49.017209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:49.017209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:49.017209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:49.017209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:49.017209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:49.017209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:49.017209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:49.017209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:49.017209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:49.017209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:49.018090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:49.018090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:49.018090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:49.018090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:49.018090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:49.018090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:49.018090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:49.018090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:49.018090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:49.018090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:49.018090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:49.018090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:49.018090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:29:49.018090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:49.025453 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 348/717] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:48 2022] GET /identity/v3/services/network => generated 88 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:49.028484 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9b2c4-bb74-466f-90fc-c2356b14c5aa None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:49.106695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:49.192831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9b2c4-bb74-466f-90fc-c2356b14c5aa None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:49.244446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278439e-2bdc-4209-a341-a572bee055eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:49.245584 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278439e-2bdc-4209-a341-a572bee055eb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:49.246057 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278439e-2bdc-4209-a341-a572bee055eb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:49.246582 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278439e-2bdc-4209-a341-a572bee055eb None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:49.247699 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278439e-2bdc-4209-a341-a572bee055eb None admin] RBAC: Adding query filter params (name=network) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:49.248192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278439e-2bdc-4209-a341-a572bee055eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:49.250183 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278439e-2bdc-4209-a341-a572bee055eb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:49.256895 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 370/718] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 16:29:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:49.263475 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f51872-5a64-4ce9-b4b1-48686b01b52c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:49.338922 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:49.398317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f51872-5a64-4ce9-b4b1-48686b01b52c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:49.468862 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cb683-1a92-4bc7-83e2-4865fda95776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:49.469474 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cb683-1a92-4bc7-83e2-4865fda95776 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:49.469779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cb683-1a92-4bc7-83e2-4865fda95776 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:49.470166 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cb683-1a92-4bc7-83e2-4865fda95776 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:49.470882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cb683-1a92-4bc7-83e2-4865fda95776 None admin] RBAC: Adding query filter params (type=network) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:49.471456 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cb683-1a92-4bc7-83e2-4865fda95776 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:49.472936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cb683-1a92-4bc7-83e2-4865fda95776 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:49.481288 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 349/719] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 16:29:49 2022] GET /identity/v3/services?type=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:49.967753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424091d-f406-4e1b-9c52-7ae9b2443580 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:49.968482 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424091d-f406-4e1b-9c52-7ae9b2443580 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:49.968482 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424091d-f406-4e1b-9c52-7ae9b2443580 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:49.970526 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 371/720] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:49.976615 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f80b4-bfb1-4c45-8491-ec1cc05dd8c6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:49.976963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f80b4-bfb1-4c45-8491-ec1cc05dd8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:49.977216 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f80b4-bfb1-4c45-8491-ec1cc05dd8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:49.998856 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a01f80b4-bfb1-4c45-8491-ec1cc05dd8c6 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:50.000085 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a01f80b4-bfb1-4c45-8491-ec1cc05dd8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:50.123957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 350/721] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:50.164716 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424091d-f406-4e1b-9c52-7ae9b2443580 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:50.319775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424091d-f406-4e1b-9c52-7ae9b2443580 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:50.340120 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:50.371580 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0d90c-e014-413f-b3b3-e9b06260be92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:50.372400 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0d90c-e014-413f-b3b3-e9b06260be92 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:50.372680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0d90c-e014-413f-b3b3-e9b06260be92 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:50.372953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0d90c-e014-413f-b3b3-e9b06260be92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:50.385771 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0d90c-e014-413f-b3b3-e9b06260be92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:50.400909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a1a0d90c-e014-413f-b3b3-e9b06260be92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:50.400909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:50.400909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:50.400909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:50.400909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:50.400909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:50.400909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:50.400909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:50.400909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:50.400909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:50.400909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:50.400909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:50.400909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:50.400909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:50.400909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:50.400909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:50.408230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:50.408230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:50.408230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:50.408230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:50.408230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:50.408230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:50.408230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:50.408230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:50.408230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:50.408230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:50.408230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:50.408230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:50.408230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:50.408230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:50.408230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:50.408230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:50.410284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:50.410284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:50.410284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:50.410284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:50.410284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:50.410284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:50.410284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:50.410284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:50.410284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:50.410284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:50.410284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:50.410284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:50.410284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 372/722] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:29:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:50.412483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f80b4-bfb1-4c45-8491-ec1cc05dd8c6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:50.506195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:50.584502 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f80b4-bfb1-4c45-8491-ec1cc05dd8c6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:50.630517 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460b0d6-2c66-4ee4-952c-a159df82a614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:50.631206 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460b0d6-2c66-4ee4-952c-a159df82a614 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:50.631485 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460b0d6-2c66-4ee4-952c-a159df82a614 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:50.631757 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460b0d6-2c66-4ee4-952c-a159df82a614 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:50.632575 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460b0d6-2c66-4ee4-952c-a159df82a614 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:50.632885 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460b0d6-2c66-4ee4-952c-a159df82a614 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:50.634371 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460b0d6-2c66-4ee4-952c-a159df82a614 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:50.649100 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 351/723] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:29:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:50.654488 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0d90c-e014-413f-b3b3-e9b06260be92 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:50.822199 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0d90c-e014-413f-b3b3-e9b06260be92 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:50.895354 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113bff6-b4c5-4988-9a7d-a0d5f228cb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:50.897136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113bff6-b4c5-4988-9a7d-a0d5f228cb0f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:50.897916 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113bff6-b4c5-4988-9a7d-a0d5f228cb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:50.898633 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113bff6-b4c5-4988-9a7d-a0d5f228cb0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:50.928575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113bff6-b4c5-4988-9a7d-a0d5f228cb0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:50.930854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113bff6-b4c5-4988-9a7d-a0d5f228cb0f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:50.961531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-7113bff6-b4c5-4988-9a7d-a0d5f228cb0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:50.961531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:50.961531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:50.961531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:50.961531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:50.961531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:50.961531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:50.961531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:50.961531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:50.961531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:50.961531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:50.961531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:50.961531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:50.961531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:50.961531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:50.962772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:50.962772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:50.962772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:50.962772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:50.962772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:50.962772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:50.962772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:50.962772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:50.962772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:50.962772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:50.962772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:50.962772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:50.962772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:50.962772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:50.962772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:50.962772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:50.962772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:50.963780 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:50.963780 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:50.963780 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:50.963780 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:50.970288 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 373/724] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:50.975880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460b0d6-2c66-4ee4-952c-a159df82a614 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:51.156542 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460b0d6-2c66-4ee4-952c-a159df82a614 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:51.186507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:51.200253 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898943e-217a-47a9-9a5e-a6cff1b8e953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:51.206571 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898943e-217a-47a9-9a5e-a6cff1b8e953 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:51.206571 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898943e-217a-47a9-9a5e-a6cff1b8e953 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:51.206571 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898943e-217a-47a9-9a5e-a6cff1b8e953 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:51.206571 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898943e-217a-47a9-9a5e-a6cff1b8e953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:51.206571 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898943e-217a-47a9-9a5e-a6cff1b8e953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:51.206571 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898943e-217a-47a9-9a5e-a6cff1b8e953 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:51.218307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 352/725] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:51.228762 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113bff6-b4c5-4988-9a7d-a0d5f228cb0f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:51.285924 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:51.388829 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113bff6-b4c5-4988-9a7d-a0d5f228cb0f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:51.433026 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1560d-4334-46de-bdd8-86db886b1585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:51.434125 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1560d-4334-46de-bdd8-86db886b1585 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:51.434565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1560d-4334-46de-bdd8-86db886b1585 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:51.434989 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1560d-4334-46de-bdd8-86db886b1585 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:51.444408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1560d-4334-46de-bdd8-86db886b1585 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:51.446116 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1560d-4334-46de-bdd8-86db886b1585 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:51.467055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-86b1560d-4334-46de-bdd8-86db886b1585 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:29:51.467055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:51.467055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:51.467055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:51.467055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:51.467055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:51.467055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:51.467055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:51.467055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:51.467055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:51.467055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:51.467055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:51.467055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:51.467055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:51.467055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:51.467055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:51.468272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:51.468272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:51.468272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:51.468272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:51.468272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:51.468272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:51.468272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:51.468272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:51.468272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:51.468272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:51.468272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:51.468272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:51.468272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:51.468272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:51.468272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:51.468272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:51.468272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:51.468272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:51.473570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:51.473570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:51.473570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:51.473570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:51.473570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:51.473570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:51.473570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:51.473570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:51.473570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:29:51.473570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:51.476081 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 374/726] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:29:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:51.483935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898943e-217a-47a9-9a5e-a6cff1b8e953 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:51.528733 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7682974-f49c-4a44-bdcb-ccffb18a2289 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:51.529452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7682974-f49c-4a44-bdcb-ccffb18a2289 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:51.529938 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7682974-f49c-4a44-bdcb-ccffb18a2289 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:51.531828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 375/727] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:51.537603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c6b64-e973-4f84-95e4-0ccd0551853d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:51.538179 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c6b64-e973-4f84-95e4-0ccd0551853d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:51.538690 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c6b64-e973-4f84-95e4-0ccd0551853d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:51.574319 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-de0c6b64-e973-4f84-95e4-0ccd0551853d None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:51.575878 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-de0c6b64-e973-4f84-95e4-0ccd0551853d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:51.620529 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898943e-217a-47a9-9a5e-a6cff1b8e953 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:51.665287 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878687b9-66be-4dc7-b7db-dad2d87ec46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:51.665287 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878687b9-66be-4dc7-b7db-dad2d87ec46c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:51.665287 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878687b9-66be-4dc7-b7db-dad2d87ec46c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:51.665287 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878687b9-66be-4dc7-b7db-dad2d87ec46c None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:51.665711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878687b9-66be-4dc7-b7db-dad2d87ec46c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:51.665711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878687b9-66be-4dc7-b7db-dad2d87ec46c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:51.665711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878687b9-66be-4dc7-b7db-dad2d87ec46c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:51.682299 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 353/728] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 26 16:29:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:51.691037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878687b9-66be-4dc7-b7db-dad2d87ec46c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:51.727854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 376/729] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:51.780550 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:51.845991 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c6b64-e973-4f84-95e4-0ccd0551853d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:51.867773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:51.947561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878687b9-66be-4dc7-b7db-dad2d87ec46c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:51.994899 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c6b64-e973-4f84-95e4-0ccd0551853d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:51.997585 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e2b57-8065-452b-b7c4-bd7aeaafb0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:51.999963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e2b57-8065-452b-b7c4-bd7aeaafb0ea None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.000459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e2b57-8065-452b-b7c4-bd7aeaafb0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.000947 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e2b57-8065-452b-b7c4-bd7aeaafb0ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.046024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8aed9-e586-4e40-8282-2fc830a20401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:52.046841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8aed9-e586-4e40-8282-2fc830a20401 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.047122 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8aed9-e586-4e40-8282-2fc830a20401 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.047395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8aed9-e586-4e40-8282-2fc830a20401 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.067147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8aed9-e586-4e40-8282-2fc830a20401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:52.076886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-aeb8aed9-e586-4e40-8282-2fc830a20401 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:52.076886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:52.076886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:52.076886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:52.076886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:52.076886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:52.076886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:52.076886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:52.076886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:52.076886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:52.076886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:52.076886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:52.076886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:52.076886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:52.076886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:52.076886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:52.078100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:52.078100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:52.078100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:52.078100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:52.078100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:52.078100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:52.078100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:52.078100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:52.078100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:52.078100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:52.078100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:52.078100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:52.078100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:52.078100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:52.078100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:52.078100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:52.078967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:52.078967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:52.078967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:52.078967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:52.078967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:52.078967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:52.078967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:52.078967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:52.078967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:52.078967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:52.078967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:52.078967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:52.078967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 377/730] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:29:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:52.080219 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b24b0-9486-48e4-aca3-9c6af30d6c87 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.080219 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b24b0-9486-48e4-aca3-9c6af30d6c87 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.080474 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b24b0-9486-48e4-aca3-9c6af30d6c87 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.089505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 378/731] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:52.089505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b24b0-9486-48e4-aca3-9c6af30d6c87 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:52.114766 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e2b57-8065-452b-b7c4-bd7aeaafb0ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:52.116736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e2b57-8065-452b-b7c4-bd7aeaafb0ea None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:52.161948 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:52.178262 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:52.216837 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b24b0-9486-48e4-aca3-9c6af30d6c87 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:52.250000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 354/732] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:29:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:29:52.251518 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36e4c2-1434-4343-b576-40a890a9ece1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.251909 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36e4c2-1434-4343-b576-40a890a9ece1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.252308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36e4c2-1434-4343-b576-40a890a9ece1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.269474 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d7a49-f013-4197-878b-f3af0bed73bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:52.270216 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d7a49-f013-4197-878b-f3af0bed73bd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.270499 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d7a49-f013-4197-878b-f3af0bed73bd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.270770 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d7a49-f013-4197-878b-f3af0bed73bd None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.271526 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d7a49-f013-4197-878b-f3af0bed73bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:52.271826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d7a49-f013-4197-878b-f3af0bed73bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:52.273159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bc36e4c2-1434-4343-b576-40a890a9ece1 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:52.273334 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d7a49-f013-4197-878b-f3af0bed73bd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:52.274901 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bc36e4c2-1434-4343-b576-40a890a9ece1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:52.284679 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 379/733] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:29:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:52.285586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d7a49-f013-4197-878b-f3af0bed73bd None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:52.381945 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 355/734] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:52.382812 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36e4c2-1434-4343-b576-40a890a9ece1 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:52.437650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d7a49-f013-4197-878b-f3af0bed73bd None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:52.476995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:52.481692 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85255721-4a0b-4386-ad68-d37843809745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:52.482538 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85255721-4a0b-4386-ad68-d37843809745 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.482826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85255721-4a0b-4386-ad68-d37843809745 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.483095 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85255721-4a0b-4386-ad68-d37843809745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.486756 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:52.498330 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85255721-4a0b-4386-ad68-d37843809745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:52.499882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85255721-4a0b-4386-ad68-d37843809745 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:52.518958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-85255721-4a0b-4386-ad68-d37843809745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:52.518958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:52.518958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:52.518958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:52.518958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:52.518958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:52.518958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:52.518958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:52.518958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:52.518958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:52.518958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:52.518958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:52.518958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:52.518958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:52.518958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:52.520409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:52.520409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:52.520409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:52.520409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:52.520409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:52.520409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:52.520409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:52.520409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:52.520409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:52.520409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:52.520409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:52.520409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:52.520409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:52.520409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:52.520409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:52.520409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:52.520409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:52.522572 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:52.522572 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:52.522572 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:52.522572 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:52.522572 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 380/735] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:52.522572 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1d376-a848-4db4-9080-340aabdceea5 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.522572 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1d376-a848-4db4-9080-340aabdceea5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.522572 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1d376-a848-4db4-9080-340aabdceea5 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.529637 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 381/736] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:52.529637 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1d376-a848-4db4-9080-340aabdceea5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:52.535235 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36e4c2-1434-4343-b576-40a890a9ece1 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:52.587503 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae7d90-cff8-4ca0-91eb-1282593b8164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:52.588324 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae7d90-cff8-4ca0-91eb-1282593b8164 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.588604 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae7d90-cff8-4ca0-91eb-1282593b8164 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.588879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae7d90-cff8-4ca0-91eb-1282593b8164 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.601799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae7d90-cff8-4ca0-91eb-1282593b8164 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:52.603350 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae7d90-cff8-4ca0-91eb-1282593b8164 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:52.625459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-feae7d90-cff8-4ca0-91eb-1282593b8164 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:52.625459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:52.625459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:52.625459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:52.625459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:52.625459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:52.625459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:52.625459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:52.625459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:52.625459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:52.625459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:52.625459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:52.625459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:52.625459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:52.625459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:52.626700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:52.626700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:52.626700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:52.626700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:52.626700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:52.626700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:52.626700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:52.626700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:52.626700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:52.626700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:52.626700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:52.626700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:52.626700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:52.626700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:52.626700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:52.626700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:52.626700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:52.627609 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:52.627609 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:52.627609 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:52.627609 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:52.627609 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 356/737] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:52.627886 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae7d90-cff8-4ca0-91eb-1282593b8164 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:52.674284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1d376-a848-4db4-9080-340aabdceea5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:52.720536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1095f53-8f78-42b5-bf36-434d48121139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:52.721777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1095f53-8f78-42b5-bf36-434d48121139 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.722605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1095f53-8f78-42b5-bf36-434d48121139 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.722882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1095f53-8f78-42b5-bf36-434d48121139 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.736282 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1095f53-8f78-42b5-bf36-434d48121139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:52.744273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d1095f53-8f78-42b5-bf36-434d48121139 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:52.744273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:52.744273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:52.744273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:52.744273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:52.744273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:52.744273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:52.744273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:52.744273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:52.744273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:52.744273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:52.744273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:52.744273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:52.744273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:52.744273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:52.744273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:52.745245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:52.745245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:52.745245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:52.745245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:52.745245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:52.745245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:52.745245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:52.745245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:52.745245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:52.745245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:52.745245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:52.745245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:52.745245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:52.745245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:52.745245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:52.745245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:52.746134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:52.746134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:52.746134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:52.746134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:52.746134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:52.746134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:52.746134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:52.746134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:52.746134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:52.746134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:52.746134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:29:52.746134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:52.750349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 382/738] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:29:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:52.752057 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4cf06-55ac-4c2f-b435-4f8d68ab661e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.752337 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4cf06-55ac-4c2f-b435-4f8d68ab661e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.752662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4cf06-55ac-4c2f-b435-4f8d68ab661e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.755129 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae7d90-cff8-4ca0-91eb-1282593b8164 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:52.770366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-15c4cf06-55ac-4c2f-b435-4f8d68ab661e None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:52.771552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-15c4cf06-55ac-4c2f-b435-4f8d68ab661e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:52.778154 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:52.801788 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27670f57-ce57-4973-8a96-8d5f3c7473ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:52.803350 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27670f57-ce57-4973-8a96-8d5f3c7473ba None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.803894 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27670f57-ce57-4973-8a96-8d5f3c7473ba None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.804171 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27670f57-ce57-4973-8a96-8d5f3c7473ba None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.804901 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27670f57-ce57-4973-8a96-8d5f3c7473ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:52.805202 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27670f57-ce57-4973-8a96-8d5f3c7473ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:52.806635 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27670f57-ce57-4973-8a96-8d5f3c7473ba None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:52.819704 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 357/739] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:52.820670 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27670f57-ce57-4973-8a96-8d5f3c7473ba None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:52.828814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:52.853152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 383/740] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:52.854109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4cf06-55ac-4c2f-b435-4f8d68ab661e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:52.934636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27670f57-ce57-4973-8a96-8d5f3c7473ba None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:52.958706 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4cf06-55ac-4c2f-b435-4f8d68ab661e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:52.977571 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1fe93-4f3c-4f66-8d11-1970dc75b78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:52.978255 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1fe93-4f3c-4f66-8d11-1970dc75b78b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.978531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1fe93-4f3c-4f66-8d11-1970dc75b78b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.978803 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1fe93-4f3c-4f66-8d11-1970dc75b78b None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.979526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1fe93-4f3c-4f66-8d11-1970dc75b78b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:52.979831 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1fe93-4f3c-4f66-8d11-1970dc75b78b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:52.981222 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1fe93-4f3c-4f66-8d11-1970dc75b78b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:52.995009 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 358/741] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:52.996252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a3ce8-a61d-4c40-8e4e-5d220ad50096 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.996618 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a3ce8-a61d-4c40-8e4e-5d220ad50096 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.996903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a3ce8-a61d-4c40-8e4e-5d220ad50096 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.997567 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092fc23-cd20-43ef-908d-9204f2f1f43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:52.999494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092fc23-cd20-43ef-908d-9204f2f1f43b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:52.999628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 359/742] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:52.999720 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092fc23-cd20-43ef-908d-9204f2f1f43b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:52.999720 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092fc23-cd20-43ef-908d-9204f2f1f43b None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:52.999908 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a3ce8-a61d-4c40-8e4e-5d220ad50096 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:52.999993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092fc23-cd20-43ef-908d-9204f2f1f43b None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:53.000075 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092fc23-cd20-43ef-908d-9204f2f1f43b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:53.001713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092fc23-cd20-43ef-908d-9204f2f1f43b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:53.011277 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 384/743] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 16:29:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:53.012092 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092fc23-cd20-43ef-908d-9204f2f1f43b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:53.048698 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:53.060046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:53.121920 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a3ce8-a61d-4c40-8e4e-5d220ad50096 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:53.131064 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092fc23-cd20-43ef-908d-9204f2f1f43b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:53.162002 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac60a4-2b46-46d0-a8bb-28b2f6047d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:53.162803 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac60a4-2b46-46d0-a8bb-28b2f6047d51 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:53.163084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac60a4-2b46-46d0-a8bb-28b2f6047d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:53.163362 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac60a4-2b46-46d0-a8bb-28b2f6047d51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:53.166295 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48924ad3-4277-4240-a4d1-540da3959dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:53.166962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48924ad3-4277-4240-a4d1-540da3959dc2 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:53.167241 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48924ad3-4277-4240-a4d1-540da3959dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:53.167509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48924ad3-4277-4240-a4d1-540da3959dc2 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:53.168220 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48924ad3-4277-4240-a4d1-540da3959dc2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:53.169607 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48924ad3-4277-4240-a4d1-540da3959dc2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:53.170295 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac60a4-2b46-46d0-a8bb-28b2f6047d51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:53.171708 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac60a4-2b46-46d0-a8bb-28b2f6047d51 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:53.186319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-0aac60a4-2b46-46d0-a8bb-28b2f6047d51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:53.186319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:53.186319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:53.186319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:53.186319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:53.186319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:53.186319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:53.186319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:53.186319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:53.186319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:53.186319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:53.186319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:53.186319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:53.186319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:53.186319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:53.188370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:53.188370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:53.188370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:53.188370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:53.188370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:53.188370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:53.188370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:53.188370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:53.188370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:53.188370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:53.188370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:53.188370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:53.188370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:53.188370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:53.188370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:53.188370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:53.188370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:53.189916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:53.189916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:53.189916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:53.189916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:53.189916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:53.189916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:53.189916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:53.189916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:53.189916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 360/744] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:53.189916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac60a4-2b46-46d0-a8bb-28b2f6047d51 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:53.238326 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 385/745] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 16:29:53 2022] POST /identity/v3/services => generated 251 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:29:53.239773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9f01a-f397-4921-9887-d9f9c1cea643 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:53.240135 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9f01a-f397-4921-9887-d9f9c1cea643 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:53.240478 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9f01a-f397-4921-9887-d9f9c1cea643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:53.262411 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8fb9f01a-f397-4921-9887-d9f9c1cea643 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:53.264088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8fb9f01a-f397-4921-9887-d9f9c1cea643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:53.307463 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:53.314409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac60a4-2b46-46d0-a8bb-28b2f6047d51 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:53.359401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4549d33-e475-48f9-80f2-c51ff161db4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:53.360228 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4549d33-e475-48f9-80f2-c51ff161db4a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:53.361046 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4549d33-e475-48f9-80f2-c51ff161db4a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:53.361357 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4549d33-e475-48f9-80f2-c51ff161db4a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:53.377289 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 386/746] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:53 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:29:53.377515 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4549d33-e475-48f9-80f2-c51ff161db4a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:53.377616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9f01a-f397-4921-9887-d9f9c1cea643 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:53.377737 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4549d33-e475-48f9-80f2-c51ff161db4a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:53.389112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-a4549d33-e475-48f9-80f2-c51ff161db4a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:29:53.389112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:53.389112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:53.389112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:53.389112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:53.389112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:53.389112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:53.389112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:53.389112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:53.389112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:53.389112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:53.389112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:53.389112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:53.389112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:53.389112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:53.389112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:53.390265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:53.390265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:53.390265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:53.390265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:53.390265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:53.390265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:53.390265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:53.390265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:53.390265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:53.390265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:53.390265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:53.390265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:53.390265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:53.390265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:53.390265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:53.390265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:53.390265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:53.390265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:53.391225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:53.391225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:53.391225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:53.391225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:53.391225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:53.391225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:53.391225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:53.391225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:53.391225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:29:53.391225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:53.391225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 361/747] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 26 16:29:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:53.391886 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4549d33-e475-48f9-80f2-c51ff161db4a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:53.408092 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:53.504667 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9f01a-f397-4921-9887-d9f9c1cea643 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:53.513917 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4549d33-e475-48f9-80f2-c51ff161db4a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:53.546739 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467d8db-0b68-4893-8b2b-9f02596ed210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:53.548011 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467d8db-0b68-4893-8b2b-9f02596ed210 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:53.548483 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467d8db-0b68-4893-8b2b-9f02596ed210 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:53.548815 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467d8db-0b68-4893-8b2b-9f02596ed210 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:53.552218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabd2c6-ca05-48fe-9a7a-cb57914184bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:53.552893 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabd2c6-ca05-48fe-9a7a-cb57914184bb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:53.553177 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabd2c6-ca05-48fe-9a7a-cb57914184bb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:53.553492 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabd2c6-ca05-48fe-9a7a-cb57914184bb None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:53.554294 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabd2c6-ca05-48fe-9a7a-cb57914184bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:53.554601 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabd2c6-ca05-48fe-9a7a-cb57914184bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:53.556050 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabd2c6-ca05-48fe-9a7a-cb57914184bb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:53.560700 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467d8db-0b68-4893-8b2b-9f02596ed210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:53.562412 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467d8db-0b68-4893-8b2b-9f02596ed210 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:53.568583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 362/748] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:29:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:53.569454 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabd2c6-ca05-48fe-9a7a-cb57914184bb None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:53.585070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:53.588775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a467d8db-0b68-4893-8b2b-9f02596ed210 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:53.588775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:53.588775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:53.588775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:53.588775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:53.588775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:53.588775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:53.588775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:53.588775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:53.588775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:53.588775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:53.588775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:53.588775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:53.588775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:53.588775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:53.589704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:53.589704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:53.589704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:53.589704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:53.589704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:53.589704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:53.589704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:53.589704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:53.589704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:53.589704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:53.589704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:53.589704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:53.589704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:53.589704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:53.589704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:53.589704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:53.589704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:53.590628 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:53.590628 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:53.590628 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:53.590628 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:53.590628 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 387/749] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:53.590921 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467d8db-0b68-4893-8b2b-9f02596ed210 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:53.683887 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabd2c6-ca05-48fe-9a7a-cb57914184bb None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:53.688942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:53.716117 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467d8db-0b68-4893-8b2b-9f02596ed210 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:53.723997 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef959ece-6461-44d9-a154-26dfa6435397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:53.724734 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef959ece-6461-44d9-a154-26dfa6435397 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:53.725504 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef959ece-6461-44d9-a154-26dfa6435397 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:53.725792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef959ece-6461-44d9-a154-26dfa6435397 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:53.726659 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef959ece-6461-44d9-a154-26dfa6435397 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:53.726967 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef959ece-6461-44d9-a154-26dfa6435397 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:53.729107 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef959ece-6461-44d9-a154-26dfa6435397 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:53.750728 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 363/750] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 26 16:29:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:53.754676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef959ece-6461-44d9-a154-26dfa6435397 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:53.757512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be1b98-a4db-4adc-9d8e-7415ee64640f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:53.758613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be1b98-a4db-4adc-9d8e-7415ee64640f None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:53.759095 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be1b98-a4db-4adc-9d8e-7415ee64640f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:53.759577 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be1b98-a4db-4adc-9d8e-7415ee64640f None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:53.760833 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be1b98-a4db-4adc-9d8e-7415ee64640f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:53.763262 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be1b98-a4db-4adc-9d8e-7415ee64640f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:53.833733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:53.865165 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef959ece-6461-44d9-a154-26dfa6435397 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:53.896318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 388/751] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 16:29:53 2022] POST /identity/v3/services => generated 240 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:29:53.896318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be1b98-a4db-4adc-9d8e-7415ee64640f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:53.930048 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d35412-d5a5-4812-961f-8575c74b871c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:53.930724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d35412-d5a5-4812-961f-8575c74b871c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:53.931038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d35412-d5a5-4812-961f-8575c74b871c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:53.931385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d35412-d5a5-4812-961f-8575c74b871c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:53.932311 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d35412-d5a5-4812-961f-8575c74b871c None admin] RBAC: Adding query filter params (role.id=796e313fa8794ac885ccf6300d09332a, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=07cc455638fb4db4939af3657ab4203e) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:53.932617 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d35412-d5a5-4812-961f-8575c74b871c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:53.934236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d35412-d5a5-4812-961f-8575c74b871c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:53.948361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 364/752] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:29:53 2022] GET /identity/v3/role_assignments?user.id=07cc455638fb4db4939af3657ab4203e&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=796e313fa8794ac885ccf6300d09332a => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:53.949437 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d35412-d5a5-4812-961f-8575c74b871c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:54.041640 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be1b98-a4db-4adc-9d8e-7415ee64640f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:54.084521 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e38c6e-3141-4944-920b-b27a46575031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:54.085351 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e38c6e-3141-4944-920b-b27a46575031 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:54.085752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e38c6e-3141-4944-920b-b27a46575031 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:54.086131 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e38c6e-3141-4944-920b-b27a46575031 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:54.087032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e38c6e-3141-4944-920b-b27a46575031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:54.087477 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e38c6e-3141-4944-920b-b27a46575031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:54.089069 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e38c6e-3141-4944-920b-b27a46575031 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:54.098451 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:54.104629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 389/753] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:54.111577 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e38c6e-3141-4944-920b-b27a46575031 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:54.181557 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d35412-d5a5-4812-961f-8575c74b871c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:54.235816 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:54.244967 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5598c9c-5797-4fa8-8ed6-61f7a1a72b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:54.245824 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5598c9c-5797-4fa8-8ed6-61f7a1a72b54 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:54.246110 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5598c9c-5797-4fa8-8ed6-61f7a1a72b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:54.246375 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e38c6e-3141-4944-920b-b27a46575031 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:54.246483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5598c9c-5797-4fa8-8ed6-61f7a1a72b54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:54.262400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5598c9c-5797-4fa8-8ed6-61f7a1a72b54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:54.264119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5598c9c-5797-4fa8-8ed6-61f7a1a72b54 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:54.287159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-b5598c9c-5797-4fa8-8ed6-61f7a1a72b54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:54.287159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:54.287159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:54.287159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:54.287159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:54.287159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:54.287159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:54.287159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:54.287159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:54.287159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:54.287159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:54.287159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:54.287159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:54.287159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:54.287159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:54.288204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:54.288204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:54.288204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:54.288204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:54.288204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:54.288204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:54.288204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:54.288204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:54.288204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:54.288204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:54.288204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:54.288204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:54.288204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:54.288204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:54.288204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:54.288204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:54.288204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:54.289244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:54.289244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:54.289244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:54.289244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:54.289244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 365/754] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:54.296801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5598c9c-5797-4fa8-8ed6-61f7a1a72b54 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:54.309991 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3432b-46eb-4d1d-a766-5bddcb55f7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:54.310834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3432b-46eb-4d1d-a766-5bddcb55f7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:54.311118 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3432b-46eb-4d1d-a766-5bddcb55f7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:54.311399 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3432b-46eb-4d1d-a766-5bddcb55f7e4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:54.319985 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3432b-46eb-4d1d-a766-5bddcb55f7e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:54.333779 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3432b-46eb-4d1d-a766-5bddcb55f7e4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:54.368107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-3cb3432b-46eb-4d1d-a766-5bddcb55f7e4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:29:54.368107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:54.368107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:54.368107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:54.368107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:54.368107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:54.368107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:54.368107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:54.368107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:54.368107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:54.368107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:54.368107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:54.368107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:54.368107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:54.368107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:54.368107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:54.369224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:54.369224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:54.369224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:54.369224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:54.369224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:54.369224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:54.369224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:54.369224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:54.369224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:54.369224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:54.369224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:54.369224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:54.369224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:54.369224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:54.369224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:54.369224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:54.369224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:54.369224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:54.370560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:54.370560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:54.370560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:54.370560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:54.370560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:54.370560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:54.370560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:54.370560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:54.370560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:29:54.370560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:54.377635 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 390/755] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 26 16:29:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:54.382308 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3432b-46eb-4d1d-a766-5bddcb55f7e4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:54.462084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5598c9c-5797-4fa8-8ed6-61f7a1a72b54 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:54.505633 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:54.533085 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f0a8d-737b-4343-9268-2b4efc7d39d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:54.533782 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f0a8d-737b-4343-9268-2b4efc7d39d0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:54.534061 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f0a8d-737b-4343-9268-2b4efc7d39d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:54.534332 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f0a8d-737b-4343-9268-2b4efc7d39d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:54.535051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f0a8d-737b-4343-9268-2b4efc7d39d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:54.535348 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f0a8d-737b-4343-9268-2b4efc7d39d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:54.537097 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f0a8d-737b-4343-9268-2b4efc7d39d0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:54.553549 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 366/756] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:54.559386 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f0a8d-737b-4343-9268-2b4efc7d39d0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:54.590884 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3432b-46eb-4d1d-a766-5bddcb55f7e4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:54.645685 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6018d-4059-4145-a91d-c408783e953a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:54.646279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6018d-4059-4145-a91d-c408783e953a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:54.646559 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6018d-4059-4145-a91d-c408783e953a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:54.646835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6018d-4059-4145-a91d-c408783e953a None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:54.647727 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6018d-4059-4145-a91d-c408783e953a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:54.648036 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6018d-4059-4145-a91d-c408783e953a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:54.649524 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6018d-4059-4145-a91d-c408783e953a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:54.650875 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:54.693379 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 391/757] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 26 16:29:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:54.699833 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6018d-4059-4145-a91d-c408783e953a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:54.786992 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f0a8d-737b-4343-9268-2b4efc7d39d0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:54.855554 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff6531-73ed-41ac-b69f-63f4b6b2972f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:54.855948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6018d-4059-4145-a91d-c408783e953a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:54.856372 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff6531-73ed-41ac-b69f-63f4b6b2972f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:54.856657 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff6531-73ed-41ac-b69f-63f4b6b2972f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:54.856935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff6531-73ed-41ac-b69f-63f4b6b2972f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:54.875451 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:54.877155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff6531-73ed-41ac-b69f-63f4b6b2972f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:54.878679 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff6531-73ed-41ac-b69f-63f4b6b2972f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:54.893990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-bcff6531-73ed-41ac-b69f-63f4b6b2972f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:54.893990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:54.893990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:54.893990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:54.893990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:54.893990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:54.893990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:54.893990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:54.893990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:54.893990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:54.893990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:54.893990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:54.893990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:54.893990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:54.893990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:54.899215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:54.899215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:54.899215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:54.899215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:54.899215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:54.899215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:54.899215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:54.899215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:54.899215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:54.899215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:54.899215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:54.899215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:54.899215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:54.899215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:54.899215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:54.899215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:54.899215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:54.900848 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:54.900848 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:54.900848 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:54.900848 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:54.900848 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:54.900848 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:54.900848 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:54.900848 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:54.900848 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 367/758] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:54.905288 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff6531-73ed-41ac-b69f-63f4b6b2972f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:54.916948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f27a4-ee22-4ef0-81bc-25a4b26522f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:54.917690 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f27a4-ee22-4ef0-81bc-25a4b26522f2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:54.917976 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f27a4-ee22-4ef0-81bc-25a4b26522f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:54.918253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f27a4-ee22-4ef0-81bc-25a4b26522f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:55.054326 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f27a4-ee22-4ef0-81bc-25a4b26522f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:55.056562 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f27a4-ee22-4ef0-81bc-25a4b26522f2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:55.175673 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff6531-73ed-41ac-b69f-63f4b6b2972f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:55.177403 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:55.193940 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 392/759] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:29:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:29:55.199662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f27a4-ee22-4ef0-81bc-25a4b26522f2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:55.235419 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:55.249605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dee0a-c61e-4a94-81db-a19d8983894f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:55.250290 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dee0a-c61e-4a94-81db-a19d8983894f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:55.250575 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dee0a-c61e-4a94-81db-a19d8983894f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:55.250886 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dee0a-c61e-4a94-81db-a19d8983894f None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:55.253914 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96dee0a-c61e-4a94-81db-a19d8983894f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:55.254302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96dee0a-c61e-4a94-81db-a19d8983894f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:55.255792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96dee0a-c61e-4a94-81db-a19d8983894f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:55.287343 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 368/760] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:29:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:55.295146 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dee0a-c61e-4a94-81db-a19d8983894f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:55.418120 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dee0a-c61e-4a94-81db-a19d8983894f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:55.461009 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ed6e7-900a-4391-9a54-ed038f109fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:55.462617 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ed6e7-900a-4391-9a54-ed038f109fef None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:55.462920 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ed6e7-900a-4391-9a54-ed038f109fef None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:55.463202 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ed6e7-900a-4391-9a54-ed038f109fef None admin] PATH_INFO: `/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/35c9fa9c29494ff9b1f749974dca2719/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:55.465860 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ed6e7-900a-4391-9a54-ed038f109fef None admin] RBAC: Authorizing `identity:create_grant(project_id=a3379cdd914747758e71b3b05c5921b1, user_id=35c9fa9c29494ff9b1f749974dca2719, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:55.467410 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ed6e7-900a-4391-9a54-ed038f109fef None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:55.489279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f27a4-ee22-4ef0-81bc-25a4b26522f2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:55.534831 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 369/761] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:29:55 2022] PUT /identity/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/35c9fa9c29494ff9b1f749974dca2719/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:29:55.543841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddd0d3-d4ba-4408-921b-1a34060d24e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:55.544786 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddd0d3-d4ba-4408-921b-1a34060d24e8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:55.545130 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddd0d3-d4ba-4408-921b-1a34060d24e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:55.545440 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddd0d3-d4ba-4408-921b-1a34060d24e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:55.558475 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddd0d3-d4ba-4408-921b-1a34060d24e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:55.559975 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddd0d3-d4ba-4408-921b-1a34060d24e8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:55.581954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-5cddd0d3-d4ba-4408-921b-1a34060d24e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:55.581954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:55.581954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:55.581954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:55.581954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:55.581954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:55.581954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:55.581954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:55.581954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:55.581954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:55.581954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:55.581954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:55.581954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:55.581954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:55.581954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:55.584439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:55.584439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:55.584439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:55.584439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:55.584439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:55.584439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:55.584439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:55.584439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:55.584439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:55.584439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:55.584439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:55.584439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:55.584439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:55.584439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:55.584439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:55.584439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:55.584439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:55.586832 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:55.586832 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:55.586832 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:55.586832 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:55.586832 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 393/762] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:55.591435 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ed6e7-900a-4391-9a54-ed038f109fef None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:55.626452 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:55.668815 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bb1b7-1548-4076-b6a9-12ec7cda6cf9 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:55.669178 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bb1b7-1548-4076-b6a9-12ec7cda6cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:55.669410 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bb1b7-1548-4076-b6a9-12ec7cda6cf9 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:55.671124 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 394/763] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:29:55.676932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf70256-3044-4303-b707-f006a4b3ee92 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:55.677246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf70256-3044-4303-b707-f006a4b3ee92 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:55.677533 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf70256-3044-4303-b707-f006a4b3ee92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:55.706798 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-acf70256-3044-4303-b707-f006a4b3ee92 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:55.709048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-acf70256-3044-4303-b707-f006a4b3ee92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:55.765160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ed6e7-900a-4391-9a54-ed038f109fef None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:55.791952 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:55.798603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 395/764] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:29:55.825608 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d315c1-5613-4398-a535-ee790c7c2421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:55.826671 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d315c1-5613-4398-a535-ee790c7c2421 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:55.827124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d315c1-5613-4398-a535-ee790c7c2421 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:55.827548 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d315c1-5613-4398-a535-ee790c7c2421 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:55.828473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d315c1-5613-4398-a535-ee790c7c2421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:55.829066 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d315c1-5613-4398-a535-ee790c7c2421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:55.830756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d315c1-5613-4398-a535-ee790c7c2421 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:55.844308 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf70256-3044-4303-b707-f006a4b3ee92 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:55.846695 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 370/765] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:55.859281 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d315c1-5613-4398-a535-ee790c7c2421 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:55.984802 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:56.004765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf70256-3044-4303-b707-f006a4b3ee92 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:56.033973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d315c1-5613-4398-a535-ee790c7c2421 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:56.082078 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea3726-401e-4667-ba59-eda21775689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:56.082917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea3726-401e-4667-ba59-eda21775689b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:56.083202 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea3726-401e-4667-ba59-eda21775689b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:56.083480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea3726-401e-4667-ba59-eda21775689b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:56.084148 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea3726-401e-4667-ba59-eda21775689b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:56.085571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea3726-401e-4667-ba59-eda21775689b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:56.108184 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac024e40-32ad-479c-a1ed-e1a1dce1693b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:56.109114 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac024e40-32ad-479c-a1ed-e1a1dce1693b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:56.109427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac024e40-32ad-479c-a1ed-e1a1dce1693b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:56.109754 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac024e40-32ad-479c-a1ed-e1a1dce1693b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:56.111652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6fea3726-401e-4667-ba59-eda21775689b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:29:56.111652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:56.111652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:56.111652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:56.111652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:56.111652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:56.111652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:56.111652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:56.111652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:29:56.111652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:56.111652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:56.111652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:56.111652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:56.111652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:56.111652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:56.111652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:56.112554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:56.112554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:56.112554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:56.112554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:56.112554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:56.112554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:56.112554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:56.112554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:56.112554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:56.112554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:56.112554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:56.112554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:56.112554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:56.112554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:56.112554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:56.112554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:56.113605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:56.113605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:56.113605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:56.113605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:56.113605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:56.113605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:56.113605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:56.113605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:56.113605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:56.113605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:56.113605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:56.113605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:56.113605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:56.113605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:29:56.113605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:56.116482 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 396/766] 10.222.0.48 () {56 vars in 1129 bytes} [Thu May 26 16:29:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:56.122680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea3726-401e-4667-ba59-eda21775689b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:56.134199 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac024e40-32ad-479c-a1ed-e1a1dce1693b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:56.135889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac024e40-32ad-479c-a1ed-e1a1dce1693b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:56.170269 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-ac024e40-32ad-479c-a1ed-e1a1dce1693b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:56.170269 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:56.170269 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:56.170269 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:56.170269 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:56.170269 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:56.170269 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:56.170269 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:56.170269 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:56.170269 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:56.170269 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:56.170269 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:56.170269 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:56.170269 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:56.170269 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:56.171259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:56.171259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:56.171259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:56.171259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:56.171259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:56.171259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:56.171259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:56.171259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:56.171259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:56.171259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:56.171259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:56.171259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:56.171259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:56.171259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:56.171259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:56.171259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:56.171259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:56.172666 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:56.172666 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:56.172666 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:56.172666 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:56.172666 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:56.172666 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:56.172666 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:56.172666 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:56.172666 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 371/767] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:56.178510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac024e40-32ad-479c-a1ed-e1a1dce1693b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:56.189732 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:56.235683 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea3726-401e-4667-ba59-eda21775689b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:56.277816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932347ae-41fa-4e23-a636-22d1e0d31d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:56.278682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932347ae-41fa-4e23-a636-22d1e0d31d27 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:56.278967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932347ae-41fa-4e23-a636-22d1e0d31d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:56.279242 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932347ae-41fa-4e23-a636-22d1e0d31d27 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:56.279965 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932347ae-41fa-4e23-a636-22d1e0d31d27 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:56.280271 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932347ae-41fa-4e23-a636-22d1e0d31d27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:56.283143 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932347ae-41fa-4e23-a636-22d1e0d31d27 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:56.300057 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 397/768] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 26 16:29:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:56.301798 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932347ae-41fa-4e23-a636-22d1e0d31d27 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:56.405795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac024e40-32ad-479c-a1ed-e1a1dce1693b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:56.459947 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932347ae-41fa-4e23-a636-22d1e0d31d27 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:56.470179 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba23035-e662-41f2-819e-6cf9d12d03fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:56.470888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba23035-e662-41f2-819e-6cf9d12d03fc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:56.471431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba23035-e662-41f2-819e-6cf9d12d03fc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:56.471733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba23035-e662-41f2-819e-6cf9d12d03fc None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:56.472589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba23035-e662-41f2-819e-6cf9d12d03fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:56.472903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba23035-e662-41f2-819e-6cf9d12d03fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:56.474388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba23035-e662-41f2-819e-6cf9d12d03fc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:56.490321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 372/769] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:29:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:56.505869 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba23035-e662-41f2-819e-6cf9d12d03fc None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:56.513374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:56.553745 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:56.566470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08582e-d385-45fa-a6cd-4d0b3245a50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:56.567350 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08582e-d385-45fa-a6cd-4d0b3245a50e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:56.567645 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08582e-d385-45fa-a6cd-4d0b3245a50e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:56.569530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08582e-d385-45fa-a6cd-4d0b3245a50e None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:56.570299 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08582e-d385-45fa-a6cd-4d0b3245a50e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:56.570611 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08582e-d385-45fa-a6cd-4d0b3245a50e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:56.572009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08582e-d385-45fa-a6cd-4d0b3245a50e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:56.586299 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 398/770] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 26 16:29:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:56.610513 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08582e-d385-45fa-a6cd-4d0b3245a50e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:56.733849 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08582e-d385-45fa-a6cd-4d0b3245a50e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:56.784370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747acd9-2e7e-4ae7-9478-350266381b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:56.785121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747acd9-2e7e-4ae7-9478-350266381b79 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:56.785441 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747acd9-2e7e-4ae7-9478-350266381b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:56.785717 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747acd9-2e7e-4ae7-9478-350266381b79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:56.786583 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747acd9-2e7e-4ae7-9478-350266381b79 None admin] RBAC: Adding query filter params (interface=public, service_id=4d52cb442ca24843b4a66f4c5ee40d56, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:56.786903 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747acd9-2e7e-4ae7-9478-350266381b79 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:56.787008 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba23035-e662-41f2-819e-6cf9d12d03fc None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:56.788345 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747acd9-2e7e-4ae7-9478-350266381b79 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:56.798916 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 399/771] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 26 16:29:56 2022] GET /identity/v3/endpoints?service_id=4d52cb442ca24843b4a66f4c5ee40d56&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:56.800360 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12cdf6-4822-49e2-ae21-f46af95ee8dd None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:56.800648 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12cdf6-4822-49e2-ae21-f46af95ee8dd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:56.800925 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12cdf6-4822-49e2-ae21-f46af95ee8dd None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:56.807415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 400/772] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:56.808307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12cdf6-4822-49e2-ae21-f46af95ee8dd None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:56.839663 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4598bc-79b1-4bc9-b048-f70cb11287c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:56.840550 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4598bc-79b1-4bc9-b048-f70cb11287c8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:56.840834 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4598bc-79b1-4bc9-b048-f70cb11287c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:56.841103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4598bc-79b1-4bc9-b048-f70cb11287c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:56.841995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4598bc-79b1-4bc9-b048-f70cb11287c8 None admin] RBAC: Adding query filter params (role.id=d39d16b5286d4e1db63841f4917e08f2, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=4d2ab3eeb5b44979956dd223ac6b7c39) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:56.842309 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4598bc-79b1-4bc9-b048-f70cb11287c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:56.843784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4598bc-79b1-4bc9-b048-f70cb11287c8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:56.850868 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 373/773] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:29:56 2022] GET /identity/v3/role_assignments?user.id=4d2ab3eeb5b44979956dd223ac6b7c39&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=d39d16b5286d4e1db63841f4917e08f2 => generated 259 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:56.852285 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b8861-074a-410d-b438-b1b0125dcaeb None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:56.852579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b8861-074a-410d-b438-b1b0125dcaeb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:56.852855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b8861-074a-410d-b438-b1b0125dcaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:56.893676 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:56.901212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c22b8861-074a-410d-b438-b1b0125dcaeb None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:56.902676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c22b8861-074a-410d-b438-b1b0125dcaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:56.987366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12cdf6-4822-49e2-ae21-f46af95ee8dd None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:57.025664 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:57.027562 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a438e-0118-4b4c-9f48-a6c6b3a91bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:57.027748 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 374/774] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:57.028346 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a438e-0118-4b4c-9f48-a6c6b3a91bdf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:57.028708 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a438e-0118-4b4c-9f48-a6c6b3a91bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:57.029080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8be89-1325-4b81-b4b6-078601ee5733 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:57.029189 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a438e-0118-4b4c-9f48-a6c6b3a91bdf None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:57.029345 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8be89-1325-4b81-b4b6-078601ee5733 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:57.029620 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8be89-1325-4b81-b4b6-078601ee5733 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:57.030083 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a438e-0118-4b4c-9f48-a6c6b3a91bdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:57.031184 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 375/775] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:57.031571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a438e-0118-4b4c-9f48-a6c6b3a91bdf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:57.037428 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef82bd7-6218-4e95-a8cb-fdfb33d9d75a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:57.037706 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef82bd7-6218-4e95-a8cb-fdfb33d9d75a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:57.037986 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef82bd7-6218-4e95-a8cb-fdfb33d9d75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:57.039062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 401/776] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 26 16:29:56 2022] GET /identity/v3/services => generated 772 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:57.061330 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7ef82bd7-6218-4e95-a8cb-fdfb33d9d75a None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:57.062559 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7ef82bd7-6218-4e95-a8cb-fdfb33d9d75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:57.066046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a438e-0118-4b4c-9f48-a6c6b3a91bdf None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:57.231133 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 376/777] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:29:57.261672 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a438e-0118-4b4c-9f48-a6c6b3a91bdf None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:57.263234 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef82bd7-6218-4e95-a8cb-fdfb33d9d75a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:57.286208 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:57.310497 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6db98d-a4e4-4d2e-9b0a-40f4ee2469e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:57.311329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6db98d-a4e4-4d2e-9b0a-40f4ee2469e7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:57.311673 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6db98d-a4e4-4d2e-9b0a-40f4ee2469e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:57.311883 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6db98d-a4e4-4d2e-9b0a-40f4ee2469e7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:57.312547 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6db98d-a4e4-4d2e-9b0a-40f4ee2469e7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:57.314496 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6db98d-a4e4-4d2e-9b0a-40f4ee2469e7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:57.332536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-1a6db98d-a4e4-4d2e-9b0a-40f4ee2469e7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:29:57.332536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:57.332536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:29:57.332536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:29:57.332536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:29:57.332536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:29:57.332536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:29:57.332536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:57.332536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:29:57.332536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:57.332536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:29:57.332536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:57.332536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:57.332536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:57.332536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:57.332536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:57.332536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:57.333616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:57.333616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:57.333616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:57.333616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:57.333616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:57.333616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:57.333616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:29:57.333616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:29:57.333616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:29:57.333616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:29:57.333616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:57.333616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:57.333616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:57.333616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:57.333616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:57.333616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:57.334471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:57.334471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:57.334471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:57.334471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:57.334471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:57.334471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:57.334471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:57.334471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:57.334471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:57.334471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:57.334471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:29:57.334471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:29:57.334471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:29:57.334471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:57.334471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 402/778] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:57 2022] GET /identity/v3/services/network => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:57.341386 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6db98d-a4e4-4d2e-9b0a-40f4ee2469e7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:57.406439 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef82bd7-6218-4e95-a8cb-fdfb33d9d75a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:57.452926 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:57.465189 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e137b-3e7c-4bd1-a066-0a012c612570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:57.466212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e137b-3e7c-4bd1-a066-0a012c612570 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:57.466573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e137b-3e7c-4bd1-a066-0a012c612570 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:57.466924 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e137b-3e7c-4bd1-a066-0a012c612570 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:57.474143 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6db98d-a4e4-4d2e-9b0a-40f4ee2469e7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:57.483632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e137b-3e7c-4bd1-a066-0a012c612570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:57.496582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-4d1e137b-3e7c-4bd1-a066-0a012c612570 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:57.496582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:57.496582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:57.496582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:57.496582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:57.496582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:57.496582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:57.496582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:57.496582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:57.496582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:57.496582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:57.496582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:57.496582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:57.496582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:57.496582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:57.496582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:57.498890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:57.498890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:57.498890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:57.498890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:57.498890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:57.498890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:57.498890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:57.498890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:57.498890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:57.498890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:57.498890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:57.498890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:57.498890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:57.498890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:57.498890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:57.498890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:57.500322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:57.500322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:57.500322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:57.500322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:57.500322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:57.500322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:57.500322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:57.500322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:57.500322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:57.500322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:57.500322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:57.500322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:57.500322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 377/779] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:29:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:57.520300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e137b-3e7c-4bd1-a066-0a012c612570 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:57.520387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e175ff-43b4-4b01-8002-75ef42a06948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:57.520387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e175ff-43b4-4b01-8002-75ef42a06948 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:57.520387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e175ff-43b4-4b01-8002-75ef42a06948 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:57.520387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e175ff-43b4-4b01-8002-75ef42a06948 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:57.520655 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e175ff-43b4-4b01-8002-75ef42a06948 None admin] RBAC: Adding query filter params (name=network) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:57.520655 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e175ff-43b4-4b01-8002-75ef42a06948 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:57.520655 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e175ff-43b4-4b01-8002-75ef42a06948 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:57.571692 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 403/780] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 16:29:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:57.578512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e175ff-43b4-4b01-8002-75ef42a06948 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:57.619055 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e137b-3e7c-4bd1-a066-0a012c612570 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:57.657691 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122221f1-0a53-4349-b59d-3d0e5dfc93d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:57.658378 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122221f1-0a53-4349-b59d-3d0e5dfc93d5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:57.658664 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122221f1-0a53-4349-b59d-3d0e5dfc93d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:57.658947 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122221f1-0a53-4349-b59d-3d0e5dfc93d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:57.659702 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122221f1-0a53-4349-b59d-3d0e5dfc93d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:57.660015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122221f1-0a53-4349-b59d-3d0e5dfc93d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:57.661574 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122221f1-0a53-4349-b59d-3d0e5dfc93d5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:57.671382 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 378/781] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:29:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:57.677944 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122221f1-0a53-4349-b59d-3d0e5dfc93d5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:57.684324 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:57.734118 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:57.773392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e175ff-43b4-4b01-8002-75ef42a06948 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:57.796896 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122221f1-0a53-4349-b59d-3d0e5dfc93d5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:57.838278 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89cf7b-005b-4efc-be66-983d3d96f329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:57.839468 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89cf7b-005b-4efc-be66-983d3d96f329 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:57.839803 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201d329-893a-43a4-ab49-f54541f56407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:57.840454 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89cf7b-005b-4efc-be66-983d3d96f329 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:57.840841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201d329-893a-43a4-ab49-f54541f56407 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:57.841303 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201d329-893a-43a4-ab49-f54541f56407 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:57.841526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89cf7b-005b-4efc-be66-983d3d96f329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:57.841765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201d329-893a-43a4-ab49-f54541f56407 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:57.843184 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201d329-893a-43a4-ab49-f54541f56407 None admin] RBAC: Adding query filter params (type=network) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:57.843693 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201d329-893a-43a4-ab49-f54541f56407 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:57.846440 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201d329-893a-43a4-ab49-f54541f56407 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:57.855349 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89cf7b-005b-4efc-be66-983d3d96f329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:57.855786 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 404/782] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 16:29:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:57.857521 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89cf7b-005b-4efc-be66-983d3d96f329 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:57.865297 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201d329-893a-43a4-ab49-f54541f56407 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:57.896012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-5b89cf7b-005b-4efc-be66-983d3d96f329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:57.896012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:57.896012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:57.896012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:57.896012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:57.896012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:57.896012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:57.896012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:57.896012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:57.896012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:57.896012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:57.896012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:57.896012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:57.896012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:57.896012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:57.897004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:57.897004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:57.897004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:57.897004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:57.897004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:57.897004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:57.897004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:57.897004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:57.897004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:57.897004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:57.897004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:57.897004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:57.897004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:57.897004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:57.897004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:57.897004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:57.897004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:57.897919 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:57.897919 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:57.897919 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:57.897919 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:57.900316 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 379/783] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:57.906063 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89cf7b-005b-4efc-be66-983d3d96f329 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:58.018012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:58.022341 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89cf7b-005b-4efc-be66-983d3d96f329 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:58.040034 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201d329-893a-43a4-ab49-f54541f56407 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:58.059677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:58.061654 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d743dd-ac52-4616-ae80-431ac4db72ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:58.062628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d743dd-ac52-4616-ae80-431ac4db72ac None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:58.063142 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d743dd-ac52-4616-ae80-431ac4db72ac None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:58.064199 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d743dd-ac52-4616-ae80-431ac4db72ac None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:58.065137 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d743dd-ac52-4616-ae80-431ac4db72ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:58.065831 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d743dd-ac52-4616-ae80-431ac4db72ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:58.067417 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d743dd-ac52-4616-ae80-431ac4db72ac None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:58.080261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 380/784] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:58.086147 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d743dd-ac52-4616-ae80-431ac4db72ac None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:58.100441 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54eb6b1-8c43-414a-b7c6-cf6e8e422e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:58.101447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54eb6b1-8c43-414a-b7c6-cf6e8e422e5e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:58.102124 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54eb6b1-8c43-414a-b7c6-cf6e8e422e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:58.102348 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54eb6b1-8c43-414a-b7c6-cf6e8e422e5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:58.103754 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54eb6b1-8c43-414a-b7c6-cf6e8e422e5e None admin] RBAC: Adding query filter params (interface=public, service_id=65c8fd08f4894030abe35ec0c6c8002e, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:58.114089 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54eb6b1-8c43-414a-b7c6-cf6e8e422e5e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:58.116523 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54eb6b1-8c43-414a-b7c6-cf6e8e422e5e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:58.136526 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 405/785] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 26 16:29:57 2022] GET /identity/v3/endpoints?service_id=65c8fd08f4894030abe35ec0c6c8002e&interface=public®ion_id=RegionOne => generated 194 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:58.143851 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54eb6b1-8c43-414a-b7c6-cf6e8e422e5e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:58.352070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d743dd-ac52-4616-ae80-431ac4db72ac None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:58.372887 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54eb6b1-8c43-414a-b7c6-cf6e8e422e5e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:58.393995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135a88a-c868-43ab-b85b-c699adf7b11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:58.394827 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135a88a-c868-43ab-b85b-c699adf7b11c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:58.395104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135a88a-c868-43ab-b85b-c699adf7b11c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:58.395373 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135a88a-c868-43ab-b85b-c699adf7b11c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:58.404518 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135a88a-c868-43ab-b85b-c699adf7b11c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:58.406025 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135a88a-c868-43ab-b85b-c699adf7b11c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:58.421527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-0135a88a-c868-43ab-b85b-c699adf7b11c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:29:58.421527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:58.421527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:58.421527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:58.421527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:58.421527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:58.421527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:58.421527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:58.421527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:58.421527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:58.421527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:58.421527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:58.421527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:58.421527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:58.421527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:58.421527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:58.423052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:58.423052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:58.423052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:58.423052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:58.423052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:58.423052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:58.423052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:58.423052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:58.423052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:58.423052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:58.423052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:58.423052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:58.423052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:58.423052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:58.423052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:58.423052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:58.423052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:58.423052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:58.424064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:58.424064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:58.424064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:58.424064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:58.424064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:58.424064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:58.424064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:58.424064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:58.424064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:29:58.424064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:58.424064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 381/786] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:29:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:58.429302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6627ec-d5e0-4185-b8d6-edb301db180d None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:58.429302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6627ec-d5e0-4185-b8d6-edb301db180d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:58.429302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6627ec-d5e0-4185-b8d6-edb301db180d None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:58.429302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 382/787] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:29:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:29:58.434706 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6627ec-d5e0-4185-b8d6-edb301db180d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:58.438828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce475f-d70b-41fc-b4f4-9667c95ebf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:58.439591 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce475f-d70b-41fc-b4f4-9667c95ebf27 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:58.439887 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce475f-d70b-41fc-b4f4-9667c95ebf27 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:58.440189 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce475f-d70b-41fc-b4f4-9667c95ebf27 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:58.440938 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce475f-d70b-41fc-b4f4-9667c95ebf27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:58.442458 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce475f-d70b-41fc-b4f4-9667c95ebf27 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:58.457063 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 406/788] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 26 16:29:58 2022] GET /identity/v3/services => generated 772 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:58.459087 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a696b8-cf6d-4179-8c95-538740be32b4 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:58.459224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a696b8-cf6d-4179-8c95-538740be32b4 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:58.459443 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a696b8-cf6d-4179-8c95-538740be32b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:58.462801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:58.490197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f2a696b8-cf6d-4179-8c95-538740be32b4 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:58.497293 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f2a696b8-cf6d-4179-8c95-538740be32b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:58.586373 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:58.607272 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6627ec-d5e0-4185-b8d6-edb301db180d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:58.645534 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 407/789] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:29:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:58.666119 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a696b8-cf6d-4179-8c95-538740be32b4 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:58.677878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd04619-be1b-4e7a-a04d-76ca43fc97c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:58.678959 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd04619-be1b-4e7a-a04d-76ca43fc97c4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:58.679555 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd04619-be1b-4e7a-a04d-76ca43fc97c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:58.680036 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd04619-be1b-4e7a-a04d-76ca43fc97c4 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:58.681087 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd04619-be1b-4e7a-a04d-76ca43fc97c4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:58.681789 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd04619-be1b-4e7a-a04d-76ca43fc97c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:58.683651 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd04619-be1b-4e7a-a04d-76ca43fc97c4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:58.706289 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 383/790] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 26 16:29:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:58.712502 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd04619-be1b-4e7a-a04d-76ca43fc97c4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:58.810607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:58.819526 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a696b8-cf6d-4179-8c95-538740be32b4 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:58.844168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd04619-be1b-4e7a-a04d-76ca43fc97c4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:58.861432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f181ee5-3cd2-4dfe-986e-ad3a9c7e343a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:58.862660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f181ee5-3cd2-4dfe-986e-ad3a9c7e343a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:58.863152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f181ee5-3cd2-4dfe-986e-ad3a9c7e343a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:58.863632 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f181ee5-3cd2-4dfe-986e-ad3a9c7e343a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:58.878721 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f181ee5-3cd2-4dfe-986e-ad3a9c7e343a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:58.884902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80d885-6e55-45ea-8e57-ed2271e85609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:58.885739 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80d885-6e55-45ea-8e57-ed2271e85609 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:58.886025 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80d885-6e55-45ea-8e57-ed2271e85609 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:58.886302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80d885-6e55-45ea-8e57-ed2271e85609 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:58.889531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-9f181ee5-3cd2-4dfe-986e-ad3a9c7e343a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:58.889531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:58.889531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:58.889531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:58.889531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:58.889531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:58.889531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:58.889531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:58.889531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:58.889531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:58.889531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:58.889531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:58.889531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:58.889531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:58.889531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:58.889531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:58.890457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:58.890457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:58.890457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:58.890457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:58.890457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:58.890457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:58.890457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:58.890457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:58.890457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:58.890457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:58.890457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:58.890457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:58.890457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:58.890457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:58.890457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:58.890457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:58.891377 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:58.891377 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:58.891377 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:58.891377 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:58.891377 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:58.891377 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:58.891377 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:58.891377 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:58.891377 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:58.891377 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:58.891377 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:58.891377 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:58.894660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 408/791] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:29:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:58.899406 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80d885-6e55-45ea-8e57-ed2271e85609 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:58.901153 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80d885-6e55-45ea-8e57-ed2271e85609 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:58.902522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f181ee5-3cd2-4dfe-986e-ad3a9c7e343a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:58.923510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-3f80d885-6e55-45ea-8e57-ed2271e85609 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:58.923510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:58.923510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:58.923510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:58.923510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:58.923510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:58.923510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:58.923510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:58.923510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:58.923510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:58.923510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:58.923510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:58.923510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:58.923510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:58.923510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:58.924482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:58.924482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:58.924482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:58.924482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:58.924482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:58.924482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:58.924482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:58.924482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:58.924482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:58.924482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:58.924482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:58.924482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:58.924482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:58.924482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:58.924482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:58.924482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:58.924482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:58.925845 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:58.925845 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:58.925845 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:58.925845 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:58.925845 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 384/792] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:29:58.931733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80d885-6e55-45ea-8e57-ed2271e85609 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:58.938908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:59.058001 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f181ee5-3cd2-4dfe-986e-ad3a9c7e343a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:59.088057 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80d885-6e55-45ea-8e57-ed2271e85609 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:59.142166 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2059d03-ec13-4720-a4be-9b8423733ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:59.142774 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2059d03-ec13-4720-a4be-9b8423733ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:59.143061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2059d03-ec13-4720-a4be-9b8423733ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:59.143337 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2059d03-ec13-4720-a4be-9b8423733ab1 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:59.144091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2059d03-ec13-4720-a4be-9b8423733ab1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:59.144401 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2059d03-ec13-4720-a4be-9b8423733ab1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:59.145811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2059d03-ec13-4720-a4be-9b8423733ab1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:59.156218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 409/793] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:29:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:59.162931 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2059d03-ec13-4720-a4be-9b8423733ab1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:59.173650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:59.187908 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39596a31-3fcd-4bc6-8854-26c0985d107e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:59.188982 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39596a31-3fcd-4bc6-8854-26c0985d107e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:59.189687 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39596a31-3fcd-4bc6-8854-26c0985d107e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:59.189931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39596a31-3fcd-4bc6-8854-26c0985d107e None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:59.190882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39596a31-3fcd-4bc6-8854-26c0985d107e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:59.191197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39596a31-3fcd-4bc6-8854-26c0985d107e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:59.192688 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39596a31-3fcd-4bc6-8854-26c0985d107e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:59.219267 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 385/794] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:59.223360 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39596a31-3fcd-4bc6-8854-26c0985d107e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:59.355764 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39596a31-3fcd-4bc6-8854-26c0985d107e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:59.414046 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eaea49-ccfc-416c-a6bc-c90bec7a2c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:59.414046 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaea49-ccfc-416c-a6bc-c90bec7a2c74 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:59.414046 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaea49-ccfc-416c-a6bc-c90bec7a2c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:59.414046 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaea49-ccfc-416c-a6bc-c90bec7a2c74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:59.418516 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eaea49-ccfc-416c-a6bc-c90bec7a2c74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:59.420037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eaea49-ccfc-416c-a6bc-c90bec7a2c74 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:59.457075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-66eaea49-ccfc-416c-a6bc-c90bec7a2c74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:59.457075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:59.457075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:59.457075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:59.457075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:59.457075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:59.457075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:59.457075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:59.457075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:59.457075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:59.457075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:59.457075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:59.457075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:29:59.457075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:29:59.457075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:29:59.459385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:29:59.459385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:59.459385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:59.459385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:59.459385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:59.459385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:59.459385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:59.459385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:59.459385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:29:59.459385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:59.459385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:59.459385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:59.459385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:59.459385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:59.459385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:59.459385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:59.459385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:59.461531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:29:59.461531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:29:59.461531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:29:59.461531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:29:59.461531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:29:59.461531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:29:59.461531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:29:59.461531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:29:59.462338 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:59.462986 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 386/795] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:29:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:59.466321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eaea49-ccfc-416c-a6bc-c90bec7a2c74 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:59.470266 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2059d03-ec13-4720-a4be-9b8423733ab1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:59.511120 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abc771-62f5-4b0c-a3e7-4526e95f3f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:59.511973 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abc771-62f5-4b0c-a3e7-4526e95f3f01 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:59.512338 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abc771-62f5-4b0c-a3e7-4526e95f3f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:59.512615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abc771-62f5-4b0c-a3e7-4526e95f3f01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:59.525746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abc771-62f5-4b0c-a3e7-4526e95f3f01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:59.527377 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abc771-62f5-4b0c-a3e7-4526e95f3f01 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:59.548432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-57abc771-62f5-4b0c-a3e7-4526e95f3f01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:59.548432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:59.548432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:59.548432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:59.548432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:59.548432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:59.548432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:59.548432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:59.548432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:59.548432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:59.548432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:59.548432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:59.548432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:29:59.548432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:29:59.548432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:29:59.551404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:29:59.551404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:59.551404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:59.551404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:59.551404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:59.551404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:59.551404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:59.551404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:59.551404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:59.551404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:59.551404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:59.551404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:59.551404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:59.551404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:59.551404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:59.551404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:59.551404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:59.554513 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:29:59.554513 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:29:59.554513 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:29:59.554513 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:59.554513 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 410/796] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:59.561732 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abc771-62f5-4b0c-a3e7-4526e95f3f01 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:59.662530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:59.682943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abc771-62f5-4b0c-a3e7-4526e95f3f01 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:59.727711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ab452-9e1f-479a-b29a-fba9826e2601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:59.728463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ab452-9e1f-479a-b29a-fba9826e2601 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:59.728747 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ab452-9e1f-479a-b29a-fba9826e2601 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:59.729027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ab452-9e1f-479a-b29a-fba9826e2601 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:59.729811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ab452-9e1f-479a-b29a-fba9826e2601 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:59.730127 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ab452-9e1f-479a-b29a-fba9826e2601 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:59.731788 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ab452-9e1f-479a-b29a-fba9826e2601 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:59.747308 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 411/797] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:59.753490 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ab452-9e1f-479a-b29a-fba9826e2601 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:59.773662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:59.809025 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eaea49-ccfc-416c-a6bc-c90bec7a2c74 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:59.871285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ab452-9e1f-479a-b29a-fba9826e2601 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:59.887161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5b8ba-01b8-45c0-b906-3fe35a1b32de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:59.887879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5b8ba-01b8-45c0-b906-3fe35a1b32de None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:59.888179 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5b8ba-01b8-45c0-b906-3fe35a1b32de None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:59.888505 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5b8ba-01b8-45c0-b906-3fe35a1b32de None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:59.889554 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5b8ba-01b8-45c0-b906-3fe35a1b32de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:59.889867 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5b8ba-01b8-45c0-b906-3fe35a1b32de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:59.891870 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5b8ba-01b8-45c0-b906-3fe35a1b32de None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:59.912044 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01457e2d-93dc-4765-9f17-a57e663552ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:59.912852 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01457e2d-93dc-4765-9f17-a57e663552ce None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:59.913146 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01457e2d-93dc-4765-9f17-a57e663552ce None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:59.913507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01457e2d-93dc-4765-9f17-a57e663552ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:59.922269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01457e2d-93dc-4765-9f17-a57e663552ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:59.924333 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01457e2d-93dc-4765-9f17-a57e663552ce None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:59.926159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 387/798] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:29:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:59.934109 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5b8ba-01b8-45c0-b906-3fe35a1b32de None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:59.945914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-01457e2d-93dc-4765-9f17-a57e663552ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:29:59.945914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:59.945914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:59.945914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:59.945914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:59.945914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:59.945914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:59.945914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:59.945914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:59.945914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:59.945914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:59.945914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:59.945914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:29:59.945914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:29:59.945914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:29:59.945914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:29:59.947463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:59.947463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:59.947463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:29:59.947463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:59.947463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:29:59.947463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:29:59.947463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:59.947463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:59.947463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:59.947463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:59.947463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:59.947463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:29:59.947463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:59.947463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:59.947463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:59.947463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:59.947463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:59.947463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:59.949279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:59.949279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:59.949279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:29:59.949279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:29:59.949279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:29:59.949279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:29:59.949279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:29:59.949279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:29:59.949279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:29:59.949279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:29:59.949279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 412/799] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 26 16:29:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:59.954823 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01457e2d-93dc-4765-9f17-a57e663552ce None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:00.026347 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:00.068801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01457e2d-93dc-4765-9f17-a57e663552ce None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:00.119297 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5b8ba-01b8-45c0-b906-3fe35a1b32de None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:00.121330 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a2ccb-bf08-4f2a-a145-4c1c7e8688ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:00.122402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a2ccb-bf08-4f2a-a145-4c1c7e8688ad None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:00.122799 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a2ccb-bf08-4f2a-a145-4c1c7e8688ad None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:00.123213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a2ccb-bf08-4f2a-a145-4c1c7e8688ad None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:00.124532 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a2ccb-bf08-4f2a-a145-4c1c7e8688ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:00.124997 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a2ccb-bf08-4f2a-a145-4c1c7e8688ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:00.127454 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a2ccb-bf08-4f2a-a145-4c1c7e8688ad None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:00.130888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:00.157709 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 413/800] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 26 16:29:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:00.159656 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31811a-0eb5-4218-a1bf-2c0de6c649a6 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:00.160089 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31811a-0eb5-4218-a1bf-2c0de6c649a6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:00.160506 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31811a-0eb5-4218-a1bf-2c0de6c649a6 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:00.163266 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 414/801] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:00.165119 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724813e-597b-4ed2-9a0f-08576eaa83cf None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:00.165658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724813e-597b-4ed2-9a0f-08576eaa83cf None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:00.166090 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724813e-597b-4ed2-9a0f-08576eaa83cf None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:00.168079 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13ed84-2379-4e68-9414-e37cfed588ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:00.174783 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 415/802] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:00.175024 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13ed84-2379-4e68-9414-e37cfed588ad None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:00.175024 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13ed84-2379-4e68-9414-e37cfed588ad None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:00.175024 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13ed84-2379-4e68-9414-e37cfed588ad None admin] PATH_INFO: `/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/07cc455638fb4db4939af3657ab4203e/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:00.175352 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724813e-597b-4ed2-9a0f-08576eaa83cf None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:00.175506 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13ed84-2379-4e68-9414-e37cfed588ad None admin] RBAC: Authorizing `identity:create_grant(project_id=a3379cdd914747758e71b3b05c5921b1, user_id=07cc455638fb4db4939af3657ab4203e, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:00.175506 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13ed84-2379-4e68-9414-e37cfed588ad None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:00.288937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724813e-597b-4ed2-9a0f-08576eaa83cf None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:00.295924 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 388/803] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:29:59 2022] PUT /identity/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/07cc455638fb4db4939af3657ab4203e/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:30:00.307127 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33e4bd-68c3-4295-a77d-67dced156bb6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:00.307579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33e4bd-68c3-4295-a77d-67dced156bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:00.308143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33e4bd-68c3-4295-a77d-67dced156bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:00.317432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:00.347534 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e9646-a96c-4fb0-80c4-70e90f2d2433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:00.348559 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e9646-a96c-4fb0-80c4-70e90f2d2433 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:00.349062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e9646-a96c-4fb0-80c4-70e90f2d2433 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:00.349560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e9646-a96c-4fb0-80c4-70e90f2d2433 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:00.351619 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9d33e4bd-68c3-4295-a77d-67dced156bb6 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:00.354051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9d33e4bd-68c3-4295-a77d-67dced156bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:00.473838 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e9646-a96c-4fb0-80c4-70e90f2d2433 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:00.478107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e9646-a96c-4fb0-80c4-70e90f2d2433 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:00.505616 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 389/804] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:00.508310 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1d2aa-39b3-4ce4-a750-6f12154495f0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:00.509023 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1d2aa-39b3-4ce4-a750-6f12154495f0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:00.509792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1d2aa-39b3-4ce4-a750-6f12154495f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:00.540700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ccf1d2aa-39b3-4ce4-a750-6f12154495f0 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:00.543069 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ccf1d2aa-39b3-4ce4-a750-6f12154495f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:00.650780 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 416/805] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:30:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:00.655398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 390/806] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:00.658349 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1d2aa-39b3-4ce4-a750-6f12154495f0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:00.659508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e9646-a96c-4fb0-80c4-70e90f2d2433 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:00.741430 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:00.748454 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:00.914562 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1d2aa-39b3-4ce4-a750-6f12154495f0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:00.939326 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e9646-a96c-4fb0-80c4-70e90f2d2433 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:00.987371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7a67b-34c1-44eb-9887-384337b19be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:00.988623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7a67b-34c1-44eb-9887-384337b19be2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:00.989094 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7a67b-34c1-44eb-9887-384337b19be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:00.989537 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7a67b-34c1-44eb-9887-384337b19be2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:01.004729 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7a67b-34c1-44eb-9887-384337b19be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:01.006300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7a67b-34c1-44eb-9887-384337b19be2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:01.022037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b03b48-ac32-4fb0-b9af-b42db69be1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:01.022886 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b03b48-ac32-4fb0-b9af-b42db69be1ff None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:01.023171 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b03b48-ac32-4fb0-b9af-b42db69be1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:01.023450 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b03b48-ac32-4fb0-b9af-b42db69be1ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:01.050948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-66f7a67b-34c1-44eb-9887-384337b19be2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:01.050948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:01.050948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:01.050948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:01.050948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:01.050948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:01.050948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:01.050948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:01.050948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:01.050948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:01.050948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:01.050948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:01.050948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:01.050948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:01.050948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:01.051922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:01.051922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:01.051922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:01.051922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:01.051922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:01.051922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:01.051922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:01.051922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:01.051922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:01.051922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:01.051922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:01.051922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:01.051922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:01.051922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:01.051922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:01.051922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:01.051922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:01.052815 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:01.052815 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:01.052815 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:01.052815 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:01.060453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 417/807] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:01.062046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7a67b-34c1-44eb-9887-384337b19be2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:01.086318 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b03b48-ac32-4fb0-b9af-b42db69be1ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:01.106668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-51b03b48-ac32-4fb0-b9af-b42db69be1ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:30:01.106668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:01.106668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:01.106668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:01.106668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:01.106668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:01.106668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:01.106668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:01.106668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:01.106668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:01.106668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:01.106668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:01.106668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:01.106668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:01.106668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:01.106668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:01.107665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:01.107665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:01.107665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:01.107665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:01.107665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:01.107665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:01.107665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:01.107665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:01.107665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:01.107665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:01.107665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:01.107665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:01.107665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:01.107665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:01.107665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:01.107665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:01.108560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:01.108560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:01.108560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:01.108560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:01.108560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:01.108560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:01.108560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:01.108560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:01.108560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:01.108560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:01.108560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:30:01.108560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:01.117795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 391/808] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:30:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 460 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:01.120977 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b03b48-ac32-4fb0-b9af-b42db69be1ff None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:01.302717 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:01.369783 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7a67b-34c1-44eb-9887-384337b19be2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:01.432327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705907d8-df0f-4ef6-874e-1c17a7c49d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:01.440780 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705907d8-df0f-4ef6-874e-1c17a7c49d60 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:01.441331 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705907d8-df0f-4ef6-874e-1c17a7c49d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:01.441629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705907d8-df0f-4ef6-874e-1c17a7c49d60 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:01.445375 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705907d8-df0f-4ef6-874e-1c17a7c49d60 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:01.447583 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705907d8-df0f-4ef6-874e-1c17a7c49d60 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:01.486989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:01.501575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-705907d8-df0f-4ef6-874e-1c17a7c49d60 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:30:01.501575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:01.501575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:30:01.501575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:30:01.501575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:30:01.501575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:30:01.501575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:30:01.501575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:01.501575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:30:01.501575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:01.501575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:01.501575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:01.501575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:01.501575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:01.501575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:01.501575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:01.502917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:01.502917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:01.502917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:01.502917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:01.502917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:01.502917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:01.502917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:01.502917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:30:01.502917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:30:01.502917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:30:01.502917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:30:01.502917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:01.502917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:01.502917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:01.502917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:01.502917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:01.503880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:01.503880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:01.503880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:01.503880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:01.503880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:01.503880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:01.503880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:01.503880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:01.503880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:01.503880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:01.503880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:01.503880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:30:01.503880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:01.503880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:30:01.503880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:01.512407 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 418/809] 10.222.0.48 () {56 vars in 1129 bytes} [Thu May 26 16:30:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:01.512407 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705907d8-df0f-4ef6-874e-1c17a7c49d60 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:01.514850 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b03b48-ac32-4fb0-b9af-b42db69be1ff None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:01.580779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8883a2-4894-4f28-bcb0-e741ccf8191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:01.582380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8883a2-4894-4f28-bcb0-e741ccf8191b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:01.583011 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8883a2-4894-4f28-bcb0-e741ccf8191b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:01.583616 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8883a2-4894-4f28-bcb0-e741ccf8191b None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:01.584664 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8883a2-4894-4f28-bcb0-e741ccf8191b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:01.585228 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8883a2-4894-4f28-bcb0-e741ccf8191b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:01.586963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8883a2-4894-4f28-bcb0-e741ccf8191b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:01.602474 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 392/810] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:01.604004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8883a2-4894-4f28-bcb0-e741ccf8191b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:01.675150 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705907d8-df0f-4ef6-874e-1c17a7c49d60 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:01.720104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8757f-697b-4731-8116-1d063629c558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:01.721465 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8757f-697b-4731-8116-1d063629c558 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:01.721827 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8757f-697b-4731-8116-1d063629c558 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:01.722275 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8757f-697b-4731-8116-1d063629c558 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:01.723466 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8757f-697b-4731-8116-1d063629c558 None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:01.723959 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8757f-697b-4731-8116-1d063629c558 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:01.726309 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8757f-697b-4731-8116-1d063629c558 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:01.730215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:01.740980 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 419/811] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 16:30:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:01.743336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8757f-697b-4731-8116-1d063629c558 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:01.758709 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8883a2-4894-4f28-bcb0-e741ccf8191b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:01.799510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37633db6-1bb2-48b4-b51e-0d0668158995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:01.800681 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37633db6-1bb2-48b4-b51e-0d0668158995 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:01.801586 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37633db6-1bb2-48b4-b51e-0d0668158995 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:01.802077 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37633db6-1bb2-48b4-b51e-0d0668158995 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:01.803420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37633db6-1bb2-48b4-b51e-0d0668158995 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:01.803926 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37633db6-1bb2-48b4-b51e-0d0668158995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:01.805594 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37633db6-1bb2-48b4-b51e-0d0668158995 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:01.816426 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 393/812] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 26 16:30:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:01.816426 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559a353-2689-4a05-b859-2bcc11238f1b None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:01.816426 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559a353-2689-4a05-b859-2bcc11238f1b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:01.816426 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559a353-2689-4a05-b859-2bcc11238f1b None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:01.816426 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 394/813] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:01.816426 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559a353-2689-4a05-b859-2bcc11238f1b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:01.834424 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:01.897977 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8757f-697b-4731-8116-1d063629c558 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:01.941412 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04827c4-aaa1-489b-af2e-ad47bf457a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:01.942472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04827c4-aaa1-489b-af2e-ad47bf457a54 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:01.944442 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04827c4-aaa1-489b-af2e-ad47bf457a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:01.944442 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04827c4-aaa1-489b-af2e-ad47bf457a54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:01.956005 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04827c4-aaa1-489b-af2e-ad47bf457a54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:01.956473 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04827c4-aaa1-489b-af2e-ad47bf457a54 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:01.969193 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559a353-2689-4a05-b859-2bcc11238f1b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:01.974296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-b04827c4-aaa1-489b-af2e-ad47bf457a54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:01.974296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:01.974296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:01.974296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:01.974296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:01.974296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:01.974296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:01.974296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:01.974296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:01.974296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:01.974296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:01.974296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:01.974296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:30:01.974296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:30:01.974296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:30:01.975898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:30:01.975898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:01.975898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:01.975898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:01.975898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:01.975898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:01.975898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:01.975898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:01.975898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:01.975898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:01.975898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:01.975898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:01.975898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:01.975898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:01.975898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:01.975898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:01.975898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:01.977475 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:30:01.977475 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:30:01.977475 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:30:01.977475 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:30:01.977475 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:30:01.977475 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:30:01.977475 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:01.977475 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:01.982803 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 420/814] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:30:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:01.984489 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04827c4-aaa1-489b-af2e-ad47bf457a54 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:02.020982 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affce20b-80f8-4e96-8817-14c55d3a074e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:02.021836 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affce20b-80f8-4e96-8817-14c55d3a074e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:02.022124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affce20b-80f8-4e96-8817-14c55d3a074e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:02.022403 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affce20b-80f8-4e96-8817-14c55d3a074e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:02.033940 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affce20b-80f8-4e96-8817-14c55d3a074e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:02.035424 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affce20b-80f8-4e96-8817-14c55d3a074e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:02.059589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-affce20b-80f8-4e96-8817-14c55d3a074e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:02.059589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:02.059589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:02.059589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:02.059589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:02.059589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:02.059589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:02.059589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:02.059589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:02.059589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:02.059589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:02.059589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:02.059589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:02.059589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:02.059589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:02.061460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:02.061460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:02.061460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:02.061460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:02.061460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:02.061460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:02.061460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:02.061460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:02.061460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:02.061460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:02.061460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:02.061460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:02.061460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:02.061460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:02.061460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:02.061460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:02.061460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:02.063573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:02.063573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:02.063573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:02.063573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:02.070235 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 395/815] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:02.071128 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:02.075023 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3a0fd-13d1-4f93-b6ca-a9165102644f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:02.075846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3a0fd-13d1-4f93-b6ca-a9165102644f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:02.076780 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3a0fd-13d1-4f93-b6ca-a9165102644f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:02.100572 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-29b3a0fd-13d1-4f93-b6ca-a9165102644f None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:02.102454 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-29b3a0fd-13d1-4f93-b6ca-a9165102644f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:02.135616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04827c4-aaa1-489b-af2e-ad47bf457a54 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:02.181548 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49caea-deb4-43ca-b489-b4264718f07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:02.182937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49caea-deb4-43ca-b489-b4264718f07c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:02.183065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49caea-deb4-43ca-b489-b4264718f07c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:02.183475 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:02.183605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49caea-deb4-43ca-b489-b4264718f07c None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:02.184929 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49caea-deb4-43ca-b489-b4264718f07c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:02.184929 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49caea-deb4-43ca-b489-b4264718f07c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:02.187007 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49caea-deb4-43ca-b489-b4264718f07c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:02.192536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 396/816] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:02.193809 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3a0fd-13d1-4f93-b6ca-a9165102644f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:02.197324 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 421/817] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 26 16:30:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:02.197324 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49caea-deb4-43ca-b489-b4264718f07c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:02.317143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3a0fd-13d1-4f93-b6ca-a9165102644f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:02.329410 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49caea-deb4-43ca-b489-b4264718f07c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:02.355396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:02.368140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47af21d-5606-42f5-b065-becf2a833a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:02.368825 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47af21d-5606-42f5-b065-becf2a833a2d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:02.369108 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47af21d-5606-42f5-b065-becf2a833a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:02.369422 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47af21d-5606-42f5-b065-becf2a833a2d None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:02.370166 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47af21d-5606-42f5-b065-becf2a833a2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:02.374447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47af21d-5606-42f5-b065-becf2a833a2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:02.374447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47af21d-5606-42f5-b065-becf2a833a2d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:02.374654 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636ba0c-84e8-4271-a4aa-1c5107df6cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:02.374654 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636ba0c-84e8-4271-a4aa-1c5107df6cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:02.374654 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636ba0c-84e8-4271-a4aa-1c5107df6cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:02.374928 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636ba0c-84e8-4271-a4aa-1c5107df6cd9 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:02.375986 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636ba0c-84e8-4271-a4aa-1c5107df6cd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:02.376498 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636ba0c-84e8-4271-a4aa-1c5107df6cd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:02.379016 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636ba0c-84e8-4271-a4aa-1c5107df6cd9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:02.390400 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 422/818] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:02.390400 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47af21d-5606-42f5-b065-becf2a833a2d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:02.403523 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 397/819] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:30:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:02.403523 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636ba0c-84e8-4271-a4aa-1c5107df6cd9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:02.476729 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:02.515007 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47af21d-5606-42f5-b065-becf2a833a2d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:02.535608 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636ba0c-84e8-4271-a4aa-1c5107df6cd9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:02.552004 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4d4fc-a62f-4d09-b05d-18a6ad9b4163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:02.552675 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4d4fc-a62f-4d09-b05d-18a6ad9b4163 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:02.552958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4d4fc-a62f-4d09-b05d-18a6ad9b4163 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:02.553233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4d4fc-a62f-4d09-b05d-18a6ad9b4163 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:02.554004 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4d4fc-a62f-4d09-b05d-18a6ad9b4163 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:02.555372 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4d4fc-a62f-4d09-b05d-18a6ad9b4163 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:02.575311 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f1cc7-4d52-4e75-a010-ea7dc8407724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:02.576130 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f1cc7-4d52-4e75-a010-ea7dc8407724 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:02.576480 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f1cc7-4d52-4e75-a010-ea7dc8407724 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:02.576886 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f1cc7-4d52-4e75-a010-ea7dc8407724 None admin] PATH_INFO: `/v3/services/network` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:02.577589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f1cc7-4d52-4e75-a010-ea7dc8407724 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:02.579527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f1cc7-4d52-4e75-a010-ea7dc8407724 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:02.591638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-788f1cc7-4d52-4e75-a010-ea7dc8407724 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:30:02.591638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:02.591638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:30:02.591638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:30:02.591638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:30:02.591638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:30:02.591638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:30:02.591638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:02.591638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:30:02.591638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:02.591638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:02.591638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:02.591638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:02.591638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:02.591638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:02.591638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:02.591638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:02.592993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:02.592993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:02.592993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:02.592993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:02.592993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:02.592993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:02.592993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:30:02.592993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:30:02.592993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:30:02.592993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:30:02.592993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:02.592993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:02.592993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:02.592993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:02.592993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:02.592993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:02.594995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:02.594995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:02.594995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:02.594995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:02.594995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:02.594995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:02.594995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:02.594995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:02.594995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:02.594995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:02.594995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:30:02.594995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:02.594995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:30:02.594995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:02.594995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 398/820] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:30:02 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:02.596690 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f1cc7-4d52-4e75-a010-ea7dc8407724 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:02.714477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f1cc7-4d52-4e75-a010-ea7dc8407724 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:02.737505 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:02.753734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 423/821] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 26 16:30:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:30:02.754791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4d4fc-a62f-4d09-b05d-18a6ad9b4163 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:02.764566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755cb4e4-50b4-415a-a8f0-88a393d63eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:02.765467 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cb4e4-50b4-415a-a8f0-88a393d63eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:02.765758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cb4e4-50b4-415a-a8f0-88a393d63eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:02.766038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cb4e4-50b4-415a-a8f0-88a393d63eb0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:02.783473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755cb4e4-50b4-415a-a8f0-88a393d63eb0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:02.786087 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755cb4e4-50b4-415a-a8f0-88a393d63eb0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:02.813943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-755cb4e4-50b4-415a-a8f0-88a393d63eb0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:30:02.813943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:02.813943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:02.813943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:02.813943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:02.813943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:02.813943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:02.813943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:02.813943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:02.813943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:02.813943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:02.813943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:02.813943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:30:02.813943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:30:02.813943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:30:02.813943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:30:02.821640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:02.821640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:02.821640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:30:02.821640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:02.821640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:30:02.821640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:02.821640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:02.821640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:02.821640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:02.821640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:02.821640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:02.821640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:02.821640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:02.821640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:02.821640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:02.821640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:02.821640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:02.821640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:02.823369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:02.823369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:02.823369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:30:02.823369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:30:02.823369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:30:02.823369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:30:02.823369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:30:02.823369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:30:02.823369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:30:02.823369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:02.823369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 399/822] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 26 16:30:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:02.823369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755cb4e4-50b4-415a-a8f0-88a393d63eb0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:02.855972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:02.950907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4d4fc-a62f-4d09-b05d-18a6ad9b4163 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:02.993401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755cb4e4-50b4-415a-a8f0-88a393d63eb0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:02.995125 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98d365-df45-41ce-bcd9-58e7d755cf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:02.995898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98d365-df45-41ce-bcd9-58e7d755cf25 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:02.996079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98d365-df45-41ce-bcd9-58e7d755cf25 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:02.996555 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98d365-df45-41ce-bcd9-58e7d755cf25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:02.997553 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98d365-df45-41ce-bcd9-58e7d755cf25 None admin] RBAC: Adding query filter params (role.id=796e313fa8794ac885ccf6300d09332a, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=35c9fa9c29494ff9b1f749974dca2719) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:02.997860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98d365-df45-41ce-bcd9-58e7d755cf25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:03.000232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98d365-df45-41ce-bcd9-58e7d755cf25 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:03.007017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 424/823] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:30:02 2022] GET /identity/v3/role_assignments?user.id=35c9fa9c29494ff9b1f749974dca2719&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=796e313fa8794ac885ccf6300d09332a => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:03.007941 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98d365-df45-41ce-bcd9-58e7d755cf25 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:03.048063 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a096d-6e97-4a95-8a5b-33eb6d59fb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:03.048761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a096d-6e97-4a95-8a5b-33eb6d59fb1a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:03.049040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a096d-6e97-4a95-8a5b-33eb6d59fb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:03.049790 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a096d-6e97-4a95-8a5b-33eb6d59fb1a None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:03.051002 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a096d-6e97-4a95-8a5b-33eb6d59fb1a None admin] RBAC: Adding query filter params (name=network) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:03.051002 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a096d-6e97-4a95-8a5b-33eb6d59fb1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:03.052785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a096d-6e97-4a95-8a5b-33eb6d59fb1a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:03.059903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 400/824] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 16:30:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:03.061347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22449487-c545-4dfe-af6a-8f906615f5ea None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:03.061735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22449487-c545-4dfe-af6a-8f906615f5ea None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:03.062018 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22449487-c545-4dfe-af6a-8f906615f5ea None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:03.063633 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 401/825] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:03.066157 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22449487-c545-4dfe-af6a-8f906615f5ea None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:03.126236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:03.193973 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98d365-df45-41ce-bcd9-58e7d755cf25 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:03.196373 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:03.211019 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22449487-c545-4dfe-af6a-8f906615f5ea None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:03.249059 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aafe1e-8634-49c6-9103-4d28b29ff108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:03.249889 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aafe1e-8634-49c6-9103-4d28b29ff108 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:03.250060 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aafe1e-8634-49c6-9103-4d28b29ff108 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:03.250310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aafe1e-8634-49c6-9103-4d28b29ff108 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:03.251638 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aafe1e-8634-49c6-9103-4d28b29ff108 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:03.251943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aafe1e-8634-49c6-9103-4d28b29ff108 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:03.254526 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aafe1e-8634-49c6-9103-4d28b29ff108 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:03.272894 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e94e00-4aa3-4ce2-896f-99cb4022d689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:03.273658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e94e00-4aa3-4ce2-896f-99cb4022d689 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:03.273940 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e94e00-4aa3-4ce2-896f-99cb4022d689 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:03.274211 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e94e00-4aa3-4ce2-896f-99cb4022d689 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:03.275790 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e94e00-4aa3-4ce2-896f-99cb4022d689 None admin] RBAC: Adding query filter params (type=network) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:03.276099 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e94e00-4aa3-4ce2-896f-99cb4022d689 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:03.277643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e94e00-4aa3-4ce2-896f-99cb4022d689 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:03.282823 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 425/826] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 26 16:30:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:03.284176 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950f1ee-0423-4a18-a701-8b23cc07e37f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:03.284463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950f1ee-0423-4a18-a701-8b23cc07e37f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:03.284844 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950f1ee-0423-4a18-a701-8b23cc07e37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:03.287411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 402/827] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 16:30:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:03.291531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e94e00-4aa3-4ce2-896f-99cb4022d689 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:03.306887 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6950f1ee-0423-4a18-a701-8b23cc07e37f None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:03.308279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6950f1ee-0423-4a18-a701-8b23cc07e37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:03.400001 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 426/828] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:03.409526 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950f1ee-0423-4a18-a701-8b23cc07e37f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:03.445848 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e94e00-4aa3-4ce2-896f-99cb4022d689 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:03.459872 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:03.500975 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55724d41-5935-465c-8d8b-0bf9374a69e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:03.502051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55724d41-5935-465c-8d8b-0bf9374a69e8 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:03.502431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55724d41-5935-465c-8d8b-0bf9374a69e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:03.502775 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55724d41-5935-465c-8d8b-0bf9374a69e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:03.503912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55724d41-5935-465c-8d8b-0bf9374a69e8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:03.505899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55724d41-5935-465c-8d8b-0bf9374a69e8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:03.538124 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:03.549281 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950f1ee-0423-4a18-a701-8b23cc07e37f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:03.593115 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f01837-6c85-47d2-8a70-91f5e68b8fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:03.593996 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f01837-6c85-47d2-8a70-91f5e68b8fee None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:03.594418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f01837-6c85-47d2-8a70-91f5e68b8fee None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:03.594719 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f01837-6c85-47d2-8a70-91f5e68b8fee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:03.607301 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f01837-6c85-47d2-8a70-91f5e68b8fee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:03.608936 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f01837-6c85-47d2-8a70-91f5e68b8fee None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:03.629574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a2f01837-6c85-47d2-8a70-91f5e68b8fee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:03.629574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:03.629574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:03.629574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:03.629574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:03.629574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:03.629574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:03.629574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:03.629574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:03.629574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:03.629574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:03.629574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:03.629574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:03.629574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:03.629574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:03.631088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:03.631088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:03.631088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:03.631088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:03.631088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:03.631088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:03.631088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:03.631088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:03.631088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:03.631088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:03.631088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:03.631088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:03.631088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:03.631088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:03.631088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:03.631088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:03.631088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:03.638527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:03.638527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:03.638527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:03.638527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:03.638527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 427/829] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:03.638527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f01837-6c85-47d2-8a70-91f5e68b8fee None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:03.665736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 403/830] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 26 16:30:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:30:03.666956 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55724d41-5935-465c-8d8b-0bf9374a69e8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:03.796896 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f01837-6c85-47d2-8a70-91f5e68b8fee None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:03.889701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a3c80-f904-4d0d-99f6-e98e90be04c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:03.890520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a3c80-f904-4d0d-99f6-e98e90be04c5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:03.890803 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a3c80-f904-4d0d-99f6-e98e90be04c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:03.891108 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a3c80-f904-4d0d-99f6-e98e90be04c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:03.911092 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55724d41-5935-465c-8d8b-0bf9374a69e8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:03.911310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:03.920313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a3c80-f904-4d0d-99f6-e98e90be04c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:03.928446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d40a3c80-f904-4d0d-99f6-e98e90be04c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:03.928446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:03.928446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:03.928446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:03.928446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:03.928446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:03.928446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:03.928446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:03.928446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:03.928446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:03.928446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:03.928446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:03.928446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:03.928446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:03.928446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:03.928446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:03.929544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:03.929544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:03.929544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:03.929544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:03.929544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:03.929544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:03.929544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:03.929544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:03.929544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:03.929544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:03.929544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:03.929544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:03.929544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:03.929544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:03.929544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:03.929544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:03.930668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:03.930668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:03.930668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:03.930668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:03.930668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:03.930668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:03.930668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:03.930668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:03.930668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:03.930668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:03.930668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:03.930668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:03.933293 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 428/831] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:30:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:03.940827 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a3c80-f904-4d0d-99f6-e98e90be04c5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:03.981668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0a63e-b30e-4fb2-bedb-74d43b2bd35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:03.982350 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0a63e-b30e-4fb2-bedb-74d43b2bd35d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:03.982692 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0a63e-b30e-4fb2-bedb-74d43b2bd35d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:03.982993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0a63e-b30e-4fb2-bedb-74d43b2bd35d None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:03.983730 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0a63e-b30e-4fb2-bedb-74d43b2bd35d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:03.984118 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0a63e-b30e-4fb2-bedb-74d43b2bd35d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:03.986389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0a63e-b30e-4fb2-bedb-74d43b2bd35d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:04.003209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 404/832] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:04.010373 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0a63e-b30e-4fb2-bedb-74d43b2bd35d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:04.064987 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:04.120041 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a3c80-f904-4d0d-99f6-e98e90be04c5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:04.172888 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6083fa-eea3-4a64-a8d5-6edc05d50add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:04.173618 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6083fa-eea3-4a64-a8d5-6edc05d50add None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:04.177017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6083fa-eea3-4a64-a8d5-6edc05d50add None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:04.177364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6083fa-eea3-4a64-a8d5-6edc05d50add None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:04.178175 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6083fa-eea3-4a64-a8d5-6edc05d50add None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:04.178488 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6083fa-eea3-4a64-a8d5-6edc05d50add None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:04.179936 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6083fa-eea3-4a64-a8d5-6edc05d50add None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:04.190371 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0a63e-b30e-4fb2-bedb-74d43b2bd35d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:04.192823 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 429/833] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:30:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:04.202328 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6083fa-eea3-4a64-a8d5-6edc05d50add None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:04.231532 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f791405-5930-414b-b31a-e021400b230a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:04.232795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f791405-5930-414b-b31a-e021400b230a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:04.233320 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f791405-5930-414b-b31a-e021400b230a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:04.233800 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f791405-5930-414b-b31a-e021400b230a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:04.242081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f791405-5930-414b-b31a-e021400b230a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:04.243556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f791405-5930-414b-b31a-e021400b230a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:04.260650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-0f791405-5930-414b-b31a-e021400b230a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:04.260650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:04.260650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:04.260650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:04.260650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:04.260650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:04.260650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:04.260650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:04.260650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:04.260650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:04.260650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:04.260650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:04.260650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:30:04.260650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:30:04.260650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:30:04.261644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:30:04.261644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:04.261644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:04.261644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:04.261644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:04.261644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:04.261644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:04.261644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:04.261644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:04.261644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:04.261644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:04.261644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:04.261644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:04.261644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:04.261644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:04.261644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:04.261644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:04.262539 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:30:04.262539 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:30:04.262539 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:30:04.262539 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:30:04.262539 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:30:04.262539 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:30:04.262539 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:04.262539 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:04.263423 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 405/834] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:30:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:04.269523 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f791405-5930-414b-b31a-e021400b230a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:04.289230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:04.336361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6083fa-eea3-4a64-a8d5-6edc05d50add None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:04.376800 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32bd1c-d77d-4c7f-b473-fee4a7026b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:04.377949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32bd1c-d77d-4c7f-b473-fee4a7026b6b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:04.378424 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32bd1c-d77d-4c7f-b473-fee4a7026b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:04.378883 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32bd1c-d77d-4c7f-b473-fee4a7026b6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:04.381444 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:04.392010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32bd1c-d77d-4c7f-b473-fee4a7026b6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:04.393781 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32bd1c-d77d-4c7f-b473-fee4a7026b6b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:04.404144 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f791405-5930-414b-b31a-e021400b230a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:04.417210 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-1f32bd1c-d77d-4c7f-b473-fee4a7026b6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:04.417210 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:04.417210 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:04.417210 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:04.417210 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:04.417210 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:04.417210 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:04.417210 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:04.417210 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:04.417210 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:04.417210 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:04.417210 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:04.417210 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:04.417210 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:04.417210 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:04.418396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:04.418396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:04.418396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:04.418396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:04.418396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:04.418396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:04.418396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:04.418396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:04.418396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:04.418396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:04.418396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:04.418396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:04.418396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:04.418396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:04.418396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:04.418396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:04.418396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:04.419450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:04.419450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:04.419450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:04.419450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:04.421798 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 430/835] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:04.428998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32bd1c-d77d-4c7f-b473-fee4a7026b6b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:04.469732 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4584465-4653-46ab-9a05-361dc61614cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:04.471584 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4584465-4653-46ab-9a05-361dc61614cd None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:04.472079 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4584465-4653-46ab-9a05-361dc61614cd None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:04.472539 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4584465-4653-46ab-9a05-361dc61614cd None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:04.473784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4584465-4653-46ab-9a05-361dc61614cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:04.474284 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4584465-4653-46ab-9a05-361dc61614cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:04.476939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4584465-4653-46ab-9a05-361dc61614cd None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:04.497860 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 406/836] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:30:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:04.502856 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4584465-4653-46ab-9a05-361dc61614cd None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:04.570186 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32bd1c-d77d-4c7f-b473-fee4a7026b6b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:04.586585 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:04.610344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b898144-8e9f-4673-9747-938c65c18c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:04.611094 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b898144-8e9f-4673-9747-938c65c18c62 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:04.611377 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b898144-8e9f-4673-9747-938c65c18c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:04.611650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b898144-8e9f-4673-9747-938c65c18c62 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:04.612377 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b898144-8e9f-4673-9747-938c65c18c62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:04.612681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b898144-8e9f-4673-9747-938c65c18c62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:04.614293 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b898144-8e9f-4673-9747-938c65c18c62 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:04.632510 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 431/837] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:04.633804 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b898144-8e9f-4673-9747-938c65c18c62 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:04.647507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4584465-4653-46ab-9a05-361dc61614cd None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:04.697667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f13a6-cacf-4fe6-b74c-aa3663c1b20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:04.699547 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f13a6-cacf-4fe6-b74c-aa3663c1b20b None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:04.700062 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f13a6-cacf-4fe6-b74c-aa3663c1b20b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:04.700530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f13a6-cacf-4fe6-b74c-aa3663c1b20b None admin] PATH_INFO: `/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/4d2ab3eeb5b44979956dd223ac6b7c39/roles/d39d16b5286d4e1db63841f4917e08f2` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:04.717760 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:04.724258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f13a6-cacf-4fe6-b74c-aa3663c1b20b None admin] RBAC: Authorizing `identity:create_grant(project_id=a3379cdd914747758e71b3b05c5921b1, user_id=4d2ab3eeb5b44979956dd223ac6b7c39, role_id=d39d16b5286d4e1db63841f4917e08f2)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:04.726601 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f13a6-cacf-4fe6-b74c-aa3663c1b20b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:04.757327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b898144-8e9f-4673-9747-938c65c18c62 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:04.800953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da5ff6-b86a-4e17-a40f-238a795e2303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:04.801992 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da5ff6-b86a-4e17-a40f-238a795e2303 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:04.802287 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da5ff6-b86a-4e17-a40f-238a795e2303 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:04.802617 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da5ff6-b86a-4e17-a40f-238a795e2303 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:04.811258 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da5ff6-b86a-4e17-a40f-238a795e2303 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:04.812792 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da5ff6-b86a-4e17-a40f-238a795e2303 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:04.829541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-21da5ff6-b86a-4e17-a40f-238a795e2303 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:30:04.829541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:04.829541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:04.829541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:04.829541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:04.829541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:04.829541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:04.829541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:04.829541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:04.829541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:04.829541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:04.829541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:04.829541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:30:04.829541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:30:04.829541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:30:04.829541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:30:04.830666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:04.830666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:04.830666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:30:04.830666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:04.830666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:30:04.830666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:04.830666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:04.830666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:04.830666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:04.830666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:04.830666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:04.830666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:04.830666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:04.830666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:04.830666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:04.830666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:04.830666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:04.830666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:04.831655 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:04.831655 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:04.831655 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:30:04.831655 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:30:04.831655 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:30:04.831655 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:30:04.831655 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:30:04.831655 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:30:04.831655 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:30:04.831655 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:04.831655 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 432/838] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:30:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:04.838547 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da5ff6-b86a-4e17-a40f-238a795e2303 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:04.873027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:04.945783 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da5ff6-b86a-4e17-a40f-238a795e2303 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:04.983241 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283e47a-ec12-4e14-9622-7c22a86f68ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:04.984306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283e47a-ec12-4e14-9622-7c22a86f68ff None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:04.984802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283e47a-ec12-4e14-9622-7c22a86f68ff None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:04.986034 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283e47a-ec12-4e14-9622-7c22a86f68ff None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:04.987271 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283e47a-ec12-4e14-9622-7c22a86f68ff None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:04.987783 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283e47a-ec12-4e14-9622-7c22a86f68ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:04.989726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283e47a-ec12-4e14-9622-7c22a86f68ff None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:04.991500 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 407/839] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:30:04 2022] PUT /identity/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/4d2ab3eeb5b44979956dd223ac6b7c39/roles/d39d16b5286d4e1db63841f4917e08f2 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:30:05.012922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 433/840] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 26 16:30:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:05.019985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f13a6-cacf-4fe6-b74c-aa3663c1b20b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:05.152689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f13a6-cacf-4fe6-b74c-aa3663c1b20b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:05.200313 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb4198-c417-4d30-b75e-aaa61f2426f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:05.201240 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb4198-c417-4d30-b75e-aaa61f2426f1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:05.201559 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb4198-c417-4d30-b75e-aaa61f2426f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:05.201838 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb4198-c417-4d30-b75e-aaa61f2426f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:05.274143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:05.285752 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb4198-c417-4d30-b75e-aaa61f2426f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:05.287263 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb4198-c417-4d30-b75e-aaa61f2426f1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:05.393137 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 408/841] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:30:05 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:05.399801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283e47a-ec12-4e14-9622-7c22a86f68ff None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:05.406090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c0325-307f-4b21-943e-5ec69d07cba4 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:05.406782 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c0325-307f-4b21-943e-5ec69d07cba4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:05.407316 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c0325-307f-4b21-943e-5ec69d07cba4 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:05.409395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 409/842] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:05.415539 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f339c-2a65-4e54-87cb-db8e768194b2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:05.416129 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f339c-2a65-4e54-87cb-db8e768194b2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:05.416597 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f339c-2a65-4e54-87cb-db8e768194b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:05.435159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b56f339c-2a65-4e54-87cb-db8e768194b2 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:05.437201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b56f339c-2a65-4e54-87cb-db8e768194b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:05.521737 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:05.529322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 410/843] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:30:05.538384 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283e47a-ec12-4e14-9622-7c22a86f68ff None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:05.554295 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f339c-2a65-4e54-87cb-db8e768194b2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:05.576920 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:05.589507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab3969-5185-4943-ab5f-1cd6883bc809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:05.591003 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab3969-5185-4943-ab5f-1cd6883bc809 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:05.591543 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab3969-5185-4943-ab5f-1cd6883bc809 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:05.592050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab3969-5185-4943-ab5f-1cd6883bc809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:05.606657 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab3969-5185-4943-ab5f-1cd6883bc809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:05.608325 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab3969-5185-4943-ab5f-1cd6883bc809 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:05.628908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-bdab3969-5185-4943-ab5f-1cd6883bc809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:05.628908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:05.628908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:05.628908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:05.628908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:05.628908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:05.628908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:05.628908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:05.628908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:05.628908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:05.628908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:05.628908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:05.628908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:05.628908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:05.628908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:05.630136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:05.630136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:05.630136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:05.630136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:05.630136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:05.630136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:05.630136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:05.630136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:05.630136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:05.630136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:05.630136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:05.630136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:05.630136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:05.630136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:05.630136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:05.630136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:05.630136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:05.631080 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:05.631080 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:05.631080 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:05.631080 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:05.631080 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 434/844] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:05.632065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b511ce-19ab-46d6-acd0-733ed2a86153 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:05.632334 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b511ce-19ab-46d6-acd0-733ed2a86153 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:05.632601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b511ce-19ab-46d6-acd0-733ed2a86153 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:05.634224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 435/845] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:05.641469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b511ce-19ab-46d6-acd0-733ed2a86153 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:05.675420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f339c-2a65-4e54-87cb-db8e768194b2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:05.723062 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d34ed-195d-4176-970f-d9e42eabdb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:05.724234 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d34ed-195d-4176-970f-d9e42eabdb37 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:05.724721 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d34ed-195d-4176-970f-d9e42eabdb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:05.725286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d34ed-195d-4176-970f-d9e42eabdb37 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:05.726023 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d34ed-195d-4176-970f-d9e42eabdb37 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:05.727474 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d34ed-195d-4176-970f-d9e42eabdb37 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:05.740442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-444d34ed-195d-4176-970f-d9e42eabdb37 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:30:05.740442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:05.740442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:30:05.740442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:30:05.740442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:30:05.740442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:30:05.740442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:30:05.740442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:05.740442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:30:05.740442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:05.740442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:05.740442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:05.740442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:05.740442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:05.740442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:05.740442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:05.740442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:05.741537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:05.741537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:05.741537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:05.741537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:05.741537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:05.741537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:05.741537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:30:05.741537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:30:05.741537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:30:05.741537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:30:05.741537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:05.741537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:05.741537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:05.741537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:05.741537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:05.741537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:05.742393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:05.742393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:05.742393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:05.742393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:05.742393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:05.742393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:05.742393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:05.742393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:05.742393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:05.742393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:05.742393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:30:05.742393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:05.742393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:30:05.742393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:05.742393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 411/846] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 16:30:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:05.743389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51167ea-d644-4890-98d6-10af6c0d08c6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:05.743389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51167ea-d644-4890-98d6-10af6c0d08c6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:05.744067 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51167ea-d644-4890-98d6-10af6c0d08c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:05.763868 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b51167ea-d644-4890-98d6-10af6c0d08c6 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:05.765722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b51167ea-d644-4890-98d6-10af6c0d08c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:05.765911 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b511ce-19ab-46d6-acd0-733ed2a86153 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:05.809809 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27290177-f843-4364-9f06-2c5110aa0f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:05.810492 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27290177-f843-4364-9f06-2c5110aa0f41 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:05.810779 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27290177-f843-4364-9f06-2c5110aa0f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:05.811057 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27290177-f843-4364-9f06-2c5110aa0f41 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:05.811784 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27290177-f843-4364-9f06-2c5110aa0f41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:05.812141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27290177-f843-4364-9f06-2c5110aa0f41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:05.813984 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27290177-f843-4364-9f06-2c5110aa0f41 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:05.827866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 436/847] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:05.833518 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27290177-f843-4364-9f06-2c5110aa0f41 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:05.836384 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:05.841307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 412/848] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:05.846904 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51167ea-d644-4890-98d6-10af6c0d08c6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:05.868311 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:05.969704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27290177-f843-4364-9f06-2c5110aa0f41 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:05.983134 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51167ea-d644-4890-98d6-10af6c0d08c6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:06.016073 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e088c-eb91-489e-9273-22ec954866d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:06.016791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e088c-eb91-489e-9273-22ec954866d6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:06.017086 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e088c-eb91-489e-9273-22ec954866d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:06.017413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e088c-eb91-489e-9273-22ec954866d6 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:06.018082 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e088c-eb91-489e-9273-22ec954866d6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:06.018388 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e088c-eb91-489e-9273-22ec954866d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:06.019767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e088c-eb91-489e-9273-22ec954866d6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:06.029898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 437/849] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 16:30:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:06.029898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e088c-eb91-489e-9273-22ec954866d6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:06.033362 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302678d0-ee49-4c3a-ad67-c77d8821c526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:06.034195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302678d0-ee49-4c3a-ad67-c77d8821c526 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:06.034464 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302678d0-ee49-4c3a-ad67-c77d8821c526 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:06.034746 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302678d0-ee49-4c3a-ad67-c77d8821c526 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:06.044142 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302678d0-ee49-4c3a-ad67-c77d8821c526 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:06.046787 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302678d0-ee49-4c3a-ad67-c77d8821c526 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:06.062319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-302678d0-ee49-4c3a-ad67-c77d8821c526 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:06.062319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:06.062319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:06.062319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:06.062319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:06.062319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:06.062319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:06.062319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:06.062319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:06.062319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:06.062319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:06.062319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:06.062319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:30:06.062319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:30:06.062319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:30:06.063388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:30:06.063388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:06.063388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:06.063388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:06.063388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:06.063388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:06.063388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:06.063388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:06.063388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:06.063388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:06.063388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:06.063388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:06.063388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:06.063388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:06.063388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:06.063388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:06.063388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:06.064321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:30:06.064321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:30:06.064321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:30:06.064321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:30:06.064321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:30:06.064321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:30:06.064321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:06.064321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:06.064321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 413/850] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:30:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:06.064808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302678d0-ee49-4c3a-ad67-c77d8821c526 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:06.139309 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:06.167067 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:06.189708 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e088c-eb91-489e-9273-22ec954866d6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:06.198136 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302678d0-ee49-4c3a-ad67-c77d8821c526 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:06.234423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47f20b-0f5f-4042-9e7e-9284c5c89d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:06.235796 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47f20b-0f5f-4042-9e7e-9284c5c89d17 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:06.236100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47f20b-0f5f-4042-9e7e-9284c5c89d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:06.236390 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47f20b-0f5f-4042-9e7e-9284c5c89d17 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:06.237051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47f20b-0f5f-4042-9e7e-9284c5c89d17 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:06.238602 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47f20b-0f5f-4042-9e7e-9284c5c89d17 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:06.240413 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c041fa6-a3fb-4982-8252-a1df46d6ba8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:06.241523 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c041fa6-a3fb-4982-8252-a1df46d6ba8c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:06.241740 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c041fa6-a3fb-4982-8252-a1df46d6ba8c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:06.242023 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c041fa6-a3fb-4982-8252-a1df46d6ba8c None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:06.243044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c041fa6-a3fb-4982-8252-a1df46d6ba8c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:06.243720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c041fa6-a3fb-4982-8252-a1df46d6ba8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:06.245215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c041fa6-a3fb-4982-8252-a1df46d6ba8c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:06.252615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-dc47f20b-0f5f-4042-9e7e-9284c5c89d17 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:30:06.252615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:06.252615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:30:06.252615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:30:06.252615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:30:06.252615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:30:06.252615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:30:06.252615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:06.252615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:30:06.252615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:06.252615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:06.252615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:06.252615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:06.252615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:06.252615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:06.252615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:06.253687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:06.253687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:06.253687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:06.253687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:06.253687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:06.253687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:06.253687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:06.253687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:30:06.253687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:30:06.253687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:30:06.253687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:30:06.253687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:06.253687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:06.253687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:06.253687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:06.253687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:06.254531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:06.254531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:06.254531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:06.254531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:06.254531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:06.254531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:06.254531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:06.254531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:06.254531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:06.254531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:06.254531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:06.254531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:30:06.254531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:06.254531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:30:06.254531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:06.254531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 438/851] 10.222.0.48 () {56 vars in 1132 bytes} [Thu May 26 16:30:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:06.255384 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47f20b-0f5f-4042-9e7e-9284c5c89d17 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:06.265683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 414/852] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 16:30:06 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:06.273437 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c041fa6-a3fb-4982-8252-a1df46d6ba8c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:06.374609 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47f20b-0f5f-4042-9e7e-9284c5c89d17 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:06.401614 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c041fa6-a3fb-4982-8252-a1df46d6ba8c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:06.408511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:06.415273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238d4de-e521-4eac-bdbe-34a87428e532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:06.416058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238d4de-e521-4eac-bdbe-34a87428e532 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:06.416346 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238d4de-e521-4eac-bdbe-34a87428e532 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:06.416624 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238d4de-e521-4eac-bdbe-34a87428e532 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:06.417537 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238d4de-e521-4eac-bdbe-34a87428e532 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:06.417850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238d4de-e521-4eac-bdbe-34a87428e532 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:06.419417 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238d4de-e521-4eac-bdbe-34a87428e532 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:06.437317 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 439/853] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:30:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:06.439917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238d4de-e521-4eac-bdbe-34a87428e532 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:06.455300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72716d28-9485-4919-baea-d6b54a660315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:06.455300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72716d28-9485-4919-baea-d6b54a660315 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:06.455678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72716d28-9485-4919-baea-d6b54a660315 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:06.456010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72716d28-9485-4919-baea-d6b54a660315 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:06.456829 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72716d28-9485-4919-baea-d6b54a660315 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:06.457142 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72716d28-9485-4919-baea-d6b54a660315 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:06.459377 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72716d28-9485-4919-baea-d6b54a660315 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:06.467707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 415/854] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 26 16:30:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:06.474987 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72716d28-9485-4919-baea-d6b54a660315 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:06.483088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:06.651112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72716d28-9485-4919-baea-d6b54a660315 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:06.652184 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238d4de-e521-4eac-bdbe-34a87428e532 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:06.709870 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d522106-e790-482d-9f27-1fcf330dae8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:06.712087 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d522106-e790-482d-9f27-1fcf330dae8e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:06.712632 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d522106-e790-482d-9f27-1fcf330dae8e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:06.713107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d522106-e790-482d-9f27-1fcf330dae8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:06.715126 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d522106-e790-482d-9f27-1fcf330dae8e None admin] RBAC: Adding query filter params (role.id=796e313fa8794ac885ccf6300d09332a, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=07cc455638fb4db4939af3657ab4203e) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:06.717209 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d522106-e790-482d-9f27-1fcf330dae8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:06.721870 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d522106-e790-482d-9f27-1fcf330dae8e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:06.736366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 440/855] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:30:06 2022] GET /identity/v3/role_assignments?user.id=07cc455638fb4db4939af3657ab4203e&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=796e313fa8794ac885ccf6300d09332a => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:06.742059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b5074-6ed8-460b-b322-920ae5785f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:06.743212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b5074-6ed8-460b-b322-920ae5785f1c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:06.744011 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b5074-6ed8-460b-b322-920ae5785f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:06.744509 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b5074-6ed8-460b-b322-920ae5785f1c None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:06.745488 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b5074-6ed8-460b-b322-920ae5785f1c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:06.746244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b5074-6ed8-460b-b322-920ae5785f1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:06.747927 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b5074-6ed8-460b-b322-920ae5785f1c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:06.754496 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 416/856] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 26 16:30:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:07.507607 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111cf7d-c71f-45eb-bcd4-87f078f9b2df None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:07.507607 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111cf7d-c71f-45eb-bcd4-87f078f9b2df None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:07.507607 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111cf7d-c71f-45eb-bcd4-87f078f9b2df None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:07.508416 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 441/857] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:07.514557 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5baf3-dbb4-4cb8-9e32-306ddceeb515 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:07.515464 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5baf3-dbb4-4cb8-9e32-306ddceeb515 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:07.516469 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5baf3-dbb4-4cb8-9e32-306ddceeb515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:07.535526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c5c5baf3-dbb4-4cb8-9e32-306ddceeb515 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:07.537144 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c5c5baf3-dbb4-4cb8-9e32-306ddceeb515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:07.620600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:07.630199 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 417/858] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:30:07.673570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111cf7d-c71f-45eb-bcd4-87f078f9b2df None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:07.751811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:07.801620 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111cf7d-c71f-45eb-bcd4-87f078f9b2df None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:07.839207 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb914b-5ba1-4fb3-b97b-b514c46fd8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:07.840394 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb914b-5ba1-4fb3-b97b-b514c46fd8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:07.840744 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb914b-5ba1-4fb3-b97b-b514c46fd8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:07.841024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb914b-5ba1-4fb3-b97b-b514c46fd8d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:07.857525 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb914b-5ba1-4fb3-b97b-b514c46fd8d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:07.866552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-36cb914b-5ba1-4fb3-b97b-b514c46fd8d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:30:07.866552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:07.866552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:07.866552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:07.866552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:07.866552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:07.866552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:07.866552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:07.866552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:07.866552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:07.866552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:07.866552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:07.866552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:07.866552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:07.866552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:07.866552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:07.867527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:07.867527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:07.867527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:07.867527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:07.867527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:07.867527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:07.867527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:07.867527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:07.867527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:07.867527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:07.867527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:07.867527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:07.867527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:07.867527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:07.867527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:07.867527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:07.868366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:07.868366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:07.868366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:07.868366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:07.868366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:07.868366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:07.868366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:07.868366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:07.868366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:07.868366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:07.868366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:30:07.868366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:07.868366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 442/859] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:30:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:07.874118 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5baf3-dbb4-4cb8-9e32-306ddceeb515 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:07.987446 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5baf3-dbb4-4cb8-9e32-306ddceeb515 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:08.025706 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac535e-af3b-48d8-8592-3cef4a06a659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:08.026754 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac535e-af3b-48d8-8592-3cef4a06a659 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:08.027288 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac535e-af3b-48d8-8592-3cef4a06a659 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:08.027760 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac535e-af3b-48d8-8592-3cef4a06a659 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:08.028729 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac535e-af3b-48d8-8592-3cef4a06a659 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:08.029232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac535e-af3b-48d8-8592-3cef4a06a659 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:08.030820 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac535e-af3b-48d8-8592-3cef4a06a659 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:08.040322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 418/860] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 16:30:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:08.045875 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb914b-5ba1-4fb3-b97b-b514c46fd8d8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:08.188388 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb914b-5ba1-4fb3-b97b-b514c46fd8d8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:08.225905 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768518e8-3b76-49ea-8f0a-6d610c2ffac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:08.226731 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768518e8-3b76-49ea-8f0a-6d610c2ffac1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:08.227055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768518e8-3b76-49ea-8f0a-6d610c2ffac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:08.227548 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768518e8-3b76-49ea-8f0a-6d610c2ffac1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:08.241882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:08.244886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768518e8-3b76-49ea-8f0a-6d610c2ffac1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:08.246656 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768518e8-3b76-49ea-8f0a-6d610c2ffac1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:08.265336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-768518e8-3b76-49ea-8f0a-6d610c2ffac1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:08.265336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:08.265336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:08.265336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:08.265336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:08.265336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:08.265336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:08.265336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:08.265336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:08.265336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:08.265336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:08.265336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:08.265336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:08.265336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:08.265336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:08.266909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:08.266909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:08.266909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:08.266909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:08.266909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:08.266909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:08.266909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:08.266909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:08.266909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:08.266909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:08.266909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:08.266909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:08.266909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:08.266909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:08.266909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:08.266909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:08.266909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:08.267801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:08.267801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:08.267801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:08.267801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:08.270239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 443/861] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:08.275758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac535e-af3b-48d8-8592-3cef4a06a659 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:08.361735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:08.393549 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac535e-af3b-48d8-8592-3cef4a06a659 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:08.432093 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef51008-91cc-420e-a3ef-5483fefa75b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:08.433103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef51008-91cc-420e-a3ef-5483fefa75b9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:08.433586 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef51008-91cc-420e-a3ef-5483fefa75b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:08.434065 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef51008-91cc-420e-a3ef-5483fefa75b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:08.435076 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef51008-91cc-420e-a3ef-5483fefa75b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:08.435596 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef51008-91cc-420e-a3ef-5483fefa75b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:08.437198 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef51008-91cc-420e-a3ef-5483fefa75b9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:08.451189 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 419/862] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:08.458325 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768518e8-3b76-49ea-8f0a-6d610c2ffac1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:08.568801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768518e8-3b76-49ea-8f0a-6d610c2ffac1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:08.604883 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c445e-1762-4ef2-a06a-663a3cb416e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:08.605749 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c445e-1762-4ef2-a06a-663a3cb416e4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:08.606032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c445e-1762-4ef2-a06a-663a3cb416e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:08.606306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c445e-1762-4ef2-a06a-663a3cb416e4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:08.614741 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c445e-1762-4ef2-a06a-663a3cb416e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:08.616196 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c445e-1762-4ef2-a06a-663a3cb416e4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:08.637291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-886c445e-1762-4ef2-a06a-663a3cb416e4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:30:08.637291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:08.637291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:08.637291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:08.637291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:08.637291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:08.637291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:08.637291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:08.637291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:08.637291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:08.637291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:08.637291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:08.637291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:30:08.637291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:30:08.637291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:30:08.637291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:30:08.638329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:08.638329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:08.638329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:30:08.638329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:08.638329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:30:08.638329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:08.638329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:08.638329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:08.638329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:08.638329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:08.638329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:08.638329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:08.638329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:08.638329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:08.638329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:08.638329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:08.638329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:08.638329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:08.639294 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:08.639294 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:08.639294 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:30:08.639294 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:30:08.639294 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:30:08.639294 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:30:08.639294 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:30:08.639294 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:30:08.639294 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:30:08.639294 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:08.640348 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 444/863] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 26 16:30:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:08.646648 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef51008-91cc-420e-a3ef-5483fefa75b9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:08.764764 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef51008-91cc-420e-a3ef-5483fefa75b9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:08.803628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:08.807845 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70639fac-ae0d-4550-90d8-bf936ae84020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:08.808832 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70639fac-ae0d-4550-90d8-bf936ae84020 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:08.809360 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70639fac-ae0d-4550-90d8-bf936ae84020 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:08.816969 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70639fac-ae0d-4550-90d8-bf936ae84020 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:08.816969 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70639fac-ae0d-4550-90d8-bf936ae84020 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:08.816969 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70639fac-ae0d-4550-90d8-bf936ae84020 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:08.816969 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70639fac-ae0d-4550-90d8-bf936ae84020 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:08.832873 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 420/864] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 26 16:30:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:08.839106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c445e-1762-4ef2-a06a-663a3cb416e4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:08.877835 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a718e4-f3ea-4cc0-aff8-0bfad07f008c None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:08.878558 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a718e4-f3ea-4cc0-aff8-0bfad07f008c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:08.879036 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a718e4-f3ea-4cc0-aff8-0bfad07f008c None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:08.880861 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 421/865] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:30:08.883530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:08.886566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3d6d0-206b-42b9-8d97-d487ae983abe None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:08.886878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3d6d0-206b-42b9-8d97-d487ae983abe None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:08.887125 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3d6d0-206b-42b9-8d97-d487ae983abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:08.906734 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-87a3d6d0-206b-42b9-8d97-d487ae983abe None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:08.908034 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-87a3d6d0-206b-42b9-8d97-d487ae983abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:08.980759 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c445e-1762-4ef2-a06a-663a3cb416e4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:08.995723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 422/866] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:09.014471 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3d6d0-206b-42b9-8d97-d487ae983abe None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:09.021522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52470f-1322-4a9d-80ad-67eaf21cc582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:09.022847 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52470f-1322-4a9d-80ad-67eaf21cc582 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:09.023334 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52470f-1322-4a9d-80ad-67eaf21cc582 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:09.023988 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52470f-1322-4a9d-80ad-67eaf21cc582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:09.120949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52470f-1322-4a9d-80ad-67eaf21cc582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:09.123117 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52470f-1322-4a9d-80ad-67eaf21cc582 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:09.124347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3d6d0-206b-42b9-8d97-d487ae983abe None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:09.133960 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:09.158586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:09.167515 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef13ff4-9f6d-49c8-918a-dd36513948ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:09.168909 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef13ff4-9f6d-49c8-918a-dd36513948ae None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:09.168909 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef13ff4-9f6d-49c8-918a-dd36513948ae None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:09.168909 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef13ff4-9f6d-49c8-918a-dd36513948ae None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:09.169519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef13ff4-9f6d-49c8-918a-dd36513948ae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:09.170926 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef13ff4-9f6d-49c8-918a-dd36513948ae None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:09.249034 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 445/867] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:30:08 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:09.254730 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52470f-1322-4a9d-80ad-67eaf21cc582 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:09.347037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 423/868] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 16:30:09 2022] POST /identity/v3/services => generated 251 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:30:09.349442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc48d7b-b017-4af7-9e2e-bbb5626c7c9e None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:09.349827 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc48d7b-b017-4af7-9e2e-bbb5626c7c9e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:09.350186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc48d7b-b017-4af7-9e2e-bbb5626c7c9e None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:09.352523 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 424/869] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:09.361420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191ffd5-6a35-4d0d-869b-3273214ca3eb None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:09.361769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191ffd5-6a35-4d0d-869b-3273214ca3eb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:09.362051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191ffd5-6a35-4d0d-869b-3273214ca3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:09.380742 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52470f-1322-4a9d-80ad-67eaf21cc582 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:09.386994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c191ffd5-6a35-4d0d-869b-3273214ca3eb None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:09.388140 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c191ffd5-6a35-4d0d-869b-3273214ca3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:09.416970 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:09.434975 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c74d4-0824-4bd3-b4a4-d6a78d824599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:09.435836 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c74d4-0824-4bd3-b4a4-d6a78d824599 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:09.436163 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c74d4-0824-4bd3-b4a4-d6a78d824599 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:09.436413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c74d4-0824-4bd3-b4a4-d6a78d824599 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:09.451442 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c74d4-0824-4bd3-b4a4-d6a78d824599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:09.453105 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c74d4-0824-4bd3-b4a4-d6a78d824599 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:09.481012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-4f4c74d4-0824-4bd3-b4a4-d6a78d824599 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:09.481012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:09.481012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:09.481012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:09.481012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:09.481012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:09.481012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:09.481012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:09.481012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:09.481012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:09.481012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:09.481012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:09.481012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:09.481012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:09.481012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:09.482522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:09.482522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:09.482522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:09.482522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:09.482522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:09.482522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:09.482522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:09.482522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:09.482522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:09.482522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:09.482522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:09.482522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:09.482522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:09.482522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:09.482522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:09.482522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:09.482522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:09.483701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:09.483701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:09.483701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:09.483701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:09.484053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 425/870] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:09 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:09.486870 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e2b8d-8670-4262-835b-f19acafcd563 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:09.487750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 446/871] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:09.488148 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e2b8d-8670-4262-835b-f19acafcd563 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:09.488615 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e2b8d-8670-4262-835b-f19acafcd563 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:09.488893 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c74d4-0824-4bd3-b4a4-d6a78d824599 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:09.490793 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 426/872] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:09.498403 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a9210-2169-49d3-97e5-ef9e2adc85ae None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:09.498679 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a9210-2169-49d3-97e5-ef9e2adc85ae None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:09.498959 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a9210-2169-49d3-97e5-ef9e2adc85ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:09.518756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ea2a9210-2169-49d3-97e5-ef9e2adc85ae None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:09.521936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ea2a9210-2169-49d3-97e5-ef9e2adc85ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:09.610980 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 427/873] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:09 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:09.611939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a9210-2169-49d3-97e5-ef9e2adc85ae None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:09.621114 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c74d4-0824-4bd3-b4a4-d6a78d824599 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:09.655065 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:09.671847 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b9b3a-30f6-4d54-9549-12ec497f52c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:09.672722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b9b3a-30f6-4d54-9549-12ec497f52c4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:09.673122 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b9b3a-30f6-4d54-9549-12ec497f52c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:09.673439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b9b3a-30f6-4d54-9549-12ec497f52c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:09.674246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b9b3a-30f6-4d54-9549-12ec497f52c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:09.674552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b9b3a-30f6-4d54-9549-12ec497f52c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:09.675960 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b9b3a-30f6-4d54-9549-12ec497f52c4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:09.689383 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 447/874] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:09.690304 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b9b3a-30f6-4d54-9549-12ec497f52c4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:09.730882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:09.749935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a9210-2169-49d3-97e5-ef9e2adc85ae None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:09.792329 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9a859-4c7c-4efc-af6d-42a102a9150c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:09.793390 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9a859-4c7c-4efc-af6d-42a102a9150c None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:09.793892 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9a859-4c7c-4efc-af6d-42a102a9150c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:09.794351 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9a859-4c7c-4efc-af6d-42a102a9150c None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:09.795253 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9a859-4c7c-4efc-af6d-42a102a9150c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:09.796932 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9a859-4c7c-4efc-af6d-42a102a9150c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:09.815048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b9b3a-30f6-4d54-9549-12ec497f52c4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:09.853794 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5e6d1-afb8-4347-a1f3-d731fa149008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:09.854616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5e6d1-afb8-4347-a1f3-d731fa149008 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:09.854908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5e6d1-afb8-4347-a1f3-d731fa149008 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:09.855214 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5e6d1-afb8-4347-a1f3-d731fa149008 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:09.855869 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5e6d1-afb8-4347-a1f3-d731fa149008 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:09.857244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5e6d1-afb8-4347-a1f3-d731fa149008 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:09.870660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6ea5e6d1-afb8-4347-a1f3-d731fa149008 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:30:09.870660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:09.870660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:30:09.870660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:30:09.870660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:30:09.870660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:30:09.870660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:30:09.870660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:09.870660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:30:09.870660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:09.870660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:09.870660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:09.870660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:09.870660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:09.870660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:09.870660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:09.870660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:09.871764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:09.871764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:09.871764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:09.871764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:09.871764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:09.871764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:09.871764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:30:09.871764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:30:09.871764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:30:09.871764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:30:09.871764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:09.871764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:09.871764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:09.871764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:09.871764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:09.871764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:09.872677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:09.872677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:09.872677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:09.872677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:09.872677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:09.872677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:09.872677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:09.872677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:09.872677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:09.872677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:09.872677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:30:09.872677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:09.872677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:30:09.872677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:09.872677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 448/875] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 26 16:30:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:09.873527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5e6d1-afb8-4347-a1f3-d731fa149008 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:09.946290 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 428/876] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 16:30:09 2022] POST /identity/v3/services => generated 269 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:30:09.947063 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9a859-4c7c-4efc-af6d-42a102a9150c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:10.011276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:10.017555 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5e6d1-afb8-4347-a1f3-d731fa149008 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:10.080181 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:10.100452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a7e7a-056e-4f5a-b5d6-dad6cfed9844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:10.102001 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a7e7a-056e-4f5a-b5d6-dad6cfed9844 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:10.102516 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a7e7a-056e-4f5a-b5d6-dad6cfed9844 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:10.102797 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9a859-4c7c-4efc-af6d-42a102a9150c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:10.103196 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a7e7a-056e-4f5a-b5d6-dad6cfed9844 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:10.113689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a7e7a-056e-4f5a-b5d6-dad6cfed9844 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:10.115759 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a7e7a-056e-4f5a-b5d6-dad6cfed9844 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:10.142253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-cb1a7e7a-056e-4f5a-b5d6-dad6cfed9844 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:10.142253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:10.142253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:10.142253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:10.142253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:10.142253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:10.142253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:10.142253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:10.142253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:10.142253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:10.142253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:10.142253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:10.142253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:30:10.142253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:30:10.142253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:30:10.159753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:30:10.159753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:10.159753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:10.159753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:10.159753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:10.159753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:10.159753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:10.159753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:10.159753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:10.159753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:10.159753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:10.159753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:10.159753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:10.159753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:10.159753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:10.159753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:10.159753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:10.160734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:30:10.160734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:30:10.160734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:30:10.160734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:30:10.160734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:30:10.160734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:30:10.160734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:10.160734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:10.160734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 449/877] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:30:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:10.161240 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1261ca-5c96-4f2a-96bd-45ba8d1549e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:10.161240 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1261ca-5c96-4f2a-96bd-45ba8d1549e5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:10.161240 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1261ca-5c96-4f2a-96bd-45ba8d1549e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:10.161496 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a7e7a-056e-4f5a-b5d6-dad6cfed9844 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:10.161566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1261ca-5c96-4f2a-96bd-45ba8d1549e5 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:10.161566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1261ca-5c96-4f2a-96bd-45ba8d1549e5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:10.161566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1261ca-5c96-4f2a-96bd-45ba8d1549e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:10.161566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1261ca-5c96-4f2a-96bd-45ba8d1549e5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:10.161566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 429/878] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 26 16:30:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:10.168304 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1261ca-5c96-4f2a-96bd-45ba8d1549e5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:10.307112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a7e7a-056e-4f5a-b5d6-dad6cfed9844 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:10.345157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8a5f2-ac54-4f9b-968d-1bed0176851e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:10.346479 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1261ca-5c96-4f2a-96bd-45ba8d1549e5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:10.346714 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8a5f2-ac54-4f9b-968d-1bed0176851e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:10.347189 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8a5f2-ac54-4f9b-968d-1bed0176851e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:10.347683 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8a5f2-ac54-4f9b-968d-1bed0176851e None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:10.348680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8a5f2-ac54-4f9b-968d-1bed0176851e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:10.349189 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8a5f2-ac54-4f9b-968d-1bed0176851e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:10.350859 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8a5f2-ac54-4f9b-968d-1bed0176851e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:10.369246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 450/879] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:30:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:10.370589 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8a5f2-ac54-4f9b-968d-1bed0176851e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:10.393247 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d102a-c174-4acc-9e15-7d1bf5d8d06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:10.393953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d102a-c174-4acc-9e15-7d1bf5d8d06b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:10.394239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d102a-c174-4acc-9e15-7d1bf5d8d06b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:10.394516 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d102a-c174-4acc-9e15-7d1bf5d8d06b None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:10.395234 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d102a-c174-4acc-9e15-7d1bf5d8d06b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:10.395541 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d102a-c174-4acc-9e15-7d1bf5d8d06b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:10.397333 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d102a-c174-4acc-9e15-7d1bf5d8d06b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:10.399145 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:10.405612 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 430/880] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 26 16:30:10 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:10.511914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8a5f2-ac54-4f9b-968d-1bed0176851e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:10.557371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d7030-21bb-4072-9be4-f29c774ebd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:10.557371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d7030-21bb-4072-9be4-f29c774ebd20 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:10.557371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d7030-21bb-4072-9be4-f29c774ebd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:10.557371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d7030-21bb-4072-9be4-f29c774ebd20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:10.557744 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d7030-21bb-4072-9be4-f29c774ebd20 None admin] RBAC: Adding query filter params (role.id=d39d16b5286d4e1db63841f4917e08f2, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=4d2ab3eeb5b44979956dd223ac6b7c39) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:10.557744 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d7030-21bb-4072-9be4-f29c774ebd20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:10.558738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d7030-21bb-4072-9be4-f29c774ebd20 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:10.567672 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 451/881] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:30:10 2022] GET /identity/v3/role_assignments?user.id=4d2ab3eeb5b44979956dd223ac6b7c39&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=d39d16b5286d4e1db63841f4917e08f2 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:11.849993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd4d93-1393-4829-98ef-c8af1b2ff477 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:11.850548 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd4d93-1393-4829-98ef-c8af1b2ff477 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:11.850548 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd4d93-1393-4829-98ef-c8af1b2ff477 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:11.852381 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 431/882] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:11.859176 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446011d6-e928-4220-b8f0-506ae573ff05 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:11.860293 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446011d6-e928-4220-b8f0-506ae573ff05 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:11.860293 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446011d6-e928-4220-b8f0-506ae573ff05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:11.893295 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-446011d6-e928-4220-b8f0-506ae573ff05 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:11.893295 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-446011d6-e928-4220-b8f0-506ae573ff05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:12.075220 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 452/883] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:12.099927 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd4d93-1393-4829-98ef-c8af1b2ff477 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:12.149362 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:12.401372 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd4d93-1393-4829-98ef-c8af1b2ff477 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:12.455913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297cc20-8324-4b41-bcd1-15c09914b3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:12.456755 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297cc20-8324-4b41-bcd1-15c09914b3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:12.457068 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297cc20-8324-4b41-bcd1-15c09914b3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:12.461309 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297cc20-8324-4b41-bcd1-15c09914b3b9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:12.461309 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297cc20-8324-4b41-bcd1-15c09914b3b9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:12.461309 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297cc20-8324-4b41-bcd1-15c09914b3b9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:12.493397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-5297cc20-8324-4b41-bcd1-15c09914b3b9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:30:12.493397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:12.493397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:30:12.493397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:30:12.493397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:30:12.493397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:30:12.493397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:30:12.493397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:12.493397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:30:12.493397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:12.493397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:12.493397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:12.493397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:12.493397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:12.493397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:12.493397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:12.493397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:12.494519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:12.494519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:12.494519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:12.494519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:12.494519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:12.494519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:12.494519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:30:12.494519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:30:12.494519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:30:12.494519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:30:12.494519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:12.494519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:12.494519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:12.494519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:12.494519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:12.494519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:12.495415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:12.495415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:12.495415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:12.495415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:12.495415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:12.495415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:12.495415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:12.495415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:12.495415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:12.495415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:12.495415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:30:12.495415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:12.495415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:30:12.495415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:12.498708 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 432/884] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 16:30:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:12.506649 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446011d6-e928-4220-b8f0-506ae573ff05 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:12.530893 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa6c2f-0cb3-4fd2-bf62-b06ac06a2463 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:12.531642 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa6c2f-0cb3-4fd2-bf62-b06ac06a2463 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:12.532142 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa6c2f-0cb3-4fd2-bf62-b06ac06a2463 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:12.533747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 433/885] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:12.537282 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:12.541283 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d529005-4cc6-4b7d-a985-83857079329e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:12.541283 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d529005-4cc6-4b7d-a985-83857079329e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:12.541283 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d529005-4cc6-4b7d-a985-83857079329e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:12.580954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6d529005-4cc6-4b7d-a985-83857079329e None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:12.580954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6d529005-4cc6-4b7d-a985-83857079329e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:12.742418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446011d6-e928-4220-b8f0-506ae573ff05 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:12.759637 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 434/886] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:12.792322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d529005-4cc6-4b7d-a985-83857079329e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:12.804550 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:12.810600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958336eb-985b-48ab-a3ef-cdb861260265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:12.822841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958336eb-985b-48ab-a3ef-cdb861260265 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:12.822841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958336eb-985b-48ab-a3ef-cdb861260265 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:12.822841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958336eb-985b-48ab-a3ef-cdb861260265 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:12.822841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958336eb-985b-48ab-a3ef-cdb861260265 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:12.822841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958336eb-985b-48ab-a3ef-cdb861260265 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:12.822841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958336eb-985b-48ab-a3ef-cdb861260265 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:12.835788 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 453/887] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 16:30:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:12.845771 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958336eb-985b-48ab-a3ef-cdb861260265 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:12.978705 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:12.987143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d529005-4cc6-4b7d-a985-83857079329e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:13.010092 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958336eb-985b-48ab-a3ef-cdb861260265 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:13.026251 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f0a6f-d3bd-438b-9154-f209284670bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:13.027415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f0a6f-d3bd-438b-9154-f209284670bd None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:13.028071 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f0a6f-d3bd-438b-9154-f209284670bd None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:13.028542 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f0a6f-d3bd-438b-9154-f209284670bd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:13.029560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f0a6f-d3bd-438b-9154-f209284670bd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:13.031780 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f0a6f-d3bd-438b-9154-f209284670bd None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:13.044879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-171f0a6f-d3bd-438b-9154-f209284670bd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:30:13.044879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:13.044879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:30:13.044879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:30:13.044879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:30:13.044879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:30:13.044879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:30:13.044879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:13.044879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:30:13.044879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:13.044879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:13.044879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:13.044879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:13.044879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:13.044879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:13.044879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:13.046059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:13.046059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:13.046059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:13.046059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:13.046059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:13.046059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:13.046059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:13.046059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:30:13.046059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:30:13.046059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:30:13.046059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:30:13.046059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:13.046059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:13.046059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:13.046059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:13.046059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:13.047660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:13.047660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:13.047660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:13.047660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:13.047660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:13.047660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:13.047660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:13.047660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:13.047660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:13.047660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:13.047660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:13.047660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:30:13.047660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:13.047660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:30:13.047660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:13.055312 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 435/888] 10.222.0.48 () {56 vars in 1132 bytes} [Thu May 26 16:30:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:13.056982 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa756b4e-3005-407c-b363-d253805bb8a7 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:13.058196 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa756b4e-3005-407c-b363-d253805bb8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:13.058570 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa756b4e-3005-407c-b363-d253805bb8a7 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:13.062692 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 436/889] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:13.062692 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa756b4e-3005-407c-b363-d253805bb8a7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:13.071616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48024e52-d5a5-4b57-b254-5678d8eee5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:13.072300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48024e52-d5a5-4b57-b254-5678d8eee5bc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:13.072579 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48024e52-d5a5-4b57-b254-5678d8eee5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:13.073353 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48024e52-d5a5-4b57-b254-5678d8eee5bc None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:13.073869 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48024e52-d5a5-4b57-b254-5678d8eee5bc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:13.074178 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48024e52-d5a5-4b57-b254-5678d8eee5bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:13.075573 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48024e52-d5a5-4b57-b254-5678d8eee5bc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:13.082411 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 454/890] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 16:30:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:13.084274 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552a024-40ca-4472-9cd4-7be4d0e44fa2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:13.084675 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552a024-40ca-4472-9cd4-7be4d0e44fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:13.084983 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552a024-40ca-4472-9cd4-7be4d0e44fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:13.103055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1552a024-40ca-4472-9cd4-7be4d0e44fa2 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:13.104252 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1552a024-40ca-4472-9cd4-7be4d0e44fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:13.152236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:13.178863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 455/891] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:13.180491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf5288-bf10-4077-ab46-fd2272528781 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:13.180888 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf5288-bf10-4077-ab46-fd2272528781 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:13.181313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf5288-bf10-4077-ab46-fd2272528781 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:13.185446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 456/892] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:13.185446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf5288-bf10-4077-ab46-fd2272528781 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:13.202074 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa756b4e-3005-407c-b363-d253805bb8a7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:13.255279 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079401d5-2fd2-4963-ae87-247258c14cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:13.255945 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079401d5-2fd2-4963-ae87-247258c14cec None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:13.256234 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079401d5-2fd2-4963-ae87-247258c14cec None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:13.256513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079401d5-2fd2-4963-ae87-247258c14cec None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:13.257211 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079401d5-2fd2-4963-ae87-247258c14cec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:13.257553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079401d5-2fd2-4963-ae87-247258c14cec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:13.259014 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079401d5-2fd2-4963-ae87-247258c14cec None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:13.264113 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 437/893] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 26 16:30:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:13.265470 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bd0ed-74d5-4748-a3c5-0c2509dadb0d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:13.266195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bd0ed-74d5-4748-a3c5-0c2509dadb0d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:13.266464 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bd0ed-74d5-4748-a3c5-0c2509dadb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:13.283283 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:13.285999 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4f4bd0ed-74d5-4748-a3c5-0c2509dadb0d None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:13.287257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4f4bd0ed-74d5-4748-a3c5-0c2509dadb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:13.343774 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf5288-bf10-4077-ab46-fd2272528781 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:13.362895 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 438/894] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:13.363727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bd0ed-74d5-4748-a3c5-0c2509dadb0d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:13.391664 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c080e4-a571-4d4c-a106-06858ea45bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:13.392415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c080e4-a571-4d4c-a106-06858ea45bbe None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:13.392782 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c080e4-a571-4d4c-a106-06858ea45bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:13.393121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c080e4-a571-4d4c-a106-06858ea45bbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:13.393949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c080e4-a571-4d4c-a106-06858ea45bbe None admin] RBAC: Adding query filter params (interface=public, service_id=4aab8e3753744eb4b9f3bab917c12bbd, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:13.394308 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c080e4-a571-4d4c-a106-06858ea45bbe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:13.395605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c080e4-a571-4d4c-a106-06858ea45bbe None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:13.402829 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 457/895] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 26 16:30:13 2022] GET /identity/v3/endpoints?service_id=4aab8e3753744eb4b9f3bab917c12bbd&interface=public®ion_id=RegionOne => generated 194 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:13.404166 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c080e4-a571-4d4c-a106-06858ea45bbe None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:13.444217 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:13.484537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bd0ed-74d5-4748-a3c5-0c2509dadb0d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:13.518917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c080e4-a571-4d4c-a106-06858ea45bbe None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:13.525126 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09df858-1cbf-4612-9ae2-2d79c987828a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:13.525898 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09df858-1cbf-4612-9ae2-2d79c987828a None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:13.526186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09df858-1cbf-4612-9ae2-2d79c987828a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:13.526461 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09df858-1cbf-4612-9ae2-2d79c987828a None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:13.527183 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09df858-1cbf-4612-9ae2-2d79c987828a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:13.528558 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09df858-1cbf-4612-9ae2-2d79c987828a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:13.550466 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:13.555949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4427c4-5ed1-457e-8c90-2d279dabb749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:13.556617 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4427c4-5ed1-457e-8c90-2d279dabb749 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:13.556934 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4427c4-5ed1-457e-8c90-2d279dabb749 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:13.557216 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4427c4-5ed1-457e-8c90-2d279dabb749 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:13.557965 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4427c4-5ed1-457e-8c90-2d279dabb749 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:13.558270 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4427c4-5ed1-457e-8c90-2d279dabb749 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:13.559624 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4427c4-5ed1-457e-8c90-2d279dabb749 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:13.564370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 458/896] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 26 16:30:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:13.565140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4427c4-5ed1-457e-8c90-2d279dabb749 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:13.626343 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 439/897] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 16:30:13 2022] POST /identity/v3/services => generated 241 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:30:13.629626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09df858-1cbf-4612-9ae2-2d79c987828a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:13.696760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4427c4-5ed1-457e-8c90-2d279dabb749 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:13.770820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bf87c-d7ad-4db8-b66c-ec2e65c05e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:13.771771 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bf87c-d7ad-4db8-b66c-ec2e65c05e58 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:13.772165 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bf87c-d7ad-4db8-b66c-ec2e65c05e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:13.772453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bf87c-d7ad-4db8-b66c-ec2e65c05e58 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:13.775795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09df858-1cbf-4612-9ae2-2d79c987828a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:13.796198 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7bf87c-d7ad-4db8-b66c-ec2e65c05e58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:13.805112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-cd7bf87c-d7ad-4db8-b66c-ec2e65c05e58 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:30:13.805112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:13.805112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:13.805112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:13.805112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:13.805112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:13.805112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:13.805112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:13.805112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:13.805112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:13.805112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:13.805112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:13.805112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:13.805112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:13.805112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:13.805112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:13.806385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:13.806385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:13.806385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:13.806385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:13.806385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:13.806385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:13.806385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:13.806385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:13.806385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:13.806385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:13.806385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:13.806385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:13.806385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:13.806385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:13.806385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:13.806385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:13.807469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:13.807469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:13.807469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:13.807469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:13.807469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:13.807469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:13.807469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:13.807469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:13.807469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:13.807469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:13.807469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:30:13.807469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:13.808444 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 459/898] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 26 16:30:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:13.815384 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bf87c-d7ad-4db8-b66c-ec2e65c05e58 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:13.832020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:13.842737 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583680c8-8aee-47d5-8621-a5e3456733f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:13.843405 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583680c8-8aee-47d5-8621-a5e3456733f7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:13.848307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583680c8-8aee-47d5-8621-a5e3456733f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:13.848307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583680c8-8aee-47d5-8621-a5e3456733f7 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:13.848307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583680c8-8aee-47d5-8621-a5e3456733f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:13.848307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583680c8-8aee-47d5-8621-a5e3456733f7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:13.854063 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 440/899] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 26 16:30:13 2022] GET /identity/v3/services => generated 1497 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:30:13.854732 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583680c8-8aee-47d5-8621-a5e3456733f7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:13.903869 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:13.979156 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bf87c-d7ad-4db8-b66c-ec2e65c05e58 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:14.023330 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6213e-91e6-41c5-9b3f-26615a287864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:14.025320 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6213e-91e6-41c5-9b3f-26615a287864 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:14.025320 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6213e-91e6-41c5-9b3f-26615a287864 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:14.025320 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6213e-91e6-41c5-9b3f-26615a287864 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:14.026163 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6213e-91e6-41c5-9b3f-26615a287864 None admin] RBAC: Adding query filter params (interface=public, service_id=e74c2f00be4d4260be25bd2115222458, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:14.028179 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6213e-91e6-41c5-9b3f-26615a287864 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:14.029845 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6213e-91e6-41c5-9b3f-26615a287864 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:14.050341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 460/900] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 26 16:30:13 2022] GET /identity/v3/endpoints?service_id=e74c2f00be4d4260be25bd2115222458&interface=public®ion_id=RegionOne => generated 194 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:14.055876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6213e-91e6-41c5-9b3f-26615a287864 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:14.089752 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583680c8-8aee-47d5-8621-a5e3456733f7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:14.137561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66730fc5-0e73-49ed-a0af-8e3f97dff06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:14.138611 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66730fc5-0e73-49ed-a0af-8e3f97dff06c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:14.139124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66730fc5-0e73-49ed-a0af-8e3f97dff06c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:14.139636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66730fc5-0e73-49ed-a0af-8e3f97dff06c None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:14.141248 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66730fc5-0e73-49ed-a0af-8e3f97dff06c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:14.141909 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66730fc5-0e73-49ed-a0af-8e3f97dff06c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:14.143614 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66730fc5-0e73-49ed-a0af-8e3f97dff06c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:14.154440 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 441/901] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 26 16:30:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:14.162474 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66730fc5-0e73-49ed-a0af-8e3f97dff06c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:14.209213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6213e-91e6-41c5-9b3f-26615a287864 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:14.224767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:14.227540 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:14.247242 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15f776-b2ca-426b-b631-5f977d6abb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:14.247934 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15f776-b2ca-426b-b631-5f977d6abb1a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:14.248271 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15f776-b2ca-426b-b631-5f977d6abb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:14.248547 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15f776-b2ca-426b-b631-5f977d6abb1a None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:14.249241 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15f776-b2ca-426b-b631-5f977d6abb1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:14.250683 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15f776-b2ca-426b-b631-5f977d6abb1a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:14.265289 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 461/902] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 26 16:30:14 2022] GET /identity/v3/services => generated 1497 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:30:14.285972 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66730fc5-0e73-49ed-a0af-8e3f97dff06c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:14.331365 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed745e-7ac1-48f2-8f94-0b47154d379e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:14.332292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed745e-7ac1-48f2-8f94-0b47154d379e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:14.332575 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed745e-7ac1-48f2-8f94-0b47154d379e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:14.332847 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed745e-7ac1-48f2-8f94-0b47154d379e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:14.346287 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed745e-7ac1-48f2-8f94-0b47154d379e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:14.347819 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed745e-7ac1-48f2-8f94-0b47154d379e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:14.368968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-a8ed745e-7ac1-48f2-8f94-0b47154d379e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:14.368968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:14.368968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:14.368968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:14.368968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:14.368968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:14.368968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:14.368968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:14.368968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:14.368968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:14.368968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:14.368968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:14.368968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:14.368968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:14.368968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:14.370020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:14.370020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:14.370020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:14.370020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:14.370020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:14.370020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:14.370020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:14.370020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:14.370020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:14.370020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:14.370020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:14.370020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:14.370020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:14.370020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:14.370020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:14.370020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:14.370020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:14.370915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:14.370915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:14.370915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:14.370915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:14.372689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 442/903] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:14.377817 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15f776-b2ca-426b-b631-5f977d6abb1a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:14.522611 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15f776-b2ca-426b-b631-5f977d6abb1a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:14.565888 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1d2b1-ec26-45e5-bcc1-897d7dd35f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:14.566606 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1d2b1-ec26-45e5-bcc1-897d7dd35f40 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:14.566892 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1d2b1-ec26-45e5-bcc1-897d7dd35f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:14.567168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1d2b1-ec26-45e5-bcc1-897d7dd35f40 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:14.568007 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1d2b1-ec26-45e5-bcc1-897d7dd35f40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:14.568314 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1d2b1-ec26-45e5-bcc1-897d7dd35f40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:14.569750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1d2b1-ec26-45e5-bcc1-897d7dd35f40 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:14.583603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 462/904] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:14.588807 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed745e-7ac1-48f2-8f94-0b47154d379e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:14.707679 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed745e-7ac1-48f2-8f94-0b47154d379e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:14.710257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:14.747016 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6c510-021d-4466-8e10-e8e0d2f3e3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:14.747835 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6c510-021d-4466-8e10-e8e0d2f3e3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:14.748115 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6c510-021d-4466-8e10-e8e0d2f3e3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:14.748391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6c510-021d-4466-8e10-e8e0d2f3e3c8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:14.756040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6c510-021d-4466-8e10-e8e0d2f3e3c8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:14.757518 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6c510-021d-4466-8e10-e8e0d2f3e3c8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:14.773915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-6af6c510-021d-4466-8e10-e8e0d2f3e3c8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:30:14.773915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:14.773915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:14.773915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:14.773915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:14.773915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:14.773915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:14.773915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:14.773915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:14.773915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:14.773915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:14.773915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:14.773915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:30:14.773915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:30:14.773915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:30:14.773915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:30:14.776155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:14.776155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:14.776155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:30:14.776155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:14.776155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:30:14.776155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:14.776155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:14.776155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:14.776155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:14.776155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:14.776155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:14.776155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:14.776155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:14.776155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:14.776155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:14.776155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:14.776155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:14.776155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:14.778492 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:14.778492 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:14.778492 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:30:14.778492 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:30:14.778492 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:30:14.778492 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:30:14.778492 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:30:14.778492 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:30:14.778492 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:30:14.778492 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:14.778492 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 443/905] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 26 16:30:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:14.781607 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1d2b1-ec26-45e5-bcc1-897d7dd35f40 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:14.832646 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:14.903242 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1d2b1-ec26-45e5-bcc1-897d7dd35f40 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:14.941253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d46f7-e56e-4146-a0ae-d969b2a7974f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:14.941865 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d46f7-e56e-4146-a0ae-d969b2a7974f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:14.942281 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d46f7-e56e-4146-a0ae-d969b2a7974f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:14.942771 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d46f7-e56e-4146-a0ae-d969b2a7974f None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:14.943734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d46f7-e56e-4146-a0ae-d969b2a7974f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:14.944080 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d46f7-e56e-4146-a0ae-d969b2a7974f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:14.947161 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d46f7-e56e-4146-a0ae-d969b2a7974f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:14.969159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 463/906] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 26 16:30:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:14.974483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6c510-021d-4466-8e10-e8e0d2f3e3c8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:15.084828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6c510-021d-4466-8e10-e8e0d2f3e3c8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:15.121437 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553c8a8-2112-4e0a-b62b-e51aebfba1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:15.123040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553c8a8-2112-4e0a-b62b-e51aebfba1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:15.123552 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553c8a8-2112-4e0a-b62b-e51aebfba1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:15.124062 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553c8a8-2112-4e0a-b62b-e51aebfba1d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:15.197655 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:15.201992 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553c8a8-2112-4e0a-b62b-e51aebfba1d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:15.203506 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553c8a8-2112-4e0a-b62b-e51aebfba1d6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:15.311916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 444/907] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:30:14 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:15.318440 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d46f7-e56e-4146-a0ae-d969b2a7974f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:15.429721 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:15.433979 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d46f7-e56e-4146-a0ae-d969b2a7974f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:15.474559 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841514d-f9f0-44bd-903f-f8724d381643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:15.475568 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841514d-f9f0-44bd-903f-f8724d381643 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:15.475948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841514d-f9f0-44bd-903f-f8724d381643 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:15.476314 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841514d-f9f0-44bd-903f-f8724d381643 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:15.488648 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841514d-f9f0-44bd-903f-f8724d381643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:15.490636 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841514d-f9f0-44bd-903f-f8724d381643 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:15.511405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-9841514d-f9f0-44bd-903f-f8724d381643 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:15.511405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:15.511405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:15.511405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:15.511405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:15.511405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:15.511405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:15.511405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:15.511405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:15.511405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:15.511405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:15.511405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:15.511405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:15.511405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:15.511405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:15.512408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:15.512408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:15.512408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:15.512408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:15.512408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:15.512408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:15.512408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:15.512408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:15.512408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:15.512408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:15.512408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:15.512408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:15.512408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:15.512408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:15.512408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:15.512408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:15.512408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:15.513347 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:15.513347 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:15.513347 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:15.513347 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:15.513347 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 464/908] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:15.518562 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553c8a8-2112-4e0a-b62b-e51aebfba1d6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:15.601743 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:15.659075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553c8a8-2112-4e0a-b62b-e51aebfba1d6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:15.698087 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a89d0-90fb-4f8c-853a-8b9feab03e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:15.698686 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a89d0-90fb-4f8c-853a-8b9feab03e01 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:15.698974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a89d0-90fb-4f8c-853a-8b9feab03e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:15.699256 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a89d0-90fb-4f8c-853a-8b9feab03e01 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:15.699981 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a89d0-90fb-4f8c-853a-8b9feab03e01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:15.700346 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a89d0-90fb-4f8c-853a-8b9feab03e01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:15.701778 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a89d0-90fb-4f8c-853a-8b9feab03e01 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:15.716817 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 445/909] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:15.726348 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841514d-f9f0-44bd-903f-f8724d381643 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:15.876369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841514d-f9f0-44bd-903f-f8724d381643 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:15.917527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656c316-8ce3-4655-8bd1-daf76bc20e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:15.918360 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656c316-8ce3-4655-8bd1-daf76bc20e6e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:15.918640 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656c316-8ce3-4655-8bd1-daf76bc20e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:15.918911 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656c316-8ce3-4655-8bd1-daf76bc20e6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:15.927820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656c316-8ce3-4655-8bd1-daf76bc20e6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:15.929308 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656c316-8ce3-4655-8bd1-daf76bc20e6e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:15.944402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-5656c316-8ce3-4655-8bd1-daf76bc20e6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:15.944402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:15.944402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:15.944402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:15.944402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:15.944402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:15.944402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:15.944402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:15.944402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:15.944402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:15.944402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:15.944402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:15.944402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:30:15.944402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:30:15.944402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:30:15.946021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:30:15.946021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:15.946021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:15.946021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:15.946021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:15.946021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:15.946021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:15.946021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:15.946021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:15.946021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:15.946021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:15.946021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:15.946021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:15.946021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:15.946021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:15.946021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:15.946021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:15.947507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:30:15.947507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:30:15.947507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:30:15.947507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:30:15.947507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:30:15.947507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:30:15.947507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:15.947507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:15.947507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 465/910] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:30:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:15.953794 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a89d0-90fb-4f8c-853a-8b9feab03e01 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:16.118934 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b30cd3-e3e1-459d-85d4-2e81072d8a7a None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:16.119362 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b30cd3-e3e1-459d-85d4-2e81072d8a7a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:16.119780 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b30cd3-e3e1-459d-85d4-2e81072d8a7a None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:16.128512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 466/911] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:16 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:16.130666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59dff7-8da2-48ca-8401-0975daebcd9d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:16.131091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59dff7-8da2-48ca-8401-0975daebcd9d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:16.131505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59dff7-8da2-48ca-8401-0975daebcd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:16.132248 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a89d0-90fb-4f8c-853a-8b9feab03e01 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:16.152895 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ea59dff7-8da2-48ca-8401-0975daebcd9d None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:16.154198 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ea59dff7-8da2-48ca-8401-0975daebcd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:16.157367 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:16.163947 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:16.177738 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051a5ee-c1eb-45ac-8cee-a275a4c9a356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:16.178734 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051a5ee-c1eb-45ac-8cee-a275a4c9a356 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:16.179117 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051a5ee-c1eb-45ac-8cee-a275a4c9a356 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:16.179400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051a5ee-c1eb-45ac-8cee-a275a4c9a356 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:16.180592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051a5ee-c1eb-45ac-8cee-a275a4c9a356 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:16.180906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051a5ee-c1eb-45ac-8cee-a275a4c9a356 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:16.182978 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051a5ee-c1eb-45ac-8cee-a275a4c9a356 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:16.205701 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 446/912] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:30:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:16.207864 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051a5ee-c1eb-45ac-8cee-a275a4c9a356 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:16.268824 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 467/913] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:30:16.295053 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59dff7-8da2-48ca-8401-0975daebcd9d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:16.373311 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051a5ee-c1eb-45ac-8cee-a275a4c9a356 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:16.421550 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9ccb8-0df2-4073-b7c6-e2f1dedab5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:16.422365 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9ccb8-0df2-4073-b7c6-e2f1dedab5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:16.422761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9ccb8-0df2-4073-b7c6-e2f1dedab5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:16.423078 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9ccb8-0df2-4073-b7c6-e2f1dedab5c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:16.423306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59dff7-8da2-48ca-8401-0975daebcd9d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:16.424051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9ccb8-0df2-4073-b7c6-e2f1dedab5c8 None admin] RBAC: Adding query filter params (role.id=6380c038334a4884b6c85da311930a3e, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=4d2ab3eeb5b44979956dd223ac6b7c39) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:16.424442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9ccb8-0df2-4073-b7c6-e2f1dedab5c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:16.426226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9ccb8-0df2-4073-b7c6-e2f1dedab5c8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:16.445676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 447/914] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:30:16 2022] GET /identity/v3/role_assignments?user.id=4d2ab3eeb5b44979956dd223ac6b7c39&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=6380c038334a4884b6c85da311930a3e => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:16.447051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933af5f-71f6-47ad-bef9-50cc233265ab None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:16.447342 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933af5f-71f6-47ad-bef9-50cc233265ab None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:16.447688 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933af5f-71f6-47ad-bef9-50cc233265ab None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:16.452396 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 448/915] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:16.456339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711b324-e4af-4a29-804f-079f25ef0c57 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:16.456770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711b324-e4af-4a29-804f-079f25ef0c57 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:16.457339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711b324-e4af-4a29-804f-079f25ef0c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:16.480846 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac6596-f8ca-47d5-a8e9-1ea2d58fb131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:16.482242 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac6596-f8ca-47d5-a8e9-1ea2d58fb131 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:16.482710 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac6596-f8ca-47d5-a8e9-1ea2d58fb131 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:16.483230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac6596-f8ca-47d5-a8e9-1ea2d58fb131 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:16.485188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac6596-f8ca-47d5-a8e9-1ea2d58fb131 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:16.486082 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b711b324-e4af-4a29-804f-079f25ef0c57 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:16.487423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac6596-f8ca-47d5-a8e9-1ea2d58fb131 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:16.488095 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b711b324-e4af-4a29-804f-079f25ef0c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:16.503071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d6ac6596-f8ca-47d5-a8e9-1ea2d58fb131 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:30:16.503071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:16.503071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:30:16.503071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:30:16.503071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:30:16.503071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:30:16.503071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:30:16.503071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:16.503071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:30:16.503071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:16.503071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:16.503071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:16.503071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:16.503071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:16.503071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:16.503071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:16.503071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:16.504578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:16.504578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:16.504578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:16.504578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:16.504578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:16.504578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:16.504578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:30:16.504578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:30:16.504578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:30:16.504578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:30:16.504578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:16.504578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:16.504578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:16.504578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:16.504578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:16.504578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:16.506387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:16.506387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:16.506387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:16.506387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:16.506387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:16.506387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:16.506387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:16.506387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:16.506387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:16.506387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:16.506387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:30:16.506387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:16.506387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:30:16.506387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:16.517698 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 468/916] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 26 16:30:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:16.519291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac6596-f8ca-47d5-a8e9-1ea2d58fb131 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:16.523187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:16.570204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:16.617925 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 449/917] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:30:16.651814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711b324-e4af-4a29-804f-079f25ef0c57 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:16.665277 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac6596-f8ca-47d5-a8e9-1ea2d58fb131 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:16.712355 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00f4ad-e9e2-4069-bbbf-938e8e488a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:16.712962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00f4ad-e9e2-4069-bbbf-938e8e488a1b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:16.713244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00f4ad-e9e2-4069-bbbf-938e8e488a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:16.713546 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00f4ad-e9e2-4069-bbbf-938e8e488a1b None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:16.715170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00f4ad-e9e2-4069-bbbf-938e8e488a1b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:16.715170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00f4ad-e9e2-4069-bbbf-938e8e488a1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:16.715985 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00f4ad-e9e2-4069-bbbf-938e8e488a1b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:16.724889 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 469/918] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 26 16:30:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:16.731411 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00f4ad-e9e2-4069-bbbf-938e8e488a1b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:16.836972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:16.840372 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711b324-e4af-4a29-804f-079f25ef0c57 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:16.892930 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de327e-58e1-4581-b83f-460a538b2560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:16.893835 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de327e-58e1-4581-b83f-460a538b2560 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:16.894130 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de327e-58e1-4581-b83f-460a538b2560 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:16.894388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de327e-58e1-4581-b83f-460a538b2560 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:16.895220 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de327e-58e1-4581-b83f-460a538b2560 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:16.896849 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de327e-58e1-4581-b83f-460a538b2560 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:16.905958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00f4ad-e9e2-4069-bbbf-938e8e488a1b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:16.911145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-38de327e-58e1-4581-b83f-460a538b2560 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:30:16.911145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:16.911145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:30:16.911145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:30:16.911145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:30:16.911145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:30:16.911145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:30:16.911145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:16.911145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:30:16.911145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:16.911145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:16.911145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:16.911145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:16.911145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:16.911145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:16.911145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:16.911145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:16.912161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:16.912161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:16.912161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:16.912161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:16.912161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:16.912161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:16.912161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:30:16.912161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:30:16.912161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:30:16.912161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:30:16.912161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:16.912161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:16.912161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:16.912161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:16.912161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:16.912161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:16.913630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:16.913630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:16.913630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:16.913630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:16.913630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:16.913630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:16.913630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:16.913630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:16.913630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:16.913630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:16.913630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:30:16.913630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:16.913630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:30:16.913630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:16.913630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 450/919] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 16:30:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:16.914447 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2517c8-c710-4e4a-a631-0d9e1d5e576b None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:16.914447 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2517c8-c710-4e4a-a631-0d9e1d5e576b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:16.914568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2517c8-c710-4e4a-a631-0d9e1d5e576b None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:16.917311 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 451/920] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:16.918157 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2517c8-c710-4e4a-a631-0d9e1d5e576b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:16.949713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea889df-43c8-4e1a-aec0-188d6f1bb20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:16.950348 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea889df-43c8-4e1a-aec0-188d6f1bb20d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:16.950636 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea889df-43c8-4e1a-aec0-188d6f1bb20d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:16.950910 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea889df-43c8-4e1a-aec0-188d6f1bb20d None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:16.951624 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea889df-43c8-4e1a-aec0-188d6f1bb20d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:16.951930 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea889df-43c8-4e1a-aec0-188d6f1bb20d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:16.953900 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea889df-43c8-4e1a-aec0-188d6f1bb20d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:16.959743 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 470/921] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 26 16:30:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:16.961115 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f28be-7ba7-49e9-a346-fbf9f86f7555 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:16.961436 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f28be-7ba7-49e9-a346-fbf9f86f7555 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:16.961777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f28be-7ba7-49e9-a346-fbf9f86f7555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:16.976877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:16.986352 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4b5f28be-7ba7-49e9-a346-fbf9f86f7555 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:16.987635 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4b5f28be-7ba7-49e9-a346-fbf9f86f7555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:17.053632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2517c8-c710-4e4a-a631-0d9e1d5e576b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:17.089155 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 471/922] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:17.090407 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f28be-7ba7-49e9-a346-fbf9f86f7555 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:17.111488 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15ac61-09f7-46fb-9cca-9318069c54ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:17.112918 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15ac61-09f7-46fb-9cca-9318069c54ee None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:17.113321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15ac61-09f7-46fb-9cca-9318069c54ee None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:17.113636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15ac61-09f7-46fb-9cca-9318069c54ee None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:17.115734 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15ac61-09f7-46fb-9cca-9318069c54ee None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:17.116055 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15ac61-09f7-46fb-9cca-9318069c54ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:17.117506 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15ac61-09f7-46fb-9cca-9318069c54ee None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:17.124624 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 452/923] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 16:30:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:17.126257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15ac61-09f7-46fb-9cca-9318069c54ee None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:17.167405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:17.222241 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f28be-7ba7-49e9-a346-fbf9f86f7555 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:17.263936 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185018dc-066b-4aa6-950e-bb7ee04395e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:17.264752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185018dc-066b-4aa6-950e-bb7ee04395e4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:17.264938 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185018dc-066b-4aa6-950e-bb7ee04395e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:17.265210 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185018dc-066b-4aa6-950e-bb7ee04395e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:17.266097 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185018dc-066b-4aa6-950e-bb7ee04395e4 None admin] RBAC: Adding query filter params (interface=public, service_id=c906876a85824026b64697bbf486e6c8, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:17.266404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185018dc-066b-4aa6-950e-bb7ee04395e4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:17.267785 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185018dc-066b-4aa6-950e-bb7ee04395e4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:17.278293 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 472/924] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 26 16:30:17 2022] GET /identity/v3/endpoints?service_id=c906876a85824026b64697bbf486e6c8&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:17.278293 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185018dc-066b-4aa6-950e-bb7ee04395e4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:17.278590 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15ac61-09f7-46fb-9cca-9318069c54ee None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:17.288042 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:17.327863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb63a4-9903-4e59-8d50-8256c8eea4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:17.329217 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb63a4-9903-4e59-8d50-8256c8eea4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:17.329528 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb63a4-9903-4e59-8d50-8256c8eea4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:17.329802 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb63a4-9903-4e59-8d50-8256c8eea4d8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:17.330460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb63a4-9903-4e59-8d50-8256c8eea4d8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:17.331966 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb63a4-9903-4e59-8d50-8256c8eea4d8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:17.345756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-adfb63a4-9903-4e59-8d50-8256c8eea4d8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:30:17.345756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:17.345756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:30:17.345756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:30:17.345756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:30:17.345756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:30:17.345756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:30:17.345756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:17.345756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:30:17.345756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:17.345756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:17.345756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:17.345756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:17.345756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:17.345756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:17.345756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:17.347043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:17.347043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:17.347043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:17.347043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:17.347043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:17.347043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:17.347043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:17.347043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:30:17.347043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:30:17.347043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:30:17.347043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:30:17.347043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:17.347043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:17.347043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:17.347043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:17.347043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:17.347888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:17.347888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:17.347888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:17.347888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:17.347888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:17.347888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:17.347888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:17.347888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:17.347888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:17.347888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:17.347888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:17.347888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:30:17.347888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:17.347888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:30:17.347888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:17.352387 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 453/925] 10.222.0.48 () {56 vars in 1132 bytes} [Thu May 26 16:30:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:17.353223 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb63a4-9903-4e59-8d50-8256c8eea4d8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:17.405951 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185018dc-066b-4aa6-950e-bb7ee04395e4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:17.434434 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:17.447904 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6025c-9a2d-41e7-b629-bea810f13ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:17.448583 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6025c-9a2d-41e7-b629-bea810f13ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:17.448865 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6025c-9a2d-41e7-b629-bea810f13ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:17.449158 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6025c-9a2d-41e7-b629-bea810f13ae0 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:17.449890 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6025c-9a2d-41e7-b629-bea810f13ae0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:17.450192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6025c-9a2d-41e7-b629-bea810f13ae0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:17.451552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6025c-9a2d-41e7-b629-bea810f13ae0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:17.458198 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 473/926] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 16:30:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:17.461966 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6025c-9a2d-41e7-b629-bea810f13ae0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:17.485611 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb63a4-9903-4e59-8d50-8256c8eea4d8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:17.533072 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd748e8e-9a71-4c1b-b4ce-3114a394fc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:17.533687 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd748e8e-9a71-4c1b-b4ce-3114a394fc9f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:17.533962 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd748e8e-9a71-4c1b-b4ce-3114a394fc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:17.534231 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd748e8e-9a71-4c1b-b4ce-3114a394fc9f None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:17.534910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd748e8e-9a71-4c1b-b4ce-3114a394fc9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:17.536282 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd748e8e-9a71-4c1b-b4ce-3114a394fc9f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:17.545467 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 454/927] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 26 16:30:17 2022] GET /identity/v3/services => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:30:17.545467 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd748e8e-9a71-4c1b-b4ce-3114a394fc9f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:17.605373 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6025c-9a2d-41e7-b629-bea810f13ae0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:17.618169 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:17.665981 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366ecb0-27e1-4183-a68a-cd6ec44aa5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:17.667300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366ecb0-27e1-4183-a68a-cd6ec44aa5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:17.667844 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366ecb0-27e1-4183-a68a-cd6ec44aa5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:17.668435 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366ecb0-27e1-4183-a68a-cd6ec44aa5b8 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:17.670123 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366ecb0-27e1-4183-a68a-cd6ec44aa5b8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:17.670635 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366ecb0-27e1-4183-a68a-cd6ec44aa5b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:17.672635 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366ecb0-27e1-4183-a68a-cd6ec44aa5b8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:17.681645 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 474/928] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 26 16:30:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:17.687865 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366ecb0-27e1-4183-a68a-cd6ec44aa5b8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:17.731327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd748e8e-9a71-4c1b-b4ce-3114a394fc9f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:17.776157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:17.780922 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b981242-5984-4552-ba9f-9f0fc34d47b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:17.782870 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b981242-5984-4552-ba9f-9f0fc34d47b3 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:17.782870 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b981242-5984-4552-ba9f-9f0fc34d47b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:17.782870 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b981242-5984-4552-ba9f-9f0fc34d47b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:17.783366 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b981242-5984-4552-ba9f-9f0fc34d47b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:17.784578 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b981242-5984-4552-ba9f-9f0fc34d47b3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:17.848969 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366ecb0-27e1-4183-a68a-cd6ec44aa5b8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:17.900233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a895d-50d9-4cc1-995f-68cd990ab4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:17.900934 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a895d-50d9-4cc1-995f-68cd990ab4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:17.901220 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a895d-50d9-4cc1-995f-68cd990ab4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:17.901526 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a895d-50d9-4cc1-995f-68cd990ab4b4 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:17.902268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a895d-50d9-4cc1-995f-68cd990ab4b4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:17.902592 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a895d-50d9-4cc1-995f-68cd990ab4b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:17.903980 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a895d-50d9-4cc1-995f-68cd990ab4b4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:17.910371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 475/929] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 26 16:30:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:17.916288 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a895d-50d9-4cc1-995f-68cd990ab4b4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:17.931769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 455/930] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 26 16:30:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:30:18.056852 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a895d-50d9-4cc1-995f-68cd990ab4b4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:18.093736 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:18.132339 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5fb2c0-daf6-4216-a075-29a18f2a43c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:18.133141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fb2c0-daf6-4216-a075-29a18f2a43c6 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:18.133457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fb2c0-daf6-4216-a075-29a18f2a43c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:18.133727 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fb2c0-daf6-4216-a075-29a18f2a43c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:18.134524 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5fb2c0-daf6-4216-a075-29a18f2a43c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:18.135933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5fb2c0-daf6-4216-a075-29a18f2a43c6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:18.261897 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 476/931] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 26 16:30:17 2022] POST /identity/v3/endpoints => generated 347 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:30:18.979557 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcc6d5-215f-4020-98e1-97f97f9f0335 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:18.980078 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcc6d5-215f-4020-98e1-97f97f9f0335 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:18.980188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcc6d5-215f-4020-98e1-97f97f9f0335 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:18.981798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 456/932] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:18.987172 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f2d54-6deb-44ef-bf16-f65228fa2489 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:18.987582 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f2d54-6deb-44ef-bf16-f65228fa2489 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:18.987752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f2d54-6deb-44ef-bf16-f65228fa2489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:19.005330 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3a7f2d54-6deb-44ef-bf16-f65228fa2489 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:19.006521 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3a7f2d54-6deb-44ef-bf16-f65228fa2489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:19.101448 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 477/933] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:19.123694 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcc6d5-215f-4020-98e1-97f97f9f0335 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:19.230647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:19.249285 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcc6d5-215f-4020-98e1-97f97f9f0335 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:19.285340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befce428-ce22-4c5b-8d30-beca9b7bbca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:19.286175 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befce428-ce22-4c5b-8d30-beca9b7bbca6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:19.286459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befce428-ce22-4c5b-8d30-beca9b7bbca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:19.286736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befce428-ce22-4c5b-8d30-beca9b7bbca6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:19.299409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befce428-ce22-4c5b-8d30-beca9b7bbca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:19.307770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-befce428-ce22-4c5b-8d30-beca9b7bbca6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:30:19.307770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:19.307770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:19.307770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:19.307770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:19.307770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:19.307770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:19.307770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:19.307770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:19.307770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:19.307770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:19.307770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:19.307770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:19.307770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:19.307770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:19.307770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:19.308711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:19.308711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:19.308711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:19.308711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:19.308711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:19.308711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:19.308711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:19.308711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:19.308711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:19.308711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:19.308711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:19.308711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:19.308711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:19.308711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:19.308711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:19.308711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:19.310259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:19.310259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:19.310259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:19.310259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:19.310259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:19.310259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:19.310259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:19.310259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:19.310259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:19.310259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:19.310259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:30:19.310259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:19.310259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 457/934] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 26 16:30:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:19.315194 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f2d54-6deb-44ef-bf16-f65228fa2489 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:19.418437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:19.425832 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f2d54-6deb-44ef-bf16-f65228fa2489 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:19.469287 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c91efa-3ecf-4ae4-b685-8c831ffa0190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:19.469287 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c91efa-3ecf-4ae4-b685-8c831ffa0190 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:19.469287 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c91efa-3ecf-4ae4-b685-8c831ffa0190 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:19.469925 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c91efa-3ecf-4ae4-b685-8c831ffa0190 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:19.470071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c91efa-3ecf-4ae4-b685-8c831ffa0190 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:19.473285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c91efa-3ecf-4ae4-b685-8c831ffa0190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:19.473285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c91efa-3ecf-4ae4-b685-8c831ffa0190 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:19.486291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 478/935] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 26 16:30:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:19.488367 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befce428-ce22-4c5b-8d30-beca9b7bbca6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:19.599199 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befce428-ce22-4c5b-8d30-beca9b7bbca6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:19.635882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180f24a-d194-42e3-8cad-3071a4028757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:19.636680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180f24a-d194-42e3-8cad-3071a4028757 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:19.636959 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180f24a-d194-42e3-8cad-3071a4028757 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:19.637228 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180f24a-d194-42e3-8cad-3071a4028757 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:19.649316 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180f24a-d194-42e3-8cad-3071a4028757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:19.650778 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180f24a-d194-42e3-8cad-3071a4028757 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:19.669622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-7180f24a-d194-42e3-8cad-3071a4028757 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:19.669622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:19.669622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:19.669622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:19.669622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:19.669622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:19.669622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:19.669622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:19.669622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:19.669622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:19.669622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:19.669622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:19.669622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:19.669622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:19.669622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:19.670643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:19.670643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:19.670643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:19.670643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:19.670643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:19.670643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:19.670643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:19.670643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:19.670643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:19.670643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:19.670643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:19.670643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:19.670643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:19.670643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:19.670643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:19.670643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:19.670643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:19.672051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:19.672051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:19.672051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:19.672051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:19.672051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 458/936] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:19.676834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c91efa-3ecf-4ae4-b685-8c831ffa0190 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:19.784587 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c91efa-3ecf-4ae4-b685-8c831ffa0190 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:19.825284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693d52a-fe46-40f7-a8b2-8f71dd42c8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:19.825284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693d52a-fe46-40f7-a8b2-8f71dd42c8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:19.825284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693d52a-fe46-40f7-a8b2-8f71dd42c8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:19.825284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693d52a-fe46-40f7-a8b2-8f71dd42c8d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:19.825715 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693d52a-fe46-40f7-a8b2-8f71dd42c8d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:19.825715 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693d52a-fe46-40f7-a8b2-8f71dd42c8d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:19.826497 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693d52a-fe46-40f7-a8b2-8f71dd42c8d8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:19.842604 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 479/937] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:19.849187 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180f24a-d194-42e3-8cad-3071a4028757 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:19.853629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:19.958107 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180f24a-d194-42e3-8cad-3071a4028757 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:19.994011 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d597f-5156-4ebc-993e-5d162ca8d73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:19.998958 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d597f-5156-4ebc-993e-5d162ca8d73f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:19.999245 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d597f-5156-4ebc-993e-5d162ca8d73f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:19.999520 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d597f-5156-4ebc-993e-5d162ca8d73f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:20.007753 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d597f-5156-4ebc-993e-5d162ca8d73f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:20.009219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d597f-5156-4ebc-993e-5d162ca8d73f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:20.025530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-ef0d597f-5156-4ebc-993e-5d162ca8d73f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:30:20.025530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:20.025530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:20.025530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:20.025530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:20.025530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:20.025530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:20.025530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:20.025530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:20.025530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:20.025530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:20.025530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:20.025530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:30:20.025530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:30:20.025530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:30:20.025530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:30:20.026524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:20.026524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:20.026524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:30:20.026524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:20.026524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:30:20.026524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:20.026524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:20.026524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:20.026524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:20.026524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:20.026524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:20.026524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:20.026524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:20.026524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:20.026524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:20.026524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:20.026524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:20.026524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:20.027906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:20.027906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:20.027906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:30:20.027906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:30:20.027906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:30:20.027906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:30:20.027906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:30:20.027906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:30:20.027906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:30:20.027906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:20.027906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 459/938] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 26 16:30:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:20.033346 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693d52a-fe46-40f7-a8b2-8f71dd42c8d8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:20.044650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d293c-fb7a-463a-8342-4671d0ca5249 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:20.044926 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d293c-fb7a-463a-8342-4671d0ca5249 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:20.047597 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d293c-fb7a-463a-8342-4671d0ca5249 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:20.047597 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 460/939] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:20.056034 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf859885-7f86-47e5-a1f1-5cb828f73c5a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:20.056200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:20.056283 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf859885-7f86-47e5-a1f1-5cb828f73c5a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:20.056283 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf859885-7f86-47e5-a1f1-5cb828f73c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:20.073840 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-cf859885-7f86-47e5-a1f1-5cb828f73c5a None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:20.075260 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cf859885-7f86-47e5-a1f1-5cb828f73c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:20.148377 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:20.170325 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 461/940] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:30:20.171350 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693d52a-fe46-40f7-a8b2-8f71dd42c8d8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:20.191467 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf859885-7f86-47e5-a1f1-5cb828f73c5a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:20.224487 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ffa2d-4232-4e68-a996-908b6d0453d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:20.225562 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ffa2d-4232-4e68-a996-908b6d0453d8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:20.225916 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ffa2d-4232-4e68-a996-908b6d0453d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:20.226258 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ffa2d-4232-4e68-a996-908b6d0453d8 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:20.227343 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ffa2d-4232-4e68-a996-908b6d0453d8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:20.227721 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ffa2d-4232-4e68-a996-908b6d0453d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:20.229955 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ffa2d-4232-4e68-a996-908b6d0453d8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:20.257337 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 480/941] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 26 16:30:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:20.260451 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ffa2d-4232-4e68-a996-908b6d0453d8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:20.318119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf859885-7f86-47e5-a1f1-5cb828f73c5a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:20.357337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1e248-2943-4ab9-9f9d-adee7c7dd759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:20.357549 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1e248-2943-4ab9-9f9d-adee7c7dd759 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:20.357793 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1e248-2943-4ab9-9f9d-adee7c7dd759 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:20.358067 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1e248-2943-4ab9-9f9d-adee7c7dd759 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:20.358722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1e248-2943-4ab9-9f9d-adee7c7dd759 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:20.360652 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1e248-2943-4ab9-9f9d-adee7c7dd759 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:20.363998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:20.377338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-0ee1e248-2943-4ab9-9f9d-adee7c7dd759 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:30:20.377338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:20.377338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:30:20.377338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:30:20.377338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:30:20.377338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:30:20.377338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:30:20.377338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:20.377338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:30:20.377338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:20.377338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:20.377338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:20.377338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:20.377338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:20.377338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:20.377338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:20.377338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:20.378391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:20.378391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:20.378391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:20.378391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:20.378391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:20.378391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:20.378391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:30:20.378391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:30:20.378391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:30:20.378391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:30:20.378391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:20.378391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:20.378391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:20.378391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:20.378391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:20.378391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:20.379226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:20.379226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:20.379226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:20.379226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:20.379226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:20.379226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:20.379226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:20.379226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:20.379226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:20.379226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:20.379226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:30:20.379226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:20.379226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:30:20.379226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:20.383844 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 462/942] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 26 16:30:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:20.385582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d28cb-b915-4ed0-928f-36b6dfb24db9 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:20.385933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d28cb-b915-4ed0-928f-36b6dfb24db9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:20.386319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d28cb-b915-4ed0-928f-36b6dfb24db9 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:20.387893 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 463/943] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:20.388653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d28cb-b915-4ed0-928f-36b6dfb24db9 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:20.397064 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ffa2d-4232-4e68-a996-908b6d0453d8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:20.433320 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f3e8c-9fd5-42a9-8f2b-0a5ccb88fa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:20.434513 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f3e8c-9fd5-42a9-8f2b-0a5ccb88fa4a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:20.434853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f3e8c-9fd5-42a9-8f2b-0a5ccb88fa4a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:20.435211 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f3e8c-9fd5-42a9-8f2b-0a5ccb88fa4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:20.447502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f3e8c-9fd5-42a9-8f2b-0a5ccb88fa4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:20.448365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f3e8c-9fd5-42a9-8f2b-0a5ccb88fa4a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:20.453278 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:20.467508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-831f3e8c-9fd5-42a9-8f2b-0a5ccb88fa4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:20.467508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:20.467508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:20.467508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:20.467508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:20.467508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:20.467508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:20.467508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:20.467508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:20.467508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:20.467508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:20.467508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:20.467508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:20.467508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:20.467508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:20.468949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:20.468949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:20.468949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:20.468949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:20.468949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:20.468949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:20.468949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:20.468949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:20.468949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:20.468949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:20.468949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:20.468949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:20.468949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:20.468949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:20.468949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:20.468949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:20.468949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:20.469943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:20.469943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:20.469943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:20.469943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:20.469943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 481/944] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:20.471185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14135f0e-b501-44a5-90fa-419f4152965a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:20.471185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14135f0e-b501-44a5-90fa-419f4152965a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:20.471347 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14135f0e-b501-44a5-90fa-419f4152965a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:20.487997 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-14135f0e-b501-44a5-90fa-419f4152965a None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:20.489181 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-14135f0e-b501-44a5-90fa-419f4152965a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:20.506962 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d28cb-b915-4ed0-928f-36b6dfb24db9 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:20.548063 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8006653-f9ef-451b-96f9-039a3fac5b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:20.548757 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8006653-f9ef-451b-96f9-039a3fac5b4c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:20.549043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8006653-f9ef-451b-96f9-039a3fac5b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:20.549377 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8006653-f9ef-451b-96f9-039a3fac5b4c None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:20.551257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8006653-f9ef-451b-96f9-039a3fac5b4c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:20.551597 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8006653-f9ef-451b-96f9-039a3fac5b4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:20.553346 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8006653-f9ef-451b-96f9-039a3fac5b4c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:20.560385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 464/945] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 26 16:30:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:20.561053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8006653-f9ef-451b-96f9-039a3fac5b4c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:20.572931 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 482/946] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:20.573715 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14135f0e-b501-44a5-90fa-419f4152965a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:20.638994 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:20.690073 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14135f0e-b501-44a5-90fa-419f4152965a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:20.690315 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8006653-f9ef-451b-96f9-039a3fac5b4c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:20.714725 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:20.731063 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acb766-e411-4096-8ce7-f4a531747082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:20.731710 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acb766-e411-4096-8ce7-f4a531747082 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:20.731994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acb766-e411-4096-8ce7-f4a531747082 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:20.732266 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acb766-e411-4096-8ce7-f4a531747082 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:20.732988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acb766-e411-4096-8ce7-f4a531747082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:20.733277 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e09d3-7d53-4159-b342-b059e789b136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:20.733392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acb766-e411-4096-8ce7-f4a531747082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:20.734049 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e09d3-7d53-4159-b342-b059e789b136 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:20.734896 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e09d3-7d53-4159-b342-b059e789b136 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:20.735268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e09d3-7d53-4159-b342-b059e789b136 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:20.735367 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acb766-e411-4096-8ce7-f4a531747082 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:20.736051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e09d3-7d53-4159-b342-b059e789b136 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:20.736358 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e09d3-7d53-4159-b342-b059e789b136 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:20.737750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e09d3-7d53-4159-b342-b059e789b136 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:20.743317 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 483/947] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 26 16:30:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:20.744459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e09d3-7d53-4159-b342-b059e789b136 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:20.752551 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 465/948] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:20.754194 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e936e9-5489-4026-ad5f-1ac750403915 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:20.754483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e936e9-5489-4026-ad5f-1ac750403915 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:20.754756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e936e9-5489-4026-ad5f-1ac750403915 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:20.756055 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 466/949] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:20.756733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e936e9-5489-4026-ad5f-1ac750403915 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:20.854060 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e09d3-7d53-4159-b342-b059e789b136 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:20.863923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e936e9-5489-4026-ad5f-1ac750403915 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:20.875304 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:20.889635 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7aa5f-fc69-4897-ba51-f24c40488612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:20.917874 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7aa5f-fc69-4897-ba51-f24c40488612 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:20.917874 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7aa5f-fc69-4897-ba51-f24c40488612 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:20.917874 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7aa5f-fc69-4897-ba51-f24c40488612 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:20.917874 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7aa5f-fc69-4897-ba51-f24c40488612 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:20.917874 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7aa5f-fc69-4897-ba51-f24c40488612 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:20.918464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: WARNING keystone.server.flask.common [None req-fab7aa5f-fc69-4897-ba51-f24c40488612 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 16:30:20.918541 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bd759-39dd-476d-860b-4bc0efdbf5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:20.918541 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bd759-39dd-476d-860b-4bc0efdbf5d6 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:20.918541 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bd759-39dd-476d-860b-4bc0efdbf5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:20.918541 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bd759-39dd-476d-860b-4bc0efdbf5d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:20.918961 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bd759-39dd-476d-860b-4bc0efdbf5d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:20.918961 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bd759-39dd-476d-860b-4bc0efdbf5d6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:20.996605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.sql.core [None req-fab7aa5f-fc69-4897-ba51-f24c40488612 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 16:30:20.996605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 16:30:20.996605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [parameters: {'id': 'c006266bb3b045cb96f73f44719692c7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 16:30:20.996605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80498) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 16:30:21.014972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-fab7aa5f-fc69-4897-ba51-f24c40488612 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c006266bb3b045cb96f73f44719692c7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c006266bb3b045cb96f73f44719692c7. May 26 16:30:21.014972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:21.014972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:30:21.014972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:30:21.014972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:30:21.014972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:30:21.014972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:30:21.014972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:30:21.014972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:30:21.014972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application conn.query(q) May 26 16:30:21.014972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:30:21.014972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:30:21.014972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:30:21.018668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application result.read() May 26 16:30:21.018668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:30:21.018668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:30:21.018668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:30:21.018668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:30:21.018668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:30:21.018668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:30:21.018668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:30:21.018668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:30:21.018668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 16:30:21.018668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:21.018668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 16:30:21.018668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:21.018668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:21.018668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 16:30:21.018668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 16:30:21.018668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 26 16:30:21.018668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return project_ref.to_dict() May 26 16:30:21.019791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:30:21.019791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application next(self.gen) May 26 16:30:21.019791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 16:30:21.019791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application yield resource May 26 16:30:21.019791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:30:21.019791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application next(self.gen) May 26 16:30:21.019791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 16:30:21.019791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self.session.rollback() May 26 16:30:21.019791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 16:30:21.019791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self.force_reraise() May 26 16:30:21.019791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 16:30:21.019791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise self.value May 26 16:30:21.019791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 16:30:21.019791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 16:30:21.019791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 16:30:21.019791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application session.commit() May 26 16:30:21.019791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 16:30:21.020722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 16:30:21.020722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 16:30:21.020722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._prepare_impl() May 26 16:30:21.020722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 16:30:21.020722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self.session.flush() May 26 16:30:21.020722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 16:30:21.020722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._flush(objects) May 26 16:30:21.020722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 16:30:21.020722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 16:30:21.020722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 16:30:21.020722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application compat.raise_( May 26 16:30:21.020722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:30:21.020722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception May 26 16:30:21.020722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 16:30:21.020722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application flush_context.execute() May 26 16:30:21.020722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 16:30:21.020722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rec.execute(self) May 26 16:30:21.021682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 16:30:21.021682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 16:30:21.021682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 16:30:21.021682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 16:30:21.021682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 16:30:21.021682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 16:30:21.021682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 16:30:21.021682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 16:30:21.021682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 16:30:21.021682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 16:30:21.021682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 16:30:21.021682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 16:30:21.021682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 16:30:21.021682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 16:30:21.021682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 16:30:21.022725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 16:30:21.022725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:30:21.022725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception May 26 16:30:21.022725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:30:21.022725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:30:21.022725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:30:21.022725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:30:21.022725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:30:21.022725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:30:21.022725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:30:21.022725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application conn.query(q) May 26 16:30:21.022725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:30:21.022725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:30:21.022725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:30:21.022725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application result.read() May 26 16:30:21.022725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:30:21.022725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:30:21.023802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:30:21.023802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:30:21.023802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:30:21.023802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:30:21.023802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:30:21.023802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:30:21.023802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 16:30:21.023802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 16:30:21.023802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [parameters: {'id': 'c006266bb3b045cb96f73f44719692c7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 16:30:21.023802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 16:30:21.023802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:21.023802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:21.023802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:21.023802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:21.023802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 26 16:30:21.024763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 26 16:30:21.024763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 16:30:21.024763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 16:30:21.024763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 26 16:30:21.024763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:21.024763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:21.024763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:21.024763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:21.024763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:21.024763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:21.024763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:21.024763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:21.024763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:21.024763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:21.024763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:21.024763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:21.024763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:21.026238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:21.026238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 26 16:30:21.026238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 26 16:30:21.026238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:21.026238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:21.026238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 26 16:30:21.026238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.Conflict( May 26 16:30:21.026238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c006266bb3b045cb96f73f44719692c7. May 26 16:30:21.026238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:21.026238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 484/950] 10.222.0.48 () {60 vars in 1140 bytes} [Thu May 26 16:30:20 2022] POST /identity/v3/projects => generated 262 bytes in 273 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:21.026238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7aa5f-fc69-4897-ba51-f24c40488612 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:21.054713 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 467/951] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 26 16:30:20 2022] POST /identity/v3/endpoints => generated 349 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:30:21.056152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c456c-132e-41b3-950c-82f9c75060c3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:21.056450 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c456c-132e-41b3-950c-82f9c75060c3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:21.056791 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c456c-132e-41b3-950c-82f9c75060c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:21.087274 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3a6c456c-132e-41b3-950c-82f9c75060c3 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:21.089309 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3a6c456c-132e-41b3-950c-82f9c75060c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:21.132008 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:21.151851 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7aa5f-fc69-4897-ba51-f24c40488612 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:21.190936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 468/952] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:21.192153 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c456c-132e-41b3-950c-82f9c75060c3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:21.197811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156c279-6add-4fd3-aef4-5ce36b1d72c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:21.199540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156c279-6add-4fd3-aef4-5ce36b1d72c1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:21.200218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156c279-6add-4fd3-aef4-5ce36b1d72c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:21.200941 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156c279-6add-4fd3-aef4-5ce36b1d72c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:21.216727 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156c279-6add-4fd3-aef4-5ce36b1d72c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:21.218486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156c279-6add-4fd3-aef4-5ce36b1d72c1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:21.236370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-4156c279-6add-4fd3-aef4-5ce36b1d72c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:21.236370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:21.236370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:21.236370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:21.236370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:21.236370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:21.236370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:21.236370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:21.236370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:21.236370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:21.236370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:21.236370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:21.236370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:30:21.236370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:30:21.236370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:30:21.237556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:30:21.237556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:21.237556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:21.237556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:21.237556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:21.237556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:21.237556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:21.237556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:21.237556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:21.237556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:21.237556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:21.237556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:21.237556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:21.237556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:21.237556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:21.237556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:21.237556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:21.239228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:30:21.239228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:30:21.239228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:30:21.239228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:30:21.239228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:30:21.239228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:30:21.239228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:21.239228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:21.243132 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 485/953] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:30:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:21.244074 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156c279-6add-4fd3-aef4-5ce36b1d72c1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:21.287615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:21.325041 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c456c-132e-41b3-950c-82f9c75060c3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:21.364278 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32501ee-b104-4eff-bc49-50299c686481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:21.365403 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32501ee-b104-4eff-bc49-50299c686481 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:21.365831 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32501ee-b104-4eff-bc49-50299c686481 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:21.366251 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32501ee-b104-4eff-bc49-50299c686481 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:21.367415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156c279-6add-4fd3-aef4-5ce36b1d72c1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:21.373835 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32501ee-b104-4eff-bc49-50299c686481 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:21.376152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32501ee-b104-4eff-bc49-50299c686481 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:21.391511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-c32501ee-b104-4eff-bc49-50299c686481 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:21.391511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:21.391511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:21.391511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:21.391511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:21.391511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:21.391511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:21.391511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:21.391511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:21.391511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:21.391511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:21.391511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:21.391511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:30:21.391511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:30:21.391511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:30:21.392565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:30:21.392565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:21.392565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:21.392565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:21.392565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:21.392565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:21.392565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:21.392565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:21.392565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:21.392565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:21.392565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:21.392565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:21.392565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:21.392565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:21.392565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:21.392565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:21.392565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:21.393677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:30:21.393677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:30:21.393677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:30:21.393677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:30:21.393677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:30:21.393677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:30:21.393677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:21.393677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:21.395927 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 469/954] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:30:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:21.397057 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32501ee-b104-4eff-bc49-50299c686481 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:21.415075 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472f9ee-5865-492a-8919-fad7a4f75b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:21.416052 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472f9ee-5865-492a-8919-fad7a4f75b59 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:21.416410 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472f9ee-5865-492a-8919-fad7a4f75b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:21.416758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472f9ee-5865-492a-8919-fad7a4f75b59 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:21.417526 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472f9ee-5865-492a-8919-fad7a4f75b59 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:21.419013 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472f9ee-5865-492a-8919-fad7a4f75b59 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:21.430610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:21.436104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-3472f9ee-5865-492a-8919-fad7a4f75b59 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:30:21.436104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:21.436104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:30:21.436104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:30:21.436104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:30:21.436104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:30:21.436104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:30:21.436104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:21.436104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:30:21.436104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:21.436104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:21.436104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:21.436104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:21.436104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:21.436104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:21.436104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:21.436104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:21.437671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:21.437671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:21.437671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:21.437671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:21.437671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:21.437671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:21.437671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:30:21.437671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:30:21.437671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:30:21.437671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:30:21.437671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:21.437671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:21.437671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:21.437671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:21.437671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:21.437671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:21.438649 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:21.438649 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:21.438649 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:21.438649 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:21.438649 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:21.438649 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:21.438649 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:21.438649 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:21.438649 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:21.438649 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:21.438649 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:30:21.438649 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:21.438649 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:30:21.438649 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:21.438649 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 486/955] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:30:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:21.439445 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472f9ee-5865-492a-8919-fad7a4f75b59 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:21.522871 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32501ee-b104-4eff-bc49-50299c686481 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:21.558854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:21.562117 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c212c7-a30f-462b-9098-eaa8a48401a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:21.563220 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472f9ee-5865-492a-8919-fad7a4f75b59 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:21.563330 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c212c7-a30f-462b-9098-eaa8a48401a5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:21.563580 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c212c7-a30f-462b-9098-eaa8a48401a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:21.563853 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c212c7-a30f-462b-9098-eaa8a48401a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:21.564658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c212c7-a30f-462b-9098-eaa8a48401a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:21.565433 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c212c7-a30f-462b-9098-eaa8a48401a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:21.567115 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c212c7-a30f-462b-9098-eaa8a48401a5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:21.580342 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 470/956] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:30:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:21.581423 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c212c7-a30f-462b-9098-eaa8a48401a5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:21.602804 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07907c47-d86c-41ba-b814-1bd3eb7a5bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:21.603478 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07907c47-d86c-41ba-b814-1bd3eb7a5bad None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:21.603799 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07907c47-d86c-41ba-b814-1bd3eb7a5bad None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:21.604035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07907c47-d86c-41ba-b814-1bd3eb7a5bad None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:21.604849 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07907c47-d86c-41ba-b814-1bd3eb7a5bad None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:21.605084 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07907c47-d86c-41ba-b814-1bd3eb7a5bad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:21.607723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07907c47-d86c-41ba-b814-1bd3eb7a5bad None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:21.628510 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 487/957] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 16:30:21 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:21.629397 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07907c47-d86c-41ba-b814-1bd3eb7a5bad None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:21.716226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:21.740507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c212c7-a30f-462b-9098-eaa8a48401a5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:21.788308 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07907c47-d86c-41ba-b814-1bd3eb7a5bad None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:21.792699 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefea6e6-2b0b-4fdf-8220-a86d1feabe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:21.793768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefea6e6-2b0b-4fdf-8220-a86d1feabe8f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:21.794244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefea6e6-2b0b-4fdf-8220-a86d1feabe8f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:21.794695 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefea6e6-2b0b-4fdf-8220-a86d1feabe8f None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:21.795655 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefea6e6-2b0b-4fdf-8220-a86d1feabe8f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:21.796138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefea6e6-2b0b-4fdf-8220-a86d1feabe8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:21.798215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefea6e6-2b0b-4fdf-8220-a86d1feabe8f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:21.809677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 471/958] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 16:30:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:21.814254 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefea6e6-2b0b-4fdf-8220-a86d1feabe8f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:21.831808 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16822e08-ffed-4b33-bbb7-f8d7f070ed08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:21.833713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16822e08-ffed-4b33-bbb7-f8d7f070ed08 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:21.834223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16822e08-ffed-4b33-bbb7-f8d7f070ed08 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:21.834666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16822e08-ffed-4b33-bbb7-f8d7f070ed08 None admin] PATH_INFO: `/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/4d2ab3eeb5b44979956dd223ac6b7c39/roles/6380c038334a4884b6c85da311930a3e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:21.838329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16822e08-ffed-4b33-bbb7-f8d7f070ed08 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3379cdd914747758e71b3b05c5921b1, user_id=4d2ab3eeb5b44979956dd223ac6b7c39, role_id=6380c038334a4884b6c85da311930a3e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:21.839997 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16822e08-ffed-4b33-bbb7-f8d7f070ed08 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:21.912218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 488/959] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:30:21 2022] PUT /identity/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/4d2ab3eeb5b44979956dd223ac6b7c39/roles/6380c038334a4884b6c85da311930a3e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:30:21.942679 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefea6e6-2b0b-4fdf-8220-a86d1feabe8f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:21.988209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27306b98-8e18-4286-8d7c-edb5d7adf7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:21.989077 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27306b98-8e18-4286-8d7c-edb5d7adf7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:21.989502 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27306b98-8e18-4286-8d7c-edb5d7adf7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:21.989954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27306b98-8e18-4286-8d7c-edb5d7adf7f3 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:21.990788 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27306b98-8e18-4286-8d7c-edb5d7adf7f3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:21.991245 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27306b98-8e18-4286-8d7c-edb5d7adf7f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:21.992860 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27306b98-8e18-4286-8d7c-edb5d7adf7f3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:21.999940 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 472/960] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 16:30:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:23.457245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e01f9f-ccab-4b62-a6c3-58cf2b7d84eb None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:23.457791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e01f9f-ccab-4b62-a6c3-58cf2b7d84eb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:23.457791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e01f9f-ccab-4b62-a6c3-58cf2b7d84eb None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:23.459371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 489/961] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:23.465359 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c7c46-b424-45bb-8ed1-1e3d2e8943a5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:23.465866 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c7c46-b424-45bb-8ed1-1e3d2e8943a5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:23.465970 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c7c46-b424-45bb-8ed1-1e3d2e8943a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:23.483987 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fe4c7c46-b424-45bb-8ed1-1e3d2e8943a5 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:23.485341 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fe4c7c46-b424-45bb-8ed1-1e3d2e8943a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:23.488514 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:23.565687 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 473/962] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:23.589663 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e01f9f-ccab-4b62-a6c3-58cf2b7d84eb None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:23.614316 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:23.710145 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e01f9f-ccab-4b62-a6c3-58cf2b7d84eb None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:23.760679 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985b46f-b649-453e-a59e-8fa397533e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:23.761554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985b46f-b649-453e-a59e-8fa397533e0c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:23.761924 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985b46f-b649-453e-a59e-8fa397533e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:23.762203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985b46f-b649-453e-a59e-8fa397533e0c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:23.762927 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c985b46f-b649-453e-a59e-8fa397533e0c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:23.764739 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c985b46f-b649-453e-a59e-8fa397533e0c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:23.780382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-c985b46f-b649-453e-a59e-8fa397533e0c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:30:23.780382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:23.780382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:30:23.780382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:30:23.780382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:30:23.780382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:30:23.780382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:30:23.780382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:23.780382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:30:23.780382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:23.780382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:23.780382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:23.780382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:23.780382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:23.780382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:23.780382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:23.780382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:23.781616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:23.781616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:23.781616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:23.781616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:23.781616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:23.781616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:23.781616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:30:23.781616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:30:23.781616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:30:23.781616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:30:23.781616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:23.781616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:23.781616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:23.781616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:23.781616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:23.781616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:23.782902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:23.782902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:23.782902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:23.782902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:23.782902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:23.782902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:23.782902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:23.782902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:23.782902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:23.782902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:23.782902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:30:23.782902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:23.782902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:30:23.782902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:23.782902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 490/963] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 26 16:30:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:23.790374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c7c46-b424-45bb-8ed1-1e3d2e8943a5 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:23.914348 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c7c46-b424-45bb-8ed1-1e3d2e8943a5 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:23.955697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b2f5a-23f9-445e-88ac-b0e9c1cf3b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:23.956732 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b2f5a-23f9-445e-88ac-b0e9c1cf3b23 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:23.957221 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b2f5a-23f9-445e-88ac-b0e9c1cf3b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:23.957749 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b2f5a-23f9-445e-88ac-b0e9c1cf3b23 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:23.958674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b2f5a-23f9-445e-88ac-b0e9c1cf3b23 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:23.959579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b2f5a-23f9-445e-88ac-b0e9c1cf3b23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:23.961445 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b2f5a-23f9-445e-88ac-b0e9c1cf3b23 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:23.968356 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 474/964] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 26 16:30:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:23.974372 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985b46f-b649-453e-a59e-8fa397533e0c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:24.077138 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:24.095432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985b46f-b649-453e-a59e-8fa397533e0c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:24.119282 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59666777-4c5b-49c9-88f3-9afe0cefc713 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:24.119695 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59666777-4c5b-49c9-88f3-9afe0cefc713 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:24.120101 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59666777-4c5b-49c9-88f3-9afe0cefc713 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:24.126457 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 475/965] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:30:24.128477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02880fda-3a8a-437d-b2b0-c5e6d8af24be None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:24.128859 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02880fda-3a8a-437d-b2b0-c5e6d8af24be None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:24.129213 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02880fda-3a8a-437d-b2b0-c5e6d8af24be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:24.135590 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffccef6-c35c-433b-bae7-cf1135037d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:24.135769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:24.136625 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffccef6-c35c-433b-bae7-cf1135037d98 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:24.137079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffccef6-c35c-433b-bae7-cf1135037d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:24.137576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffccef6-c35c-433b-bae7-cf1135037d98 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:24.138461 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffccef6-c35c-433b-bae7-cf1135037d98 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:24.138957 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffccef6-c35c-433b-bae7-cf1135037d98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:24.140560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffccef6-c35c-433b-bae7-cf1135037d98 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:24.147592 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 491/966] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 26 16:30:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:24.150303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-02880fda-3a8a-437d-b2b0-c5e6d8af24be None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:24.151673 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-02880fda-3a8a-437d-b2b0-c5e6d8af24be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:24.153208 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffccef6-c35c-433b-bae7-cf1135037d98 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:24.244070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 476/967] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:24.268689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02880fda-3a8a-437d-b2b0-c5e6d8af24be None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:24.291591 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffccef6-c35c-433b-bae7-cf1135037d98 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:24.339491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7afad9-e295-41e2-a9fc-84edfd21b621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:24.340357 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7afad9-e295-41e2-a9fc-84edfd21b621 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:24.340742 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7afad9-e295-41e2-a9fc-84edfd21b621 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:24.341114 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7afad9-e295-41e2-a9fc-84edfd21b621 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:24.342071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7afad9-e295-41e2-a9fc-84edfd21b621 None admin] RBAC: Adding query filter params (interface=admin, service_id=c906876a85824026b64697bbf486e6c8, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:24.342485 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7afad9-e295-41e2-a9fc-84edfd21b621 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:24.344545 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7afad9-e295-41e2-a9fc-84edfd21b621 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:24.351513 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 492/968] 10.222.0.48 () {56 vars in 1249 bytes} [Thu May 26 16:30:24 2022] GET /identity/v3/endpoints?service_id=c906876a85824026b64697bbf486e6c8&interface=admin®ion_id=RegionOne => generated 193 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:24.357074 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7afad9-e295-41e2-a9fc-84edfd21b621 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:24.378887 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:24.416093 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02880fda-3a8a-437d-b2b0-c5e6d8af24be None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:24.461167 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17251a-1aa5-418a-9ea7-764dff058d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:24.463745 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17251a-1aa5-418a-9ea7-764dff058d36 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:24.463745 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17251a-1aa5-418a-9ea7-764dff058d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:24.463745 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17251a-1aa5-418a-9ea7-764dff058d36 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:24.463745 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17251a-1aa5-418a-9ea7-764dff058d36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:24.464775 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17251a-1aa5-418a-9ea7-764dff058d36 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:24.466139 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: WARNING keystone.server.flask.common [None req-9a17251a-1aa5-418a-9ea7-764dff058d36 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 16:30:24.474513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:24.485852 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7afad9-e295-41e2-a9fc-84edfd21b621 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:24.523051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed9143-d5c5-4fc5-95d5-91bedfdce617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:24.523637 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed9143-d5c5-4fc5-95d5-91bedfdce617 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:24.523974 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed9143-d5c5-4fc5-95d5-91bedfdce617 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:24.524282 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed9143-d5c5-4fc5-95d5-91bedfdce617 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:24.525007 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed9143-d5c5-4fc5-95d5-91bedfdce617 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:24.526442 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed9143-d5c5-4fc5-95d5-91bedfdce617 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:24.534493 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 493/969] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 26 16:30:24 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:30:24.535263 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6af3b1-e194-4f21-97c6-24974bfc6bc1 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:24.535556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6af3b1-e194-4f21-97c6-24974bfc6bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:24.535834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6af3b1-e194-4f21-97c6-24974bfc6bc1 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:24.537411 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 494/970] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:24.538667 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7d6f3-2a5a-41e8-a8cd-62ff83bdb4dd None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:24.538949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7d6f3-2a5a-41e8-a8cd-62ff83bdb4dd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:24.539220 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7d6f3-2a5a-41e8-a8cd-62ff83bdb4dd None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:24.540877 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 495/971] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:24.542993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652a9c-560f-4a80-81df-249bfcca21a9 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:24.543283 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652a9c-560f-4a80-81df-249bfcca21a9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:24.543566 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652a9c-560f-4a80-81df-249bfcca21a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:24.561871 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.sql.core [None req-9a17251a-1aa5-418a-9ea7-764dff058d36 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 16:30:24.561871 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 16:30:24.561871 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [parameters: {'user_id': 'df48115f48614b8bb3be649363aa9ea5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 16:30:24.561871 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80497) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 16:30:24.562303 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b3652a9c-560f-4a80-81df-249bfcca21a9 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:24.563800 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b3652a9c-560f-4a80-81df-249bfcca21a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:24.570252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-9a17251a-1aa5-418a-9ea7-764dff058d36 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 16:30:24.570252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:24.570252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:30:24.570252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:30:24.570252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:30:24.570252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:30:24.570252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:30:24.570252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:30:24.570252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:30:24.570252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application conn.query(q) May 26 16:30:24.570252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:30:24.570252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:30:24.570252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:30:24.570252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application result.read() May 26 16:30:24.570252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:30:24.574582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:30:24.574582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:30:24.574582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:30:24.574582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:30:24.574582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:30:24.574582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:30:24.574582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:30:24.574582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 16:30:24.574582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:24.574582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 16:30:24.574582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:24.574582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:24.574582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 16:30:24.574582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 16:30:24.574582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 26 16:30:24.574582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 26 16:30:24.574582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:30:24.574582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application next(self.gen) May 26 16:30:24.575587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 16:30:24.575587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application yield resource May 26 16:30:24.575587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:30:24.575587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application next(self.gen) May 26 16:30:24.575587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 16:30:24.575587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.session.rollback() May 26 16:30:24.575587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 16:30:24.575587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.force_reraise() May 26 16:30:24.575587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 16:30:24.575587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise self.value May 26 16:30:24.575587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 16:30:24.575587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 16:30:24.575587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 16:30:24.575587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application session.commit() May 26 16:30:24.575587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 16:30:24.575587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 16:30:24.575587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 16:30:24.576511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._prepare_impl() May 26 16:30:24.576511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 16:30:24.576511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.session.flush() May 26 16:30:24.576511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 16:30:24.576511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._flush(objects) May 26 16:30:24.576511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 16:30:24.576511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 16:30:24.576511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 16:30:24.576511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application compat.raise_( May 26 16:30:24.576511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:30:24.576511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception May 26 16:30:24.576511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 16:30:24.576511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application flush_context.execute() May 26 16:30:24.576511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 16:30:24.576511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rec.execute(self) May 26 16:30:24.576511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 16:30:24.576511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 16:30:24.578291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 16:30:24.578291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 16:30:24.578291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 26 16:30:24.578291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application result = connection._execute_20( May 26 16:30:24.578291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 16:30:24.578291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 16:30:24.578291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 16:30:24.578291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 16:30:24.578291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 16:30:24.578291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 16:30:24.578291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 16:30:24.578291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 16:30:24.578291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 16:30:24.578291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 16:30:24.578291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:30:24.578291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception May 26 16:30:24.579241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:30:24.579241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:30:24.579241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:30:24.579241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:30:24.579241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:30:24.579241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:30:24.579241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:30:24.579241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application conn.query(q) May 26 16:30:24.579241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:30:24.579241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:30:24.579241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:30:24.579241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application result.read() May 26 16:30:24.579241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:30:24.579241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:30:24.579241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:30:24.579241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:30:24.580308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:30:24.580308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:30:24.580308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:30:24.580308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:30:24.580308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 16:30:24.580308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 16:30:24.580308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [parameters: {'user_id': 'df48115f48614b8bb3be649363aa9ea5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 16:30:24.580308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 16:30:24.580308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:24.580308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:24.580308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:24.580308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:24.580308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:24.580308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:24.580308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:24.581483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:24.581483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:24.581483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:24.581483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:24.581483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:24.581483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:24.581483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:24.581483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 26 16:30:24.581483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 26 16:30:24.581483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:24.581483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:24.581483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:30:24.581483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:24.581483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:30:24.581483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:24.581483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 26 16:30:24.581483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 26 16:30:24.584045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 26 16:30:24.584045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 26 16:30:24.584045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 16:30:24.584045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 16:30:24.584045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 16:30:24.584045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:24.584045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 477/972] 10.222.0.48 () {60 vars in 1131 bytes} [Thu May 26 16:30:24 2022] POST /identity/v3/users => generated 160 bytes in 304 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:24.584045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767cdd1-8cd1-466a-b13a-42f3c643467e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:24.584045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767cdd1-8cd1-466a-b13a-42f3c643467e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:24.584045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767cdd1-8cd1-466a-b13a-42f3c643467e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:24.596902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5767cdd1-8cd1-466a-b13a-42f3c643467e None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:24.598645 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5767cdd1-8cd1-466a-b13a-42f3c643467e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:24.665358 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 496/973] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:30:24.665358 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3652a9c-560f-4a80-81df-249bfcca21a9 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:24.682302 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:24.690030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 478/974] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:24.691619 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767cdd1-8cd1-466a-b13a-42f3c643467e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:24.800911 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3652a9c-560f-4a80-81df-249bfcca21a9 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:24.828917 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767cdd1-8cd1-466a-b13a-42f3c643467e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:24.839222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a19eb-8559-4490-82ea-43c45939d1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:24.840036 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a19eb-8559-4490-82ea-43c45939d1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:24.840315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a19eb-8559-4490-82ea-43c45939d1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:24.840589 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a19eb-8559-4490-82ea-43c45939d1f7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:24.848818 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a19eb-8559-4490-82ea-43c45939d1f7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:24.850305 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a19eb-8559-4490-82ea-43c45939d1f7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:24.861867 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:24.869392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-dd2a19eb-8559-4490-82ea-43c45939d1f7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:30:24.869392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:24.869392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:24.869392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:24.869392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:24.869392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:24.869392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:24.869392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:24.869392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:24.869392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:24.869392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:24.869392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:24.869392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:30:24.869392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:30:24.869392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:30:24.869392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:30:24.876738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:24.876738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:24.876738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:30:24.876738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:24.876738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:30:24.876738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:24.876738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:24.876738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:24.876738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:24.876738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:24.876738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:24.876738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:24.876738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:24.876738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:24.876738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:24.876738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:24.876738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:24.876738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:24.877760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:24.877760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:24.877760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:30:24.877760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:30:24.877760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:30:24.877760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:30:24.877760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:30:24.877760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:30:24.877760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:30:24.877760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:24.877760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 497/975] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:30:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:24.877760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a19eb-8559-4490-82ea-43c45939d1f7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:24.881192 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a21a0c-d22a-4469-839c-fc89ee8732a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:24.882091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a21a0c-d22a-4469-839c-fc89ee8732a0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:24.882372 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a21a0c-d22a-4469-839c-fc89ee8732a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:24.882644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a21a0c-d22a-4469-839c-fc89ee8732a0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:24.894636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a21a0c-d22a-4469-839c-fc89ee8732a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:24.903090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-14a21a0c-d22a-4469-839c-fc89ee8732a0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:30:24.903090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:24.903090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:24.903090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:24.903090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:24.903090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:24.903090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:24.903090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:24.903090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:24.903090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:24.903090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:24.903090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:24.903090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:24.903090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:24.903090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:24.903090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:24.904103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:24.904103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:24.904103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:24.904103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:24.904103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:24.904103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:24.904103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:24.904103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:24.904103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:24.904103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:24.904103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:24.904103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:24.904103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:24.904103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:24.904103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:24.904103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:24.904935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:24.904935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:24.904935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:24.904935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:24.904935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:24.904935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:24.904935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:24.904935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:24.904935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:24.904935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:24.904935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:30:24.904935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:24.907040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 479/976] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 26 16:30:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:24.907040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a21a0c-d22a-4469-839c-fc89ee8732a0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:24.951681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:24.993549 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a19eb-8559-4490-82ea-43c45939d1f7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:25.028720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a21a0c-d22a-4469-839c-fc89ee8732a0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:25.032840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3c8bf-2a0a-4f6a-8baa-80dfeb94b7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:25.033597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3c8bf-2a0a-4f6a-8baa-80dfeb94b7c2 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:25.033908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3c8bf-2a0a-4f6a-8baa-80dfeb94b7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:25.034179 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3c8bf-2a0a-4f6a-8baa-80dfeb94b7c2 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:25.034965 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3c8bf-2a0a-4f6a-8baa-80dfeb94b7c2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:25.036693 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3c8bf-2a0a-4f6a-8baa-80dfeb94b7c2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:25.069483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8ef50-12d2-4408-a01b-9b5909872d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:25.070404 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8ef50-12d2-4408-a01b-9b5909872d83 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:25.071394 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8ef50-12d2-4408-a01b-9b5909872d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:25.071680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8ef50-12d2-4408-a01b-9b5909872d83 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:25.072487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8ef50-12d2-4408-a01b-9b5909872d83 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:25.072798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8ef50-12d2-4408-a01b-9b5909872d83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:25.074459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8ef50-12d2-4408-a01b-9b5909872d83 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:25.113032 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 480/977] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 16:30:24 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:25.113910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8ef50-12d2-4408-a01b-9b5909872d83 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:25.171070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:25.183741 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 498/978] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 16:30:24 2022] POST /identity/v3/services => generated 242 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:30:25.263446 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8ef50-12d2-4408-a01b-9b5909872d83 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:25.326121 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5678d5b-3067-46cb-970c-1bfb500a8967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:25.327786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5678d5b-3067-46cb-970c-1bfb500a8967 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:25.328407 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5678d5b-3067-46cb-970c-1bfb500a8967 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:25.328955 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5678d5b-3067-46cb-970c-1bfb500a8967 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:25.329997 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5678d5b-3067-46cb-970c-1bfb500a8967 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:25.330520 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5678d5b-3067-46cb-970c-1bfb500a8967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:25.332294 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5678d5b-3067-46cb-970c-1bfb500a8967 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:25.343231 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 481/979] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 26 16:30:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:25.348868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3c8bf-2a0a-4f6a-8baa-80dfeb94b7c2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:25.474345 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3c8bf-2a0a-4f6a-8baa-80dfeb94b7c2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:25.552823 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:25.563265 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee75895-71ae-4127-a768-ce9b77ba4ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:25.565493 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee75895-71ae-4127-a768-ce9b77ba4ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:25.565493 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee75895-71ae-4127-a768-ce9b77ba4ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:25.565493 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee75895-71ae-4127-a768-ce9b77ba4ed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:25.576234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee75895-71ae-4127-a768-ce9b77ba4ed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:25.577718 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee75895-71ae-4127-a768-ce9b77ba4ed0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:25.596575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-7ee75895-71ae-4127-a768-ce9b77ba4ed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:25.596575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:25.596575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:25.596575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:25.596575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:25.596575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:25.596575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:25.596575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:25.596575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:25.596575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:25.596575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:25.596575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:25.596575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:25.596575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:25.596575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:25.597680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:25.597680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:25.597680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:25.597680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:25.597680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:25.597680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:25.597680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:25.597680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:25.597680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:25.597680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:25.597680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:25.597680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:25.597680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:25.597680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:25.597680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:25.597680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:25.597680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:25.598592 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:25.598592 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:25.598592 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:25.598592 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:25.598592 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 499/980] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:25.604492 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5678d5b-3067-46cb-970c-1bfb500a8967 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:25.718024 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5678d5b-3067-46cb-970c-1bfb500a8967 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:25.720237 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:25.762501 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f244c-4304-4a22-bfd3-ef3aacd02b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:25.763565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f244c-4304-4a22-bfd3-ef3aacd02b2e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:25.764061 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f244c-4304-4a22-bfd3-ef3aacd02b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:25.764543 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f244c-4304-4a22-bfd3-ef3aacd02b2e None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:25.766104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f244c-4304-4a22-bfd3-ef3aacd02b2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:25.766513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f244c-4304-4a22-bfd3-ef3aacd02b2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:25.767972 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f244c-4304-4a22-bfd3-ef3aacd02b2e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:25.785447 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 482/981] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:25.788337 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee75895-71ae-4127-a768-ce9b77ba4ed0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:25.921981 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee75895-71ae-4127-a768-ce9b77ba4ed0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:25.963200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e767b25-36fc-4078-811f-a41b2dd0c9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:25.964103 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e767b25-36fc-4078-811f-a41b2dd0c9ed None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:25.964388 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e767b25-36fc-4078-811f-a41b2dd0c9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:25.964665 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e767b25-36fc-4078-811f-a41b2dd0c9ed None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:25.975078 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e767b25-36fc-4078-811f-a41b2dd0c9ed None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:25.976564 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e767b25-36fc-4078-811f-a41b2dd0c9ed None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:25.993188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-8e767b25-36fc-4078-811f-a41b2dd0c9ed None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:30:25.993188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:25.993188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:25.993188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:25.993188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:25.993188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:25.993188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:25.993188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:25.993188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:25.993188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:25.993188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:25.993188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:25.993188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:30:25.993188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:30:25.993188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:30:25.993188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:30:25.994285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:25.994285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:25.994285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:30:25.994285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:25.994285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:30:25.994285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:25.994285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:25.994285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:25.994285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:25.994285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:25.994285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:25.994285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:25.994285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:25.994285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:25.994285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:25.994285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:25.994285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:25.994285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:25.995344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:25.995344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:25.995344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:30:25.995344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:30:25.995344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:30:25.995344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:30:25.995344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:30:25.995344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:30:25.995344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:30:25.995344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:25.997611 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 500/982] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 26 16:30:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:26.001402 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f244c-4304-4a22-bfd3-ef3aacd02b2e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:26.125911 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f244c-4304-4a22-bfd3-ef3aacd02b2e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:26.163292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479d8f7-91a5-4708-b49b-374be93b645c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:26.163987 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479d8f7-91a5-4708-b49b-374be93b645c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:26.164272 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479d8f7-91a5-4708-b49b-374be93b645c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:26.164547 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479d8f7-91a5-4708-b49b-374be93b645c None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:26.165431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479d8f7-91a5-4708-b49b-374be93b645c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:26.165782 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479d8f7-91a5-4708-b49b-374be93b645c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:26.167300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479d8f7-91a5-4708-b49b-374be93b645c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:26.193200 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 483/983] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 26 16:30:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:26.194773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e767b25-36fc-4078-811f-a41b2dd0c9ed None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:26.245812 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:26.317484 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e767b25-36fc-4078-811f-a41b2dd0c9ed None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:26.360279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2904e42-3d0b-4b75-8702-896daef096df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:26.361231 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2904e42-3d0b-4b75-8702-896daef096df None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:26.361697 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2904e42-3d0b-4b75-8702-896daef096df None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:26.362140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2904e42-3d0b-4b75-8702-896daef096df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:26.443828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2904e42-3d0b-4b75-8702-896daef096df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:26.445243 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2904e42-3d0b-4b75-8702-896daef096df None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:26.495030 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:26.567109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 501/984] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:30:26 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:26.572652 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479d8f7-91a5-4708-b49b-374be93b645c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:26.596951 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:26.694469 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479d8f7-91a5-4708-b49b-374be93b645c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:26.733707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24079b37-9fd4-4e94-a9e3-69f1603b542b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:26.734594 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24079b37-9fd4-4e94-a9e3-69f1603b542b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:26.734871 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24079b37-9fd4-4e94-a9e3-69f1603b542b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:26.735138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24079b37-9fd4-4e94-a9e3-69f1603b542b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:26.746047 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24079b37-9fd4-4e94-a9e3-69f1603b542b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:26.747522 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24079b37-9fd4-4e94-a9e3-69f1603b542b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:26.766724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-24079b37-9fd4-4e94-a9e3-69f1603b542b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:26.766724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:26.766724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:26.766724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:26.766724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:26.766724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:26.766724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:26.766724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:26.766724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:26.766724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:26.766724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:26.766724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:26.766724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:26.766724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:26.766724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:26.767680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:26.767680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:26.767680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:26.767680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:26.767680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:26.767680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:26.767680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:26.767680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:26.767680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:26.767680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:26.767680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:26.767680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:26.767680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:26.767680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:26.767680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:26.767680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:26.767680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:26.773405 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:26.773405 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:26.773405 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:26.773405 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:26.773405 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 484/985] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:26.775520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2904e42-3d0b-4b75-8702-896daef096df None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:26.864973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93c124-96cf-48a5-a188-a71e1d8ecc4e None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:26.865285 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93c124-96cf-48a5-a188-a71e1d8ecc4e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:26.866581 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93c124-96cf-48a5-a188-a71e1d8ecc4e None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:26.867232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 485/986] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:30:26.872330 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7e565-bead-4cef-a7f1-8fa3c0f84089 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:26.872619 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7e565-bead-4cef-a7f1-8fa3c0f84089 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:26.872969 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7e565-bead-4cef-a7f1-8fa3c0f84089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:26.889839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-30c7e565-bead-4cef-a7f1-8fa3c0f84089 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:26.890523 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2904e42-3d0b-4b75-8702-896daef096df None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:26.891523 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-30c7e565-bead-4cef-a7f1-8fa3c0f84089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:26.932641 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed8c67-6410-4644-a064-1021d7744e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:26.933448 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed8c67-6410-4644-a064-1021d7744e0c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:26.933728 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed8c67-6410-4644-a064-1021d7744e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:26.934001 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed8c67-6410-4644-a064-1021d7744e0c None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:26.934720 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed8c67-6410-4644-a064-1021d7744e0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:26.935059 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed8c67-6410-4644-a064-1021d7744e0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:26.936500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed8c67-6410-4644-a064-1021d7744e0c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:26.946826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:26.956510 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 502/987] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:26.957948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed8c67-6410-4644-a064-1021d7744e0c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:26.981109 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 486/988] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:30:27.004110 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7e565-bead-4cef-a7f1-8fa3c0f84089 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:27.006307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:27.079979 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed8c67-6410-4644-a064-1021d7744e0c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:27.117395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03bc64-6e37-4324-80df-7b1161ebbb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:27.118199 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03bc64-6e37-4324-80df-7b1161ebbb1c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:27.118487 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03bc64-6e37-4324-80df-7b1161ebbb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:27.118757 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03bc64-6e37-4324-80df-7b1161ebbb1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:27.121509 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7e565-bead-4cef-a7f1-8fa3c0f84089 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:27.126824 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03bc64-6e37-4324-80df-7b1161ebbb1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:27.128262 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03bc64-6e37-4324-80df-7b1161ebbb1c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:27.145459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-da03bc64-6e37-4324-80df-7b1161ebbb1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:27.145459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:27.145459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:27.145459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:27.145459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:27.145459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:27.145459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:27.145459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:27.145459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:27.145459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:27.145459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:27.145459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:27.145459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:30:27.145459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:30:27.145459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:30:27.146449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:30:27.146449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:27.146449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:27.146449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:27.146449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:27.146449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:27.146449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:27.146449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:27.146449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:27.146449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:27.146449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:27.146449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:27.146449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:27.146449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:27.146449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:27.146449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:27.146449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:27.147375 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:30:27.147375 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:30:27.147375 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:30:27.147375 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:30:27.147375 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:30:27.147375 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:30:27.147375 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:27.147375 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:27.147375 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 503/989] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:30:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:27.152318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03bc64-6e37-4324-80df-7b1161ebbb1c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:27.167950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5da02-0470-403c-b5ae-4d580f6a806f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:27.168757 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5da02-0470-403c-b5ae-4d580f6a806f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:27.169040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5da02-0470-403c-b5ae-4d580f6a806f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:27.169342 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5da02-0470-403c-b5ae-4d580f6a806f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:27.169998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5da02-0470-403c-b5ae-4d580f6a806f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:27.171393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5da02-0470-403c-b5ae-4d580f6a806f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:27.184751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-83a5da02-0470-403c-b5ae-4d580f6a806f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:30:27.184751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:27.184751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:30:27.184751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:30:27.184751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:30:27.184751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:30:27.184751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:30:27.184751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:27.184751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:30:27.184751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:27.184751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:27.184751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:27.184751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:27.184751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:27.184751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:27.184751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:27.184751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:27.185884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:27.185884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:27.185884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:27.185884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:27.185884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:27.185884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:27.185884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:30:27.185884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:30:27.185884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:30:27.185884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:30:27.185884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:27.185884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:27.185884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:27.185884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:27.185884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:27.185884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:27.186735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:27.186735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:27.186735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:27.186735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:27.186735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:27.186735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:27.186735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:27.186735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:27.186735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:27.186735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:27.186735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:30:27.186735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:27.186735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:30:27.186735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:27.186735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 487/990] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 26 16:30:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:27.192997 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5da02-0470-403c-b5ae-4d580f6a806f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:27.225440 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:27.276229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03bc64-6e37-4324-80df-7b1161ebbb1c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:27.301289 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:27.330953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ad0ca-360e-4841-bace-9ca5ca9895b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:27.332011 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ad0ca-360e-4841-bace-9ca5ca9895b6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:27.332490 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ad0ca-360e-4841-bace-9ca5ca9895b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:27.332971 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ad0ca-360e-4841-bace-9ca5ca9895b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:27.334520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ad0ca-360e-4841-bace-9ca5ca9895b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:27.335082 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ad0ca-360e-4841-bace-9ca5ca9895b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:27.337832 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ad0ca-360e-4841-bace-9ca5ca9895b6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:27.346059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5da02-0470-403c-b5ae-4d580f6a806f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:27.367599 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 504/991] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:30:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:27.369035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ad0ca-360e-4841-bace-9ca5ca9895b6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:27.389098 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11688a6-26fc-4bf3-b131-c40424993909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:27.389832 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11688a6-26fc-4bf3-b131-c40424993909 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:27.390310 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11688a6-26fc-4bf3-b131-c40424993909 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:27.390598 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11688a6-26fc-4bf3-b131-c40424993909 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:27.391305 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11688a6-26fc-4bf3-b131-c40424993909 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:27.391614 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11688a6-26fc-4bf3-b131-c40424993909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:27.393048 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11688a6-26fc-4bf3-b131-c40424993909 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:27.400337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 488/992] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 26 16:30:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:27.407590 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11688a6-26fc-4bf3-b131-c40424993909 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:27.527021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ad0ca-360e-4841-bace-9ca5ca9895b6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:27.548529 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:27.566380 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fb8ec-e453-4e6f-a0bd-a05c1c13d8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:27.567047 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fb8ec-e453-4e6f-a0bd-a05c1c13d8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:27.567330 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fb8ec-e453-4e6f-a0bd-a05c1c13d8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:27.567893 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fb8ec-e453-4e6f-a0bd-a05c1c13d8c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:27.568551 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11688a6-26fc-4bf3-b131-c40424993909 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:27.568665 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fb8ec-e453-4e6f-a0bd-a05c1c13d8c2 None admin] RBAC: Adding query filter params (role.id=6380c038334a4884b6c85da311930a3e, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=4d2ab3eeb5b44979956dd223ac6b7c39) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:27.568751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fb8ec-e453-4e6f-a0bd-a05c1c13d8c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:27.570202 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fb8ec-e453-4e6f-a0bd-a05c1c13d8c2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:27.589530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 505/993] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:30:27 2022] GET /identity/v3/role_assignments?user.id=4d2ab3eeb5b44979956dd223ac6b7c39&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=6380c038334a4884b6c85da311930a3e => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:27.605059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:27.612217 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797b58d-a64b-4259-907a-4a1032b67b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:27.612992 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797b58d-a64b-4259-907a-4a1032b67b97 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:27.618114 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797b58d-a64b-4259-907a-4a1032b67b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:27.618114 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797b58d-a64b-4259-907a-4a1032b67b97 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:27.618114 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797b58d-a64b-4259-907a-4a1032b67b97 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:27.618114 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797b58d-a64b-4259-907a-4a1032b67b97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:27.618114 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797b58d-a64b-4259-907a-4a1032b67b97 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:27.622106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 489/994] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 26 16:30:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:27.628355 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fb8ec-e453-4e6f-a0bd-a05c1c13d8c2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:27.657206 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7b8f2-d646-493d-beb0-4c3ff8401fb9 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:27.657575 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7b8f2-d646-493d-beb0-4c3ff8401fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:27.657842 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7b8f2-d646-493d-beb0-4c3ff8401fb9 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:27.659418 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 490/995] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:30:27.665144 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f402ad-6e0d-493e-88c0-91add9f3c2a2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:27.665482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f402ad-6e0d-493e-88c0-91add9f3c2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:27.665765 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f402ad-6e0d-493e-88c0-91add9f3c2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:27.683785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a0f402ad-6e0d-493e-88c0-91add9f3c2a2 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:27.685032 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a0f402ad-6e0d-493e-88c0-91add9f3c2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:27.759854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fb8ec-e453-4e6f-a0bd-a05c1c13d8c2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:27.768896 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 491/996] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:30:27.791927 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f402ad-6e0d-493e-88c0-91add9f3c2a2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:27.806307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16ce8e-dab7-4c71-9397-c9ee25c6c255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:27.806976 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16ce8e-dab7-4c71-9397-c9ee25c6c255 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:27.807253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16ce8e-dab7-4c71-9397-c9ee25c6c255 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:27.807525 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16ce8e-dab7-4c71-9397-c9ee25c6c255 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:27.808276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16ce8e-dab7-4c71-9397-c9ee25c6c255 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:27.809833 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16ce8e-dab7-4c71-9397-c9ee25c6c255 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:27.901292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f402ad-6e0d-493e-88c0-91add9f3c2a2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:27.908676 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 506/997] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 26 16:30:27 2022] POST /identity/v3/endpoints => generated 325 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:30:27.930783 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:27.950560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc1ec5-abb9-426d-be83-fd727fc513bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:27.951379 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc1ec5-abb9-426d-be83-fd727fc513bc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:27.951660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc1ec5-abb9-426d-be83-fd727fc513bc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:27.951933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc1ec5-abb9-426d-be83-fd727fc513bc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:27.952587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc1ec5-abb9-426d-be83-fd727fc513bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:27.954039 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc1ec5-abb9-426d-be83-fd727fc513bc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:27.966689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-2ebc1ec5-abb9-426d-be83-fd727fc513bc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:30:27.966689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:27.966689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:30:27.966689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:30:27.966689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:30:27.966689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:30:27.966689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:30:27.966689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:27.966689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:30:27.966689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:27.966689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:27.966689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:27.966689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:27.966689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:27.966689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:27.966689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:27.966689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:27.967863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:27.967863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:27.967863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:27.967863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:27.967863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:27.967863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:27.967863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:30:27.967863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:30:27.967863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:30:27.967863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:30:27.967863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:27.967863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:27.967863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:27.967863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:27.967863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:27.967863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:27.969855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:27.969855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:27.969855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:27.969855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:27.969855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:27.969855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:27.969855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:27.969855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:27.969855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:27.969855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:27.969855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:30:27.969855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:27.969855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:30:27.969855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:27.973727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 492/998] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:30:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:27.975286 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16ce8e-dab7-4c71-9397-c9ee25c6c255 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:28.035944 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:28.111764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16ce8e-dab7-4c71-9397-c9ee25c6c255 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:28.161730 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808997d-d5e9-4748-8c37-f9701bbafcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:28.162409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808997d-d5e9-4748-8c37-f9701bbafcde None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:28.162691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808997d-d5e9-4748-8c37-f9701bbafcde None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:28.162972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808997d-d5e9-4748-8c37-f9701bbafcde None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:28.164126 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808997d-d5e9-4748-8c37-f9701bbafcde None admin] RBAC: Adding query filter params (name=compute) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:28.164126 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808997d-d5e9-4748-8c37-f9701bbafcde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:28.165666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808997d-d5e9-4748-8c37-f9701bbafcde None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:28.172243 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 507/999] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 16:30:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:28.181052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc1ec5-abb9-426d-be83-fd727fc513bc None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:28.314579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc1ec5-abb9-426d-be83-fd727fc513bc None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:28.355885 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fc121-ed5f-4b0c-90d1-b48a0ef5d0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:28.356852 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fc121-ed5f-4b0c-90d1-b48a0ef5d0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:28.357322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fc121-ed5f-4b0c-90d1-b48a0ef5d0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:28.357820 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fc121-ed5f-4b0c-90d1-b48a0ef5d0d2 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:28.358717 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fc121-ed5f-4b0c-90d1-b48a0ef5d0d2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:28.359230 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fc121-ed5f-4b0c-90d1-b48a0ef5d0d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:28.360989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fc121-ed5f-4b0c-90d1-b48a0ef5d0d2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:28.367439 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 493/1000] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 16:30:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:28.372977 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808997d-d5e9-4748-8c37-f9701bbafcde None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:28.494570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808997d-d5e9-4748-8c37-f9701bbafcde None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:28.503347 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:28.536002 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13605d2a-5691-4da6-95e3-fd940a4a95f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:28.537119 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13605d2a-5691-4da6-95e3-fd940a4a95f0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:28.537688 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13605d2a-5691-4da6-95e3-fd940a4a95f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:28.538803 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13605d2a-5691-4da6-95e3-fd940a4a95f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:28.540239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13605d2a-5691-4da6-95e3-fd940a4a95f0 None admin] RBAC: Adding query filter params (interface=public, service_id=6a40bf45333b4444b9e6c0c124de2722, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:28.540809 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13605d2a-5691-4da6-95e3-fd940a4a95f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:28.542842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13605d2a-5691-4da6-95e3-fd940a4a95f0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:28.550705 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 508/1001] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 26 16:30:28 2022] GET /identity/v3/endpoints?service_id=6a40bf45333b4444b9e6c0c124de2722&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:28.560510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fc121-ed5f-4b0c-90d1-b48a0ef5d0d2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:28.623609 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:28.680738 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fc121-ed5f-4b0c-90d1-b48a0ef5d0d2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:28.723139 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3ef8e-e1c9-41b4-aacf-efdc0e54d70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:28.724188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3ef8e-e1c9-41b4-aacf-efdc0e54d70f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:28.724669 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3ef8e-e1c9-41b4-aacf-efdc0e54d70f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:28.725139 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3ef8e-e1c9-41b4-aacf-efdc0e54d70f None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:28.726148 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3ef8e-e1c9-41b4-aacf-efdc0e54d70f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:28.727918 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3ef8e-e1c9-41b4-aacf-efdc0e54d70f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:28.735613 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 494/1002] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 26 16:30:28 2022] GET /identity/v3/services => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:30:29.975705 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c758ef-d627-4787-9c47-ce5caaf3ec31 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:29.976272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c758ef-d627-4787-9c47-ce5caaf3ec31 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:29.976272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c758ef-d627-4787-9c47-ce5caaf3ec31 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:29.979141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 509/1003] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:29.983511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ce76c-3ee5-4f83-99d5-6be9a052eacb None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:29.983959 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ce76c-3ee5-4f83-99d5-6be9a052eacb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:29.984099 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ce76c-3ee5-4f83-99d5-6be9a052eacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:30.003138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-748ce76c-3ee5-4f83-99d5-6be9a052eacb None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:30.004359 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-748ce76c-3ee5-4f83-99d5-6be9a052eacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:30.091545 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 495/1004] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:29 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:30.118391 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c758ef-d627-4787-9c47-ce5caaf3ec31 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:30.250061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c758ef-d627-4787-9c47-ce5caaf3ec31 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:30.291005 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a082f-e1c1-4bb9-a8f4-ac9641e470b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:30.292082 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a082f-e1c1-4bb9-a8f4-ac9641e470b8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:30.292519 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a082f-e1c1-4bb9-a8f4-ac9641e470b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:30.292940 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a082f-e1c1-4bb9-a8f4-ac9641e470b8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:30.293797 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a082f-e1c1-4bb9-a8f4-ac9641e470b8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:30.295327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a082f-e1c1-4bb9-a8f4-ac9641e470b8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:30.305520 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777521ba-cb14-4c51-9978-4c6c4e15fda4 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:30.305842 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777521ba-cb14-4c51-9978-4c6c4e15fda4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:30.306115 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777521ba-cb14-4c51-9978-4c6c4e15fda4 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:30.311591 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 496/1005] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:30.312296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-987a082f-e1c1-4bb9-a8f4-ac9641e470b8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:30:30.312296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:30.312296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:30:30.312296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:30:30.312296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:30:30.312296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:30:30.312296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:30:30.312296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:30.312296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:30:30.312296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:30.312296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:30.312296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:30.312296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:30.312296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:30.312296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:30.312296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:30.312296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:30.313315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:30.313315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:30.313315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:30.313315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:30.313315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:30.313315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:30.313315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:30:30.313315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:30:30.313315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:30:30.313315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:30:30.313315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:30.313315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:30.313315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:30.313315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:30.313315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:30.313315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:30.314182 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:30.314182 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:30.314182 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:30.314182 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:30.314182 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:30.314182 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:30.314182 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:30.314182 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:30.314182 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:30.314182 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:30.314182 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:30:30.314182 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:30.314182 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:30:30.314182 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:30.314182 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 510/1006] 10.222.0.48 () {56 vars in 1105 bytes} [Thu May 26 16:30:30 2022] GET /identity/v3/services/image => generated 86 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:30.314998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71824902-2cd4-435c-8beb-a6dcd30827af None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:30.315082 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71824902-2cd4-435c-8beb-a6dcd30827af None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:30.315704 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71824902-2cd4-435c-8beb-a6dcd30827af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:30.317163 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a082f-e1c1-4bb9-a8f4-ac9641e470b8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:30.337023 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-71824902-2cd4-435c-8beb-a6dcd30827af None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:30.339064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-71824902-2cd4-435c-8beb-a6dcd30827af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:30.360027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:30.389520 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:30.441878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 497/1007] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:30 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:30.444614 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a082f-e1c1-4bb9-a8f4-ac9641e470b8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:30.456455 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71824902-2cd4-435c-8beb-a6dcd30827af None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:30.488582 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bc85f-b494-4236-9eca-01481edda3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:30.489476 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bc85f-b494-4236-9eca-01481edda3fd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:30.489759 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bc85f-b494-4236-9eca-01481edda3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:30.490031 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bc85f-b494-4236-9eca-01481edda3fd None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:30.490731 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bc85f-b494-4236-9eca-01481edda3fd None admin] RBAC: Adding query filter params (name=image) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:30.491028 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bc85f-b494-4236-9eca-01481edda3fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:30.492479 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bc85f-b494-4236-9eca-01481edda3fd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:30.501364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 511/1008] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:30.504647 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bc85f-b494-4236-9eca-01481edda3fd None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:30.591338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71824902-2cd4-435c-8beb-a6dcd30827af None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:30.640010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:30.646810 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bc85f-b494-4236-9eca-01481edda3fd None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:30.651921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9d8fb-c3a8-46c9-bfb5-629d336c6ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:30.653130 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9d8fb-c3a8-46c9-bfb5-629d336c6ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:30.653670 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9d8fb-c3a8-46c9-bfb5-629d336c6ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:30.654273 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9d8fb-c3a8-46c9-bfb5-629d336c6ea6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:30.656280 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9d8fb-c3a8-46c9-bfb5-629d336c6ea6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:30.658244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9d8fb-c3a8-46c9-bfb5-629d336c6ea6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:30.660491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 498/1009] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:30.666024 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9d8fb-c3a8-46c9-bfb5-629d336c6ea6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:30.703121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b719a8-ff2a-459d-b686-825572dd5d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:30.704251 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b719a8-ff2a-459d-b686-825572dd5d98 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:30.704778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b719a8-ff2a-459d-b686-825572dd5d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:30.705237 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b719a8-ff2a-459d-b686-825572dd5d98 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:30.706259 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b719a8-ff2a-459d-b686-825572dd5d98 None admin] RBAC: Adding query filter params (type=image) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:30.706749 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b719a8-ff2a-459d-b686-825572dd5d98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:30.708459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b719a8-ff2a-459d-b686-825572dd5d98 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:30.714577 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 512/1010] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:30 2022] GET /identity/v3/services?type=image => generated 122 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:30.720228 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:30.793822 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9d8fb-c3a8-46c9-bfb5-629d336c6ea6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:30.836647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f5a3e-6a38-496b-baa2-28bc7454b427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:30.837864 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f5a3e-6a38-496b-baa2-28bc7454b427 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:30.838380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f5a3e-6a38-496b-baa2-28bc7454b427 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:30.838885 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f5a3e-6a38-496b-baa2-28bc7454b427 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:30.839896 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f5a3e-6a38-496b-baa2-28bc7454b427 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:30.841874 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f5a3e-6a38-496b-baa2-28bc7454b427 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:30.971351 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 499/1011] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 16:30:30 2022] POST /identity/v3/projects => generated 311 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:30:31.120936 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31bd6c-94c3-43fa-9fea-21b3bccdfb04 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:31.121537 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31bd6c-94c3-43fa-9fea-21b3bccdfb04 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:31.121537 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31bd6c-94c3-43fa-9fea-21b3bccdfb04 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:31.123258 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 513/1012] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:31.130174 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3744fa-4375-4cce-a16a-664ba666c7e7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:31.130681 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3744fa-4375-4cce-a16a-664ba666c7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:31.130767 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3744fa-4375-4cce-a16a-664ba666c7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:31.153094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8e3744fa-4375-4cce-a16a-664ba666c7e7 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:31.154844 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8e3744fa-4375-4cce-a16a-664ba666c7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:31.246835 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 500/1013] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:31 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:31.272084 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31bd6c-94c3-43fa-9fea-21b3bccdfb04 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:31.398065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31bd6c-94c3-43fa-9fea-21b3bccdfb04 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:31.440939 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19227eaf-5900-4b4b-84ff-b3a6118106d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:31.441808 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19227eaf-5900-4b4b-84ff-b3a6118106d1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:31.442094 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19227eaf-5900-4b4b-84ff-b3a6118106d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:31.442368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19227eaf-5900-4b4b-84ff-b3a6118106d1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:31.443083 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19227eaf-5900-4b4b-84ff-b3a6118106d1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:31.444572 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19227eaf-5900-4b4b-84ff-b3a6118106d1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:31.458046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-19227eaf-5900-4b4b-84ff-b3a6118106d1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:30:31.458046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:31.458046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:30:31.458046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:30:31.458046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:30:31.458046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:30:31.458046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:30:31.458046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:31.458046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:30:31.458046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:31.458046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:31.458046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:31.458046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:31.458046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:31.458046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:31.458046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:31.458046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:31.459140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:31.459140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:31.459140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:31.459140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:31.459140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:31.459140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:31.459140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:30:31.459140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:30:31.459140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:30:31.459140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:30:31.459140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:31.459140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:31.459140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:31.459140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:31.459140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:31.459140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:31.460052 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:31.460052 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:31.460052 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:31.460052 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:31.460052 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:31.460052 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:31.460052 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:31.460052 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:31.460052 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:31.460052 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:31.460052 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:30:31.460052 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:31.460052 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:30:31.460052 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:31.465533 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3744fa-4375-4cce-a16a-664ba666c7e7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:31.471840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 514/1014] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:30:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:31.494202 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:31.584846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3744fa-4375-4cce-a16a-664ba666c7e7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:31.627317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109561cb-c2dd-444a-94d8-e946c87a8463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:31.628382 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109561cb-c2dd-444a-94d8-e946c87a8463 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:31.628954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109561cb-c2dd-444a-94d8-e946c87a8463 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:31.629486 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109561cb-c2dd-444a-94d8-e946c87a8463 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:31.630419 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109561cb-c2dd-444a-94d8-e946c87a8463 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:31.630937 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109561cb-c2dd-444a-94d8-e946c87a8463 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:31.632590 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109561cb-c2dd-444a-94d8-e946c87a8463 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:31.638894 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 501/1015] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 16:30:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:31.647680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19227eaf-5900-4b4b-84ff-b3a6118106d1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:31.682493 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:31.769742 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19227eaf-5900-4b4b-84ff-b3a6118106d1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:31.810582 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e356fe-72a1-4e33-b3ac-a25176e1fb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:31.811256 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e356fe-72a1-4e33-b3ac-a25176e1fb92 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:31.811540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e356fe-72a1-4e33-b3ac-a25176e1fb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:31.811843 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e356fe-72a1-4e33-b3ac-a25176e1fb92 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:31.812648 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e356fe-72a1-4e33-b3ac-a25176e1fb92 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:31.812917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e356fe-72a1-4e33-b3ac-a25176e1fb92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:31.814277 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e356fe-72a1-4e33-b3ac-a25176e1fb92 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:31.825330 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 515/1016] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 16:30:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:31.825989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109561cb-c2dd-444a-94d8-e946c87a8463 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:31.927343 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:31.945631 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109561cb-c2dd-444a-94d8-e946c87a8463 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:31.981589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0adb49-a4d6-4938-a530-f175b6046e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:31.982579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0adb49-a4d6-4938-a530-f175b6046e3f None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:31.982994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0adb49-a4d6-4938-a530-f175b6046e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:31.983408 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0adb49-a4d6-4938-a530-f175b6046e3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:31.984864 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0adb49-a4d6-4938-a530-f175b6046e3f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:31.986508 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0adb49-a4d6-4938-a530-f175b6046e3f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:32.129394 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 502/1017] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 26 16:30:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:30:33.116799 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b115c3a-8ba6-408c-8963-99336d199211 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:33.117362 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b115c3a-8ba6-408c-8963-99336d199211 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:33.117636 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b115c3a-8ba6-408c-8963-99336d199211 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:33.119416 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 516/1018] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:33.127300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087534a-d4ad-4675-bcf2-da03b572c3b2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:33.127788 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087534a-d4ad-4675-bcf2-da03b572c3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:33.128233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087534a-d4ad-4675-bcf2-da03b572c3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:33.149481 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8087534a-d4ad-4675-bcf2-da03b572c3b2 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:33.150825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8087534a-d4ad-4675-bcf2-da03b572c3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:33.269616 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 503/1019] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:33 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:33.292664 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b115c3a-8ba6-408c-8963-99336d199211 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:33.400263 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e927a7-4677-496a-b130-1d9864e8e083 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:33.400522 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e927a7-4677-496a-b130-1d9864e8e083 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:33.400942 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e927a7-4677-496a-b130-1d9864e8e083 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:33.402516 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 504/1020] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:30:33.409078 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab7a63-b781-4fbd-87bf-f551d849b8ee None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:33.409662 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab7a63-b781-4fbd-87bf-f551d849b8ee None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:33.409956 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab7a63-b781-4fbd-87bf-f551d849b8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:33.428692 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-06ab7a63-b781-4fbd-87bf-f551d849b8ee None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:33.429939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-06ab7a63-b781-4fbd-87bf-f551d849b8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:33.441698 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:33.464996 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b115c3a-8ba6-408c-8963-99336d199211 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:33.520998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:33.529722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df2d2f-5373-4717-a788-108cdd29d3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:33.537433 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 505/1021] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:33 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:33.537580 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df2d2f-5373-4717-a788-108cdd29d3ae None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:33.537580 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df2d2f-5373-4717-a788-108cdd29d3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:33.537580 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df2d2f-5373-4717-a788-108cdd29d3ae None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:33.537956 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df2d2f-5373-4717-a788-108cdd29d3ae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:33.539627 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df2d2f-5373-4717-a788-108cdd29d3ae None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:33.556559 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab7a63-b781-4fbd-87bf-f551d849b8ee None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:33.704000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 517/1022] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 16:30:33 2022] POST /identity/v3/services => generated 242 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:30:33.704641 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab7a63-b781-4fbd-87bf-f551d849b8ee None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:33.778344 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebaa82-1e4b-4057-ae7b-8db2a96127a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:33.779831 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebaa82-1e4b-4057-ae7b-8db2a96127a3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:33.780371 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebaa82-1e4b-4057-ae7b-8db2a96127a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:33.780806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebaa82-1e4b-4057-ae7b-8db2a96127a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:33.782624 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebaa82-1e4b-4057-ae7b-8db2a96127a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:33.784547 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebaa82-1e4b-4057-ae7b-8db2a96127a3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:33.787408 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 506/1023] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:33.795157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df2d2f-5373-4717-a788-108cdd29d3ae None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:33.940503 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df2d2f-5373-4717-a788-108cdd29d3ae None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:33.990600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475a078-a188-45a4-9f85-33d8569cdfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:33.991611 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475a078-a188-45a4-9f85-33d8569cdfda None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:33.991891 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475a078-a188-45a4-9f85-33d8569cdfda None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:33.992213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475a078-a188-45a4-9f85-33d8569cdfda None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:33.992908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475a078-a188-45a4-9f85-33d8569cdfda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:33.994484 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475a078-a188-45a4-9f85-33d8569cdfda None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:34.147278 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 518/1024] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 16:30:33 2022] POST /identity/v3/users => generated 285 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:30:34.676037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65a2dd-e8f2-4af4-962e-20f52dd4da45 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:34.676569 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65a2dd-e8f2-4af4-962e-20f52dd4da45 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:34.676569 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65a2dd-e8f2-4af4-962e-20f52dd4da45 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:34.678339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 507/1025] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:34.685602 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f782f-a95d-427f-9152-7285fbdb7e0f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:34.685959 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f782f-a95d-427f-9152-7285fbdb7e0f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:34.686281 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f782f-a95d-427f-9152-7285fbdb7e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:34.700600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:34.707277 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3b2f782f-a95d-427f-9152-7285fbdb7e0f None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:34.708642 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3b2f782f-a95d-427f-9152-7285fbdb7e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:34.796869 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 519/1026] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:34.820876 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65a2dd-e8f2-4af4-962e-20f52dd4da45 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:34.894923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:34.943529 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65a2dd-e8f2-4af4-962e-20f52dd4da45 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:34.990349 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6ac21-1321-4f6d-bfa9-762bb3d053fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:34.991199 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6ac21-1321-4f6d-bfa9-762bb3d053fb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:34.991479 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6ac21-1321-4f6d-bfa9-762bb3d053fb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:34.991757 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6ac21-1321-4f6d-bfa9-762bb3d053fb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:35.008423 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6ac21-1321-4f6d-bfa9-762bb3d053fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:35.017239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-13a6ac21-1321-4f6d-bfa9-762bb3d053fb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:30:35.017239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:35.017239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:35.017239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:35.017239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:35.017239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:35.017239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:35.017239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:35.017239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:35.017239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:35.017239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:35.017239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:35.017239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:35.017239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:35.017239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:35.017239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:35.018323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:35.018323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:35.018323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:35.018323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:35.018323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:35.018323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:35.018323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:35.018323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:35.018323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:35.018323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:35.018323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:35.018323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:35.018323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:35.018323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:35.018323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:35.018323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:35.019395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:35.019395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:35.019395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:35.019395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:35.019395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:35.019395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:35.019395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:35.019395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:35.019395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:35.019395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:35.019395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:30:35.019395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:35.027338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 508/1027] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 26 16:30:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:35.027553 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f782f-a95d-427f-9152-7285fbdb7e0f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:35.180669 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f782f-a95d-427f-9152-7285fbdb7e0f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:35.252536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cc667-7f73-4c62-ae4a-2e212aa7d73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:35.253718 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cc667-7f73-4c62-ae4a-2e212aa7d73d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:35.254222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cc667-7f73-4c62-ae4a-2e212aa7d73d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:35.254688 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cc667-7f73-4c62-ae4a-2e212aa7d73d None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:35.256385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18cc667-7f73-4c62-ae4a-2e212aa7d73d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:35.256966 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18cc667-7f73-4c62-ae4a-2e212aa7d73d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:35.259724 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18cc667-7f73-4c62-ae4a-2e212aa7d73d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:35.264946 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:35.279596 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 520/1028] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 26 16:30:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:35.293300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6ac21-1321-4f6d-bfa9-762bb3d053fb None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:35.418545 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6ac21-1321-4f6d-bfa9-762bb3d053fb None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:35.450562 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:35.463511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e55b2-4a3d-470d-88d1-4847de5d3fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:35.464320 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e55b2-4a3d-470d-88d1-4847de5d3fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:35.464599 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e55b2-4a3d-470d-88d1-4847de5d3fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:35.464871 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e55b2-4a3d-470d-88d1-4847de5d3fc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:35.480043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e55b2-4a3d-470d-88d1-4847de5d3fc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:35.481739 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e55b2-4a3d-470d-88d1-4847de5d3fc6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:35.501703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-4b7e55b2-4a3d-470d-88d1-4847de5d3fc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:35.501703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:35.501703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:35.501703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:35.501703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:35.501703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:35.501703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:35.501703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:35.501703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:35.501703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:35.501703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:35.501703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:35.501703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:35.501703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:35.501703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:35.502799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:35.502799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:35.502799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:35.502799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:35.502799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:35.502799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:35.502799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:35.502799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:35.502799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:35.502799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:35.502799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:35.502799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:35.502799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:35.502799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:35.502799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:35.502799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:35.502799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:35.504104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:35.504104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:35.504104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:35.504104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:35.508178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 509/1029] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:35.509658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cc667-7f73-4c62-ae4a-2e212aa7d73d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:35.630312 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cc667-7f73-4c62-ae4a-2e212aa7d73d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:35.667754 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1060736-cba6-4eba-bdab-6a67e3cb1cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:35.668440 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1060736-cba6-4eba-bdab-6a67e3cb1cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:35.668724 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1060736-cba6-4eba-bdab-6a67e3cb1cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:35.669003 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1060736-cba6-4eba-bdab-6a67e3cb1cb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:35.669766 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1060736-cba6-4eba-bdab-6a67e3cb1cb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:35.670075 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1060736-cba6-4eba-bdab-6a67e3cb1cb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:35.671639 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1060736-cba6-4eba-bdab-6a67e3cb1cb4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:35.692569 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e55b2-4a3d-470d-88d1-4847de5d3fc6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:35.703394 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 521/1030] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:35.811031 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e55b2-4a3d-470d-88d1-4847de5d3fc6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:35.851941 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4644c-7c1a-45a1-8cef-f59a91818d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:35.852762 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4644c-7c1a-45a1-8cef-f59a91818d44 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:35.853049 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4644c-7c1a-45a1-8cef-f59a91818d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:35.853387 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4644c-7c1a-45a1-8cef-f59a91818d44 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:35.862793 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4644c-7c1a-45a1-8cef-f59a91818d44 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:35.864867 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4644c-7c1a-45a1-8cef-f59a91818d44 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:35.881973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-97b4644c-7c1a-45a1-8cef-f59a91818d44 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:30:35.881973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:35.881973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:35.881973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:35.881973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:35.881973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:35.881973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:35.881973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:35.881973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:35.881973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:35.881973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:35.881973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:35.881973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:30:35.881973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:30:35.881973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:30:35.881973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:30:35.883188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:35.883188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:35.883188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:30:35.883188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:35.883188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:30:35.883188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:35.883188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:35.883188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:35.883188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:35.883188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:35.883188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:35.883188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:35.883188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:35.883188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:35.883188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:35.883188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:35.883188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:35.883188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:35.885530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:35.885530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:35.885530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:30:35.885530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:30:35.885530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:30:35.885530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:30:35.885530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:30:35.885530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:30:35.885530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:30:35.885530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:35.889360 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 510/1031] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 26 16:30:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:35.891330 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1060736-cba6-4eba-bdab-6a67e3cb1cb4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:35.971346 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:36.032661 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1060736-cba6-4eba-bdab-6a67e3cb1cb4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:36.082698 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02a11b-338c-4d81-bfc1-70eb18c709f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:36.083990 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02a11b-338c-4d81-bfc1-70eb18c709f1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:36.084512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02a11b-338c-4d81-bfc1-70eb18c709f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:36.084997 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02a11b-338c-4d81-bfc1-70eb18c709f1 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:36.086240 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02a11b-338c-4d81-bfc1-70eb18c709f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:36.086780 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02a11b-338c-4d81-bfc1-70eb18c709f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:36.088706 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02a11b-338c-4d81-bfc1-70eb18c709f1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:36.112935 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 522/1032] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 26 16:30:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:36.119518 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4644c-7c1a-45a1-8cef-f59a91818d44 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:36.174308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:36.263613 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4644c-7c1a-45a1-8cef-f59a91818d44 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:36.299430 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cbef3-2490-4e2a-8caa-b34432a52669 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:36.299958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cbef3-2490-4e2a-8caa-b34432a52669 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:36.300169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cbef3-2490-4e2a-8caa-b34432a52669 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:36.305615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 523/1033] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:30:36.307442 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45c94f-9ba5-4d6c-bd05-fd4cd6b332c6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:36.307735 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45c94f-9ba5-4d6c-bd05-fd4cd6b332c6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:36.308028 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45c94f-9ba5-4d6c-bd05-fd4cd6b332c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:36.309518 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a774f-11ea-4f6c-88d1-8e8e239c3e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:36.310348 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a774f-11ea-4f6c-88d1-8e8e239c3e3d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:36.310804 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a774f-11ea-4f6c-88d1-8e8e239c3e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:36.311229 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a774f-11ea-4f6c-88d1-8e8e239c3e3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:36.327919 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4f45c94f-9ba5-4d6c-bd05-fd4cd6b332c6 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:36.330090 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4f45c94f-9ba5-4d6c-bd05-fd4cd6b332c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:36.418156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a774f-11ea-4f6c-88d1-8e8e239c3e3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:36.419953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a774f-11ea-4f6c-88d1-8e8e239c3e3d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:36.438989 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 524/1034] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:30:36.468530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45c94f-9ba5-4d6c-bd05-fd4cd6b332c6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:36.476759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:36.539082 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:36.611774 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 511/1035] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:30:36 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:36.614046 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14006d0-102f-40f6-96fe-d32e75ce71b4 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:36.614672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14006d0-102f-40f6-96fe-d32e75ce71b4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:36.615024 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14006d0-102f-40f6-96fe-d32e75ce71b4 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:36.621752 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 512/1036] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:36.621752 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14006d0-102f-40f6-96fe-d32e75ce71b4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:36.638502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45c94f-9ba5-4d6c-bd05-fd4cd6b332c6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:36.683677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0897f-11e9-4041-95a9-f373dafa1bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:36.684595 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0897f-11e9-4041-95a9-f373dafa1bee None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:36.685005 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0897f-11e9-4041-95a9-f373dafa1bee None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:36.685389 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0897f-11e9-4041-95a9-f373dafa1bee None admin] PATH_INFO: `/v3/services/image` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:36.686218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0897f-11e9-4041-95a9-f373dafa1bee None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:36.687804 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0897f-11e9-4041-95a9-f373dafa1bee None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:36.700398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-55b0897f-11e9-4041-95a9-f373dafa1bee None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:30:36.700398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:36.700398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:30:36.700398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:30:36.700398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:30:36.700398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:30:36.700398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:30:36.700398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:36.700398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:30:36.700398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:36.700398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:36.700398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:36.700398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:36.700398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:36.700398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:36.700398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:36.700398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:36.702000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:36.702000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:36.702000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:36.702000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:36.702000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:36.702000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:36.702000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:30:36.702000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:30:36.702000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:30:36.702000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:30:36.702000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:36.702000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:36.702000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:36.702000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:36.702000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:36.702000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:36.703681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:36.703681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:36.703681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:36.703681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:36.703681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:36.703681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:36.703681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:36.703681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:36.703681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:36.703681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:36.703681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:30:36.703681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:36.703681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:30:36.703681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:36.703681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 525/1037] 10.222.0.48 () {56 vars in 1105 bytes} [Thu May 26 16:30:36 2022] GET /identity/v3/services/image => generated 86 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:36.704813 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87383858-b4c6-435b-9cd6-9a92d5fbabff None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:36.704813 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87383858-b4c6-435b-9cd6-9a92d5fbabff None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:36.704813 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87383858-b4c6-435b-9cd6-9a92d5fbabff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:36.723516 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-87383858-b4c6-435b-9cd6-9a92d5fbabff None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:36.724767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-87383858-b4c6-435b-9cd6-9a92d5fbabff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:36.762337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14006d0-102f-40f6-96fe-d32e75ce71b4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:36.811224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 526/1038] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:36.814605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87383858-b4c6-435b-9cd6-9a92d5fbabff None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:36.825426 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb09d9-102a-412a-b39b-d0d4a2165315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:36.826988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb09d9-102a-412a-b39b-d0d4a2165315 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:36.827994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb09d9-102a-412a-b39b-d0d4a2165315 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:36.828471 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb09d9-102a-412a-b39b-d0d4a2165315 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:36.832002 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:36.848851 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb09d9-102a-412a-b39b-d0d4a2165315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:36.850465 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb09d9-102a-412a-b39b-d0d4a2165315 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:36.871219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-67cb09d9-102a-412a-b39b-d0d4a2165315 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:36.871219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:36.871219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:36.871219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:36.871219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:36.871219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:36.871219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:36.871219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:36.871219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:36.871219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:36.871219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:36.871219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:36.871219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:36.871219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:36.871219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:36.872156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:36.872156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:36.872156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:36.872156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:36.872156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:36.872156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:36.872156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:36.872156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:36.872156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:36.872156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:36.872156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:36.872156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:36.872156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:36.872156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:36.872156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:36.872156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:36.872156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:36.873071 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:36.873071 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:36.873071 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:36.873071 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:36.874924 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 513/1039] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:36.875337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb09d9-102a-412a-b39b-d0d4a2165315 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:36.885437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:36.970356 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87383858-b4c6-435b-9cd6-9a92d5fbabff None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:37.003794 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb09d9-102a-412a-b39b-d0d4a2165315 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:37.020091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baed6c-910d-48f0-a756-236b7c159bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:37.021203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baed6c-910d-48f0-a756-236b7c159bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:37.021519 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baed6c-910d-48f0-a756-236b7c159bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:37.021788 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baed6c-910d-48f0-a756-236b7c159bc8 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:37.022667 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baed6c-910d-48f0-a756-236b7c159bc8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:37.023019 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baed6c-910d-48f0-a756-236b7c159bc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:37.024803 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baed6c-910d-48f0-a756-236b7c159bc8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:37.033362 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 527/1040] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:37.033362 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baed6c-910d-48f0-a756-236b7c159bc8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:37.046428 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09479e8-4756-4441-8da1-acf01a0b0816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:37.047491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09479e8-4756-4441-8da1-acf01a0b0816 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:37.047770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09479e8-4756-4441-8da1-acf01a0b0816 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:37.048045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09479e8-4756-4441-8da1-acf01a0b0816 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:37.060044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09479e8-4756-4441-8da1-acf01a0b0816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:37.067995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-e09479e8-4756-4441-8da1-acf01a0b0816 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:37.067995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:37.067995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:37.067995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:37.067995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:37.067995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:37.067995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:37.067995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:37.067995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:37.067995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:37.067995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:37.067995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:37.067995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:37.067995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:37.067995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:37.067995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:37.069010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:37.069010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:37.069010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:37.069010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:37.069010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:37.069010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:37.069010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:37.069010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:37.069010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:37.069010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:37.069010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:37.069010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:37.069010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:37.069010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:37.069010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:37.069010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:37.070203 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:37.070203 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:37.070203 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:37.070203 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:37.070203 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:37.070203 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:37.070203 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:37.070203 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:37.070203 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:37.070203 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:37.070203 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:37.070203 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:37.070203 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 514/1041] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:30:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:37.070925 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09479e8-4756-4441-8da1-acf01a0b0816 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:37.143654 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:37.192265 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baed6c-910d-48f0-a756-236b7c159bc8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:37.196581 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:37.230987 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09479e8-4756-4441-8da1-acf01a0b0816 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:37.246439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de71bd6-56a0-4840-90f8-d80773943df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:37.249908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de71bd6-56a0-4840-90f8-d80773943df0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:37.249908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de71bd6-56a0-4840-90f8-d80773943df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:37.249908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de71bd6-56a0-4840-90f8-d80773943df0 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:37.249908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de71bd6-56a0-4840-90f8-d80773943df0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:37.249908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de71bd6-56a0-4840-90f8-d80773943df0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:37.249908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de71bd6-56a0-4840-90f8-d80773943df0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:37.271060 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 528/1042] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:37.274901 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de71bd6-56a0-4840-90f8-d80773943df0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:37.279558 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218f54a-d90f-4e72-8396-28970677b083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:37.280387 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218f54a-d90f-4e72-8396-28970677b083 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:37.280681 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218f54a-d90f-4e72-8396-28970677b083 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:37.280958 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218f54a-d90f-4e72-8396-28970677b083 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:37.281715 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218f54a-d90f-4e72-8396-28970677b083 None admin] RBAC: Adding query filter params (type=image) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:37.282010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218f54a-d90f-4e72-8396-28970677b083 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:37.283441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218f54a-d90f-4e72-8396-28970677b083 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:37.293907 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 515/1043] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:37.293907 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218f54a-d90f-4e72-8396-28970677b083 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:37.403681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de71bd6-56a0-4840-90f8-d80773943df0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:37.438484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218f54a-d90f-4e72-8396-28970677b083 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:37.443712 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544170a-1cf7-4c05-a7fa-e3d114b04d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:37.444391 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544170a-1cf7-4c05-a7fa-e3d114b04d5b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:37.445039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544170a-1cf7-4c05-a7fa-e3d114b04d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:37.446106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544170a-1cf7-4c05-a7fa-e3d114b04d5b None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:37.446106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544170a-1cf7-4c05-a7fa-e3d114b04d5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:37.446443 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544170a-1cf7-4c05-a7fa-e3d114b04d5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:37.448405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544170a-1cf7-4c05-a7fa-e3d114b04d5b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:37.456292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:37.461148 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 529/1044] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:30:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:37.462472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544170a-1cf7-4c05-a7fa-e3d114b04d5b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:37.490811 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5851e0-eaa2-4c36-9c5f-03fad680ebb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:37.491650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5851e0-eaa2-4c36-9c5f-03fad680ebb8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:37.492244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5851e0-eaa2-4c36-9c5f-03fad680ebb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:37.492509 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5851e0-eaa2-4c36-9c5f-03fad680ebb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:37.497685 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:37.503286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5851e0-eaa2-4c36-9c5f-03fad680ebb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:37.504745 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5851e0-eaa2-4c36-9c5f-03fad680ebb8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:37.522979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-3f5851e0-eaa2-4c36-9c5f-03fad680ebb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:37.522979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:37.522979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:37.522979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:37.522979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:37.522979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:37.522979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:37.522979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:37.522979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:37.522979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:37.522979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:37.522979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:37.522979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:30:37.522979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:30:37.522979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:30:37.523954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:30:37.523954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:37.523954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:37.523954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:37.523954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:37.523954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:37.523954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:37.523954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:37.523954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:37.523954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:37.523954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:37.523954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:37.523954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:37.523954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:37.523954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:37.523954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:37.523954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:37.524857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:30:37.524857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:30:37.524857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:30:37.524857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:30:37.524857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:30:37.524857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:30:37.524857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:37.524857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:37.524857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 516/1045] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:30:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:37.525460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5851e0-eaa2-4c36-9c5f-03fad680ebb8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:37.597918 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544170a-1cf7-4c05-a7fa-e3d114b04d5b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:37.642784 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c5279-ed68-4f06-b284-eb364990a208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:37.643635 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c5279-ed68-4f06-b284-eb364990a208 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:37.643922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c5279-ed68-4f06-b284-eb364990a208 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:37.644197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c5279-ed68-4f06-b284-eb364990a208 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:37.645039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c5279-ed68-4f06-b284-eb364990a208 None admin] RBAC: Adding query filter params (interface=public, service_id=b966ca3140434a0099db9026f1c6b7fd, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:37.646896 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c5279-ed68-4f06-b284-eb364990a208 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:37.646896 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c5279-ed68-4f06-b284-eb364990a208 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:37.653773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 530/1046] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 26 16:30:37 2022] GET /identity/v3/endpoints?service_id=b966ca3140434a0099db9026f1c6b7fd&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:37.654631 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c5279-ed68-4f06-b284-eb364990a208 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:37.655916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5851e0-eaa2-4c36-9c5f-03fad680ebb8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:37.696923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf85536-97eb-4076-9390-af51068ad5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:37.697849 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf85536-97eb-4076-9390-af51068ad5eb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:37.698130 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf85536-97eb-4076-9390-af51068ad5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:37.698403 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf85536-97eb-4076-9390-af51068ad5eb None admin] PATH_INFO: `/v3/users/f108b05596f5415198db54192a6c8b61` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:37.714290 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf85536-97eb-4076-9390-af51068ad5eb None admin] RBAC: Authorizing `identity:get_user(user_id=f108b05596f5415198db54192a6c8b61)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:37.715757 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf85536-97eb-4076-9390-af51068ad5eb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:37.717544 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 517/1047] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:30:37 2022] GET /identity/v3/users/f108b05596f5415198db54192a6c8b61 => generated 285 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:37.718334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf85536-97eb-4076-9390-af51068ad5eb None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:37.755282 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:37.787621 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:37.801575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c5279-ed68-4f06-b284-eb364990a208 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:37.853684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf85536-97eb-4076-9390-af51068ad5eb None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:37.859102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3537f97-d535-41ec-9e3b-fcd3a476a987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:37.859796 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3537f97-d535-41ec-9e3b-fcd3a476a987 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:37.860062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3537f97-d535-41ec-9e3b-fcd3a476a987 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:37.860336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3537f97-d535-41ec-9e3b-fcd3a476a987 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:37.861172 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3537f97-d535-41ec-9e3b-fcd3a476a987 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:37.861761 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3537f97-d535-41ec-9e3b-fcd3a476a987 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:37.862954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3537f97-d535-41ec-9e3b-fcd3a476a987 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:37.880987 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 531/1048] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:30:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:37.881198 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3537f97-d535-41ec-9e3b-fcd3a476a987 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:37.898723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c2e2d-6b42-4e34-825c-5938f402ce8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:37.899548 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c2e2d-6b42-4e34-825c-5938f402ce8f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:37.899902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c2e2d-6b42-4e34-825c-5938f402ce8f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:37.900255 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c2e2d-6b42-4e34-825c-5938f402ce8f None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:37.901009 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c2e2d-6b42-4e34-825c-5938f402ce8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:37.902529 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c2e2d-6b42-4e34-825c-5938f402ce8f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:37.913623 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 518/1049] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 26 16:30:37 2022] GET /identity/v3/services => generated 1957 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:30:37.914487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c2e2d-6b42-4e34-825c-5938f402ce8f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:38.039667 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3537f97-d535-41ec-9e3b-fcd3a476a987 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:38.083793 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:38.098941 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3557a8-2d11-4655-b3af-5ebdde89d3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:38.099894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3557a8-2d11-4655-b3af-5ebdde89d3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:38.100327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3557a8-2d11-4655-b3af-5ebdde89d3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:38.100768 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3557a8-2d11-4655-b3af-5ebdde89d3f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:38.113474 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c2e2d-6b42-4e34-825c-5938f402ce8f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:38.137216 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:38.194685 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ca6aa-f5b6-4aef-8685-209f01024942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:38.195910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ca6aa-f5b6-4aef-8685-209f01024942 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:38.197348 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ca6aa-f5b6-4aef-8685-209f01024942 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:38.198078 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ca6aa-f5b6-4aef-8685-209f01024942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:38.199153 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ca6aa-f5b6-4aef-8685-209f01024942 None admin] RBAC: Adding query filter params (role.id=6380c038334a4884b6c85da311930a3e, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=35c9fa9c29494ff9b1f749974dca2719) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:38.200332 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ca6aa-f5b6-4aef-8685-209f01024942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:38.202579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ca6aa-f5b6-4aef-8685-209f01024942 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:38.207914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3557a8-2d11-4655-b3af-5ebdde89d3f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:38.210653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 519/1050] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:30:37 2022] GET /identity/v3/role_assignments?user.id=35c9fa9c29494ff9b1f749974dca2719&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=6380c038334a4884b6c85da311930a3e => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:38.211180 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3557a8-2d11-4655-b3af-5ebdde89d3f6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:38.469106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 532/1051] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:30:37 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:38.474729 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ca6aa-f5b6-4aef-8685-209f01024942 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:38.653288 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ca6aa-f5b6-4aef-8685-209f01024942 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:38.692179 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb8de6-2483-4edd-acca-3cc4584d5799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:38.693073 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb8de6-2483-4edd-acca-3cc4584d5799 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:38.693428 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb8de6-2483-4edd-acca-3cc4584d5799 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:38.693694 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb8de6-2483-4edd-acca-3cc4584d5799 None admin] PATH_INFO: `/v3/projects/26db2a53d4684e29ba0880cb405c512f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:38.694957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb8de6-2483-4edd-acca-3cc4584d5799 None admin] RBAC: Authorizing `identity:get_project(project_id=26db2a53d4684e29ba0880cb405c512f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:38.696746 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb8de6-2483-4edd-acca-3cc4584d5799 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:38.698906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 520/1052] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:30:38 2022] GET /identity/v3/projects/26db2a53d4684e29ba0880cb405c512f => generated 311 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:38.708024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3557a8-2d11-4655-b3af-5ebdde89d3f6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:38.799861 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:38.862517 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3557a8-2d11-4655-b3af-5ebdde89d3f6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:38.905961 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a134f-9daf-4c87-bbab-02e72f9019c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:38.906634 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a134f-9daf-4c87-bbab-02e72f9019c7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:38.906920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a134f-9daf-4c87-bbab-02e72f9019c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:38.907199 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a134f-9daf-4c87-bbab-02e72f9019c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:38.908030 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a134f-9daf-4c87-bbab-02e72f9019c7 None admin] RBAC: Adding query filter params (role.id=796e313fa8794ac885ccf6300d09332a, scope.project.id=26db2a53d4684e29ba0880cb405c512f, user.id=f108b05596f5415198db54192a6c8b61) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:38.908342 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a134f-9daf-4c87-bbab-02e72f9019c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:38.909814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a134f-9daf-4c87-bbab-02e72f9019c7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:38.916129 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 533/1053] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:30:38 2022] GET /identity/v3/role_assignments?user.id=f108b05596f5415198db54192a6c8b61&scope.project.id=26db2a53d4684e29ba0880cb405c512f&role.id=796e313fa8794ac885ccf6300d09332a => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:40.285125 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204a988-c6f9-4ec9-853c-e4d2ff531842 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:40.285929 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204a988-c6f9-4ec9-853c-e4d2ff531842 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:40.285929 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204a988-c6f9-4ec9-853c-e4d2ff531842 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:40.287433 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 521/1054] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:40.292379 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d39b4-141c-460b-8b12-40a1697d26c0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:40.292800 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d39b4-141c-460b-8b12-40a1697d26c0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:40.293011 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d39b4-141c-460b-8b12-40a1697d26c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:40.310710 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6e3d39b4-141c-460b-8b12-40a1697d26c0 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:40.311967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6e3d39b4-141c-460b-8b12-40a1697d26c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:40.401510 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 534/1055] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:40.423215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204a988-c6f9-4ec9-853c-e4d2ff531842 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:40.449117 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:40.517867 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ada63-f55b-44dd-a56b-e49c35ae30b9 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:40.518086 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ada63-f55b-44dd-a56b-e49c35ae30b9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:40.518392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ada63-f55b-44dd-a56b-e49c35ae30b9 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:40.521132 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 535/1056] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:40.525463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13f232-23f7-4842-b976-f80b1951bb25 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:40.525797 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13f232-23f7-4842-b976-f80b1951bb25 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:40.526078 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13f232-23f7-4842-b976-f80b1951bb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:40.537466 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204a988-c6f9-4ec9-853c-e4d2ff531842 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:40.545024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ad13f232-23f7-4842-b976-f80b1951bb25 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:40.546290 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ad13f232-23f7-4842-b976-f80b1951bb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:40.574927 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e283a-840c-48a8-9b7f-0812e6020ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:40.576167 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e283a-840c-48a8-9b7f-0812e6020ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:40.576634 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e283a-840c-48a8-9b7f-0812e6020ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:40.577602 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e283a-840c-48a8-9b7f-0812e6020ff5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:40.578638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e283a-840c-48a8-9b7f-0812e6020ff5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:40.580341 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e283a-840c-48a8-9b7f-0812e6020ff5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:40.591481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:40.595094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-391e283a-840c-48a8-9b7f-0812e6020ff5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:30:40.595094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:40.595094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:30:40.595094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:30:40.595094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:30:40.595094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:30:40.595094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:30:40.595094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:40.595094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:30:40.595094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:40.595094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:40.595094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:40.595094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:40.595094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:40.595094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:40.595094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:40.595094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:40.596393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:40.596393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:40.596393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:40.596393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:40.596393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:40.596393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:40.596393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:30:40.596393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:30:40.596393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:30:40.596393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:30:40.596393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:40.596393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:40.596393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:40.596393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:40.596393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:40.596393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:40.597429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:40.597429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:40.597429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:40.597429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:40.597429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:40.597429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:40.597429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:40.597429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:40.597429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:40.597429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:40.597429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:30:40.597429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:40.597429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:30:40.597429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:40.597429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 522/1057] 10.222.0.48 () {56 vars in 1105 bytes} [Thu May 26 16:30:40 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:40.602761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e283a-840c-48a8-9b7f-0812e6020ff5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:40.628483 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 536/1058] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:30:40.652670 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13f232-23f7-4842-b976-f80b1951bb25 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:40.731422 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:40.746280 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e283a-840c-48a8-9b7f-0812e6020ff5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:40.774007 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13f232-23f7-4842-b976-f80b1951bb25 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:40.787618 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42415ff3-f8cc-4067-8ec5-9342573699f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:40.788296 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42415ff3-f8cc-4067-8ec5-9342573699f4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:40.788585 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42415ff3-f8cc-4067-8ec5-9342573699f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:40.788864 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42415ff3-f8cc-4067-8ec5-9342573699f4 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:40.789608 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42415ff3-f8cc-4067-8ec5-9342573699f4 None admin] RBAC: Adding query filter params (name=image) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:40.789910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42415ff3-f8cc-4067-8ec5-9342573699f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:40.791280 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42415ff3-f8cc-4067-8ec5-9342573699f4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:40.804270 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 523/1059] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:40.806475 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42415ff3-f8cc-4067-8ec5-9342573699f4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:40.834652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8982c18-b2e6-46f0-b59d-4a71c508a92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:40.835729 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8982c18-b2e6-46f0-b59d-4a71c508a92d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:40.836018 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8982c18-b2e6-46f0-b59d-4a71c508a92d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:40.836715 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8982c18-b2e6-46f0-b59d-4a71c508a92d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:40.851537 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8982c18-b2e6-46f0-b59d-4a71c508a92d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:40.865009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-b8982c18-b2e6-46f0-b59d-4a71c508a92d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:30:40.865009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:40.865009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:40.865009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:40.865009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:40.865009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:40.865009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:40.865009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:40.865009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:40.865009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:40.865009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:40.865009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:40.865009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:40.865009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:40.865009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:40.865009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:40.866051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:40.866051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:40.866051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:40.866051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:40.866051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:40.866051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:40.866051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:40.866051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:40.866051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:40.866051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:40.866051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:40.866051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:40.866051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:40.866051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:40.866051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:40.866051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:40.866917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:40.866917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:40.866917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:40.866917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:40.866917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:40.866917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:40.866917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:40.866917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:40.866917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:40.866917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:40.866917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:30:40.866917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:40.867562 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 537/1060] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 26 16:30:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:40.876585 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8982c18-b2e6-46f0-b59d-4a71c508a92d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:40.932443 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:40.939499 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42415ff3-f8cc-4067-8ec5-9342573699f4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:40.994929 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6cb03-f0ed-4fd4-bdc1-0a6c3a3e2abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:40.995603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6cb03-f0ed-4fd4-bdc1-0a6c3a3e2abe None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:40.995892 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6cb03-f0ed-4fd4-bdc1-0a6c3a3e2abe None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:40.996166 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6cb03-f0ed-4fd4-bdc1-0a6c3a3e2abe None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:40.996974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6cb03-f0ed-4fd4-bdc1-0a6c3a3e2abe None admin] RBAC: Adding query filter params (type=image) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:40.997313 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6cb03-f0ed-4fd4-bdc1-0a6c3a3e2abe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:40.998719 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6cb03-f0ed-4fd4-bdc1-0a6c3a3e2abe None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:41.004739 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 524/1061] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:41.011521 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6cb03-f0ed-4fd4-bdc1-0a6c3a3e2abe None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:41.012324 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8982c18-b2e6-46f0-b59d-4a71c508a92d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:41.042524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:41.059376 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6912b9-fb83-4768-9c7c-0c36618b4192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:41.060325 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6912b9-fb83-4768-9c7c-0c36618b4192 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:41.060681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6912b9-fb83-4768-9c7c-0c36618b4192 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:41.061034 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6912b9-fb83-4768-9c7c-0c36618b4192 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:41.062092 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6912b9-fb83-4768-9c7c-0c36618b4192 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:41.062459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6912b9-fb83-4768-9c7c-0c36618b4192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:41.064082 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6912b9-fb83-4768-9c7c-0c36618b4192 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:41.082339 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 538/1062] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 26 16:30:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:41.089247 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6912b9-fb83-4768-9c7c-0c36618b4192 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:41.142658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6cb03-f0ed-4fd4-bdc1-0a6c3a3e2abe None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:41.183921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f407a-2146-4dec-bf7e-50de8c67989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:41.184549 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f407a-2146-4dec-bf7e-50de8c67989e None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:41.184842 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f407a-2146-4dec-bf7e-50de8c67989e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:41.185122 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f407a-2146-4dec-bf7e-50de8c67989e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:41.185984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f407a-2146-4dec-bf7e-50de8c67989e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:41.187402 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f407a-2146-4dec-bf7e-50de8c67989e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:41.210047 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:41.215767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6912b9-fb83-4768-9c7c-0c36618b4192 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:41.263003 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df29ad8-7ef0-4cdd-b72f-c1be33ae4e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:41.263803 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df29ad8-7ef0-4cdd-b72f-c1be33ae4e68 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:41.264086 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df29ad8-7ef0-4cdd-b72f-c1be33ae4e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:41.264859 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df29ad8-7ef0-4cdd-b72f-c1be33ae4e68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:41.275449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df29ad8-7ef0-4cdd-b72f-c1be33ae4e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:41.276920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df29ad8-7ef0-4cdd-b72f-c1be33ae4e68 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:41.294638 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0df29ad8-7ef0-4cdd-b72f-c1be33ae4e68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:41.294638 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:41.294638 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:41.294638 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:41.294638 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:41.294638 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:41.294638 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:41.294638 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:41.294638 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:41.294638 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:41.294638 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:41.294638 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:41.294638 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:41.294638 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:41.294638 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:41.296159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:41.296159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:41.296159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:41.296159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:41.296159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:41.296159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:41.296159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:41.296159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:41.296159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:41.296159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:41.296159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:41.296159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:41.296159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:41.296159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:41.296159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:41.296159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:41.296159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:41.297167 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:41.297167 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:41.297167 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:41.297167 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:41.297167 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 539/1063] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:41.297600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888ba27-b9d6-4465-b658-39474b7bb933 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:41.297888 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888ba27-b9d6-4465-b658-39474b7bb933 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:41.298287 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888ba27-b9d6-4465-b658-39474b7bb933 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:41.299595 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 540/1064] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:41.301595 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888ba27-b9d6-4465-b658-39474b7bb933 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:41.351056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 525/1065] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 26 16:30:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:30:41.352333 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7d915-16c3-4ff9-9590-90c64a98e53d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:41.352622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7d915-16c3-4ff9-9590-90c64a98e53d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:41.352926 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7d915-16c3-4ff9-9590-90c64a98e53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:41.371730 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-44b7d915-16c3-4ff9-9590-90c64a98e53d None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:41.372985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-44b7d915-16c3-4ff9-9590-90c64a98e53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:41.450229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888ba27-b9d6-4465-b658-39474b7bb933 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:41.465478 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 526/1066] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:41.489560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7d915-16c3-4ff9-9590-90c64a98e53d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:41.491861 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:41.505008 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb6f61-2250-4137-a1c5-319f418c24fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:41.505727 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb6f61-2250-4137-a1c5-319f418c24fc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:41.506013 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb6f61-2250-4137-a1c5-319f418c24fc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:41.506289 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb6f61-2250-4137-a1c5-319f418c24fc None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:41.507017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb6f61-2250-4137-a1c5-319f418c24fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:41.507321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb6f61-2250-4137-a1c5-319f418c24fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:41.508714 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb6f61-2250-4137-a1c5-319f418c24fc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:41.521714 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 541/1067] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:41.527484 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb6f61-2250-4137-a1c5-319f418c24fc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:41.531425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:41.607568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7d915-16c3-4ff9-9590-90c64a98e53d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:41.645132 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb6f61-2250-4137-a1c5-319f418c24fc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:41.646451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d91db-f623-4f2c-8299-662199e5ab2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:41.647255 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d91db-f623-4f2c-8299-662199e5ab2d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:41.647536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d91db-f623-4f2c-8299-662199e5ab2d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:41.647815 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d91db-f623-4f2c-8299-662199e5ab2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:41.658990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d91db-f623-4f2c-8299-662199e5ab2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:41.666639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-661d91db-f623-4f2c-8299-662199e5ab2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:41.666639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:41.666639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:41.666639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:41.666639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:41.666639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:41.666639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:41.666639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:41.666639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:41.666639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:41.666639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:41.666639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:41.666639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:41.666639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:41.666639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:41.666639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:41.667600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:41.667600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:41.667600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:41.667600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:41.667600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:41.667600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:41.667600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:41.667600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:41.667600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:41.667600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:41.667600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:41.667600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:41.667600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:41.667600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:41.667600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:41.667600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:41.668653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:41.668653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:41.668653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:41.668653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:41.668653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:41.668653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:41.668653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:41.668653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:41.668653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:41.668653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:41.668653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:41.668653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:41.668653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 527/1068] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:30:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:41.678635 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d91db-f623-4f2c-8299-662199e5ab2d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:41.692022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac72bef-3ac4-4553-bebe-058c9673e216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:41.692881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac72bef-3ac4-4553-bebe-058c9673e216 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:41.693195 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac72bef-3ac4-4553-bebe-058c9673e216 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:41.693497 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac72bef-3ac4-4553-bebe-058c9673e216 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:41.701682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac72bef-3ac4-4553-bebe-058c9673e216 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:41.703092 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac72bef-3ac4-4553-bebe-058c9673e216 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:41.718426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-bac72bef-3ac4-4553-bebe-058c9673e216 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:30:41.718426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:41.718426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:41.718426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:41.718426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:41.718426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:41.718426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:41.718426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:41.718426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:41.718426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:41.718426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:41.718426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:41.718426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:30:41.718426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:30:41.718426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:30:41.718426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:30:41.719415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:41.719415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:41.719415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:30:41.719415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:41.719415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:30:41.719415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:41.719415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:41.719415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:41.719415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:41.719415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:41.719415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:41.719415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:41.719415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:41.719415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:41.719415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:41.719415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:41.719415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:41.719415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:41.721429 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:41.721429 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:41.721429 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:30:41.721429 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:30:41.721429 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:30:41.721429 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:30:41.721429 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:30:41.721429 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:30:41.721429 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:30:41.721429 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:41.721429 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 542/1069] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 26 16:30:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:41.725700 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac72bef-3ac4-4553-bebe-058c9673e216 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:41.747169 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:41.790238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d91db-f623-4f2c-8299-662199e5ab2d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:41.798026 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:41.829229 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6827f-f44b-4a26-a418-a1fc5f29a727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:41.829927 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6827f-f44b-4a26-a418-a1fc5f29a727 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:41.830227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6827f-f44b-4a26-a418-a1fc5f29a727 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:41.830538 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6827f-f44b-4a26-a418-a1fc5f29a727 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:41.831298 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6827f-f44b-4a26-a418-a1fc5f29a727 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:41.831601 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6827f-f44b-4a26-a418-a1fc5f29a727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:41.832956 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6827f-f44b-4a26-a418-a1fc5f29a727 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:41.839254 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac72bef-3ac4-4553-bebe-058c9673e216 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:41.841824 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 528/1070] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:30:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:41.848045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6827f-f44b-4a26-a418-a1fc5f29a727 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:41.883441 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b797d2a-bdaf-4f08-b371-5dacb837262f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:41.885432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b797d2a-bdaf-4f08-b371-5dacb837262f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:41.885432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b797d2a-bdaf-4f08-b371-5dacb837262f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:41.885432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b797d2a-bdaf-4f08-b371-5dacb837262f None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:41.885751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b797d2a-bdaf-4f08-b371-5dacb837262f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:41.885841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b797d2a-bdaf-4f08-b371-5dacb837262f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:41.887379 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b797d2a-bdaf-4f08-b371-5dacb837262f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:41.907795 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 543/1071] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 26 16:30:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:41.913599 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b797d2a-bdaf-4f08-b371-5dacb837262f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:41.973974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6827f-f44b-4a26-a418-a1fc5f29a727 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:41.998729 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:42.012906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb59831-9606-482b-bc23-209cbaf31964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:42.014135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb59831-9606-482b-bc23-209cbaf31964 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:42.018240 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb59831-9606-482b-bc23-209cbaf31964 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:42.018240 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb59831-9606-482b-bc23-209cbaf31964 None admin] PATH_INFO: `/v3/users/f108b05596f5415198db54192a6c8b61` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:42.018240 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb59831-9606-482b-bc23-209cbaf31964 None admin] RBAC: Authorizing `identity:get_user(user_id=f108b05596f5415198db54192a6c8b61)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:42.018240 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb59831-9606-482b-bc23-209cbaf31964 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:42.020170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 529/1072] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:30:41 2022] GET /identity/v3/users/f108b05596f5415198db54192a6c8b61 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:42.026202 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb59831-9606-482b-bc23-209cbaf31964 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:42.029279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b797d2a-bdaf-4f08-b371-5dacb837262f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:42.054780 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:42.067164 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2004fd-e3ca-4d17-9cc5-cb905cd8e13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:42.068098 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2004fd-e3ca-4d17-9cc5-cb905cd8e13b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:42.068447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2004fd-e3ca-4d17-9cc5-cb905cd8e13b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:42.068808 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2004fd-e3ca-4d17-9cc5-cb905cd8e13b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:42.080232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2004fd-e3ca-4d17-9cc5-cb905cd8e13b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:42.081827 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2004fd-e3ca-4d17-9cc5-cb905cd8e13b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:42.100494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-4c2004fd-e3ca-4d17-9cc5-cb905cd8e13b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:42.100494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:42.100494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:42.100494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:42.100494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:42.100494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:42.100494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:42.100494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:42.100494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:42.100494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:42.100494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:42.100494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:42.100494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:42.100494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:42.100494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:42.101535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:42.101535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:42.101535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:42.101535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:42.101535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:42.101535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:42.101535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:42.101535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:42.101535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:42.101535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:42.101535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:42.101535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:42.101535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:42.101535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:42.101535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:42.101535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:42.101535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:42.107268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:42.107268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:42.107268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:42.107268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:42.107268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 544/1073] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:42.107565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2004fd-e3ca-4d17-9cc5-cb905cd8e13b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:42.152783 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb59831-9606-482b-bc23-209cbaf31964 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:42.194906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c00bc-75d9-4863-9180-dd982570e901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:42.195776 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c00bc-75d9-4863-9180-dd982570e901 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:42.196061 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c00bc-75d9-4863-9180-dd982570e901 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:42.196595 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c00bc-75d9-4863-9180-dd982570e901 None admin] PATH_INFO: `/v3/projects/26db2a53d4684e29ba0880cb405c512f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:42.197825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c00bc-75d9-4863-9180-dd982570e901 None admin] RBAC: Authorizing `identity:get_project(project_id=26db2a53d4684e29ba0880cb405c512f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:42.199275 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c00bc-75d9-4863-9180-dd982570e901 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:42.201045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 530/1074] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:30:42 2022] GET /identity/v3/projects/26db2a53d4684e29ba0880cb405c512f => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:42.207569 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c00bc-75d9-4863-9180-dd982570e901 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:42.237323 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2004fd-e3ca-4d17-9cc5-cb905cd8e13b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:42.272627 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:42.277350 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1107931-a91c-4c9d-bff1-98502ae26ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:42.278018 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1107931-a91c-4c9d-bff1-98502ae26ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:42.278290 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1107931-a91c-4c9d-bff1-98502ae26ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:42.278628 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1107931-a91c-4c9d-bff1-98502ae26ed6 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:42.279375 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1107931-a91c-4c9d-bff1-98502ae26ed6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:42.279675 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1107931-a91c-4c9d-bff1-98502ae26ed6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:42.281028 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1107931-a91c-4c9d-bff1-98502ae26ed6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:42.297368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 545/1075] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:42.298376 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1107931-a91c-4c9d-bff1-98502ae26ed6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:42.318721 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c00bc-75d9-4863-9180-dd982570e901 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:42.333923 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:42.357639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86603879-1b96-499d-97b4-253c4c8cc31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:42.358614 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86603879-1b96-499d-97b4-253c4c8cc31a None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:42.358894 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86603879-1b96-499d-97b4-253c4c8cc31a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:42.359166 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86603879-1b96-499d-97b4-253c4c8cc31a None admin] PATH_INFO: `/v3/projects/26db2a53d4684e29ba0880cb405c512f/users/f108b05596f5415198db54192a6c8b61/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:42.361309 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86603879-1b96-499d-97b4-253c4c8cc31a None admin] RBAC: Authorizing `identity:create_grant(project_id=26db2a53d4684e29ba0880cb405c512f, user_id=f108b05596f5415198db54192a6c8b61, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:42.362924 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86603879-1b96-499d-97b4-253c4c8cc31a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:42.402490 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1107931-a91c-4c9d-bff1-98502ae26ed6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:42.441366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455864aa-a49f-4fff-9cb4-441cf4297d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:42.442154 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455864aa-a49f-4fff-9cb4-441cf4297d31 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:42.442432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455864aa-a49f-4fff-9cb4-441cf4297d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:42.442697 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455864aa-a49f-4fff-9cb4-441cf4297d31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:42.450174 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455864aa-a49f-4fff-9cb4-441cf4297d31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:42.452815 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455864aa-a49f-4fff-9cb4-441cf4297d31 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:42.468276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-455864aa-a49f-4fff-9cb4-441cf4297d31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:42.468276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:42.468276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:42.468276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:42.468276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:42.468276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:42.468276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:42.468276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:42.468276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:42.468276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:42.468276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:42.468276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:42.468276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:30:42.468276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:30:42.468276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:30:42.469565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:30:42.469565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:42.469565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:42.469565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:42.469565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:42.469565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:42.469565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:42.469565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:42.469565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:42.469565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:42.469565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:42.469565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:42.469565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:42.469565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:42.469565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:42.469565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:42.469565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:42.475967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:30:42.475967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:30:42.475967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:30:42.475967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:30:42.475967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:30:42.475967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:30:42.475967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:42.475967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:42.475967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 546/1076] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:30:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:42.477851 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455864aa-a49f-4fff-9cb4-441cf4297d31 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:42.516264 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 531/1077] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:30:42 2022] PUT /identity/v3/projects/26db2a53d4684e29ba0880cb405c512f/users/f108b05596f5415198db54192a6c8b61/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:30:42.602905 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:42.614768 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455864aa-a49f-4fff-9cb4-441cf4297d31 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:42.659332 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb7e37-c6d5-45c8-92fd-701425e959c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:42.660034 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb7e37-c6d5-45c8-92fd-701425e959c1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:42.660321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb7e37-c6d5-45c8-92fd-701425e959c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:42.660598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb7e37-c6d5-45c8-92fd-701425e959c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:42.661464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb7e37-c6d5-45c8-92fd-701425e959c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:42.661890 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb7e37-c6d5-45c8-92fd-701425e959c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:42.663368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb7e37-c6d5-45c8-92fd-701425e959c1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:42.683994 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 547/1078] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:30:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:42.686897 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86603879-1b96-499d-97b4-253c4c8cc31a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:42.815968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86603879-1b96-499d-97b4-253c4c8cc31a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:42.836506 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:42.851843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cbd03-fd65-48d4-97da-db8a59c11bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:42.859570 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cbd03-fd65-48d4-97da-db8a59c11bea None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:42.859570 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cbd03-fd65-48d4-97da-db8a59c11bea None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:42.859570 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cbd03-fd65-48d4-97da-db8a59c11bea None admin] PATH_INFO: `/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/35c9fa9c29494ff9b1f749974dca2719/roles/6380c038334a4884b6c85da311930a3e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:42.859570 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cbd03-fd65-48d4-97da-db8a59c11bea None admin] RBAC: Authorizing `identity:create_grant(project_id=a3379cdd914747758e71b3b05c5921b1, user_id=35c9fa9c29494ff9b1f749974dca2719, role_id=6380c038334a4884b6c85da311930a3e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:42.859570 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cbd03-fd65-48d4-97da-db8a59c11bea None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:43.049073 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 532/1079] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:30:42 2022] PUT /identity/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/35c9fa9c29494ff9b1f749974dca2719/roles/6380c038334a4884b6c85da311930a3e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:30:43.665949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c7b04-edfd-4f1e-a939-3f320954094c None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:43.666728 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c7b04-edfd-4f1e-a939-3f320954094c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:43.666728 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c7b04-edfd-4f1e-a939-3f320954094c None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:43.667937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 548/1080] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:43.673780 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a3349-51d4-4025-96f5-24f11ef95fa6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:43.674205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a3349-51d4-4025-96f5-24f11ef95fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:43.674403 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a3349-51d4-4025-96f5-24f11ef95fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:43.691802 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-392a3349-51d4-4025-96f5-24f11ef95fa6 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:43.692998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-392a3349-51d4-4025-96f5-24f11ef95fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:43.769436 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 533/1081] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:43.789964 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c7b04-edfd-4f1e-a939-3f320954094c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:43.901908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c7b04-edfd-4f1e-a939-3f320954094c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:43.938038 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70039c4b-2ff4-4b62-a4fe-4daea30ae95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:43.938610 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70039c4b-2ff4-4b62-a4fe-4daea30ae95d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:43.938894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70039c4b-2ff4-4b62-a4fe-4daea30ae95d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:43.939164 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70039c4b-2ff4-4b62-a4fe-4daea30ae95d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:43.964673 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:44.010447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70039c4b-2ff4-4b62-a4fe-4daea30ae95d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:44.012013 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70039c4b-2ff4-4b62-a4fe-4daea30ae95d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:44.126686 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 549/1082] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:30:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:44.128377 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a3349-51d4-4025-96f5-24f11ef95fa6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:44.239799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a3349-51d4-4025-96f5-24f11ef95fa6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:44.251768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:44.276032 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113b76b-2816-4c39-8001-90249d668298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:44.276826 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113b76b-2816-4c39-8001-90249d668298 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:44.277122 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113b76b-2816-4c39-8001-90249d668298 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:44.277427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113b76b-2816-4c39-8001-90249d668298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:44.289343 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113b76b-2816-4c39-8001-90249d668298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:44.290962 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113b76b-2816-4c39-8001-90249d668298 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:44.309843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-8113b76b-2816-4c39-8001-90249d668298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:44.309843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:44.309843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:44.309843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:44.309843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:44.309843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:44.309843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:44.309843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:44.309843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:44.309843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:44.309843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:44.309843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:44.309843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:44.309843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:44.309843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:44.310889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:44.310889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:44.310889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:44.310889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:44.310889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:44.310889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:44.310889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:44.310889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:44.310889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:44.310889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:44.310889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:44.310889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:44.310889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:44.310889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:44.310889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:44.310889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:44.310889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:44.311969 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:44.311969 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:44.311969 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:44.311969 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:44.311969 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 534/1083] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:44.318868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70039c4b-2ff4-4b62-a4fe-4daea30ae95d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:44.379747 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:44.425973 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70039c4b-2ff4-4b62-a4fe-4daea30ae95d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:44.465653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a859238-e6da-4b62-a540-4c542ef82559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:44.466347 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a859238-e6da-4b62-a540-4c542ef82559 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:44.466627 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a859238-e6da-4b62-a540-4c542ef82559 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:44.466932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a859238-e6da-4b62-a540-4c542ef82559 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:44.467632 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a859238-e6da-4b62-a540-4c542ef82559 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:44.467953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a859238-e6da-4b62-a540-4c542ef82559 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:44.469426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a859238-e6da-4b62-a540-4c542ef82559 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:44.489549 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 550/1084] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:44.780375 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49464786-af8d-4031-a965-0edcc6188837 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:44.780911 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49464786-af8d-4031-a965-0edcc6188837 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:44.780911 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49464786-af8d-4031-a965-0edcc6188837 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:44.782604 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 535/1085] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:44.788314 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aec46a-3217-4cd6-bec4-83f18a85584e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:44.788803 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aec46a-3217-4cd6-bec4-83f18a85584e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:44.788895 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aec46a-3217-4cd6-bec4-83f18a85584e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:44.806457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e6aec46a-3217-4cd6-bec4-83f18a85584e None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:44.807641 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e6aec46a-3217-4cd6-bec4-83f18a85584e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:44.875176 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 551/1086] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:44.898336 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49464786-af8d-4031-a965-0edcc6188837 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:45.000827 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49464786-af8d-4031-a965-0edcc6188837 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:45.034657 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b0505-86ae-45e9-8c0a-a49e43131459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:45.035368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b0505-86ae-45e9-8c0a-a49e43131459 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:45.035649 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b0505-86ae-45e9-8c0a-a49e43131459 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:45.035922 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b0505-86ae-45e9-8c0a-a49e43131459 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:45.046527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b0505-86ae-45e9-8c0a-a49e43131459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:45.054233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-5f9b0505-86ae-45e9-8c0a-a49e43131459 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:45.054233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:45.054233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:45.054233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:45.054233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:45.054233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:45.054233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:45.054233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:45.054233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:45.054233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:45.054233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:45.054233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:45.054233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:45.054233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:45.054233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:45.054233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:45.055303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:45.055303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:45.055303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:45.055303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:45.055303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:45.055303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:45.055303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:45.055303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:45.055303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:45.055303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:45.055303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:45.055303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:45.055303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:45.055303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:45.055303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:45.055303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:45.056143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:45.056143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:45.056143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:45.056143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:45.056143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:45.056143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:45.056143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:45.056143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:45.056143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:45.056143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:45.056143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:45.056143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:45.057449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 536/1087] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:30:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:45.062005 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aec46a-3217-4cd6-bec4-83f18a85584e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:45.113894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:45.167278 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aec46a-3217-4cd6-bec4-83f18a85584e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:45.202123 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc6523-2143-4135-a1a4-6a2c0ee696de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:45.202793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc6523-2143-4135-a1a4-6a2c0ee696de None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:45.203076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc6523-2143-4135-a1a4-6a2c0ee696de None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:45.203351 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc6523-2143-4135-a1a4-6a2c0ee696de None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:45.204089 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc6523-2143-4135-a1a4-6a2c0ee696de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:45.204571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc6523-2143-4135-a1a4-6a2c0ee696de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:45.206002 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc6523-2143-4135-a1a4-6a2c0ee696de None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:45.214288 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 552/1088] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:30:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:45.220605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b0505-86ae-45e9-8c0a-a49e43131459 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:45.247212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:45.287552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70dc9c-b556-49f4-9d4b-b3ff6a8efdab None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:45.287763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70dc9c-b556-49f4-9d4b-b3ff6a8efdab None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:45.288087 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70dc9c-b556-49f4-9d4b-b3ff6a8efdab None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:45.289511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 553/1089] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:30:45.294447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a34586-a54d-4685-be10-c1bd8935a2f7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:45.294733 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a34586-a54d-4685-be10-c1bd8935a2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:45.295012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a34586-a54d-4685-be10-c1bd8935a2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:45.312210 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-72a34586-a54d-4685-be10-c1bd8935a2f7 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:45.313424 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-72a34586-a54d-4685-be10-c1bd8935a2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:45.331343 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b0505-86ae-45e9-8c0a-a49e43131459 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:45.367620 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aad40a-3364-439f-a27f-b85213fd1e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:45.368501 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aad40a-3364-439f-a27f-b85213fd1e9b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:45.368777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aad40a-3364-439f-a27f-b85213fd1e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:45.369047 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aad40a-3364-439f-a27f-b85213fd1e9b None admin] PATH_INFO: `/v3/users/f108b05596f5415198db54192a6c8b61` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:45.370262 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aad40a-3364-439f-a27f-b85213fd1e9b None admin] RBAC: Authorizing `identity:get_user(user_id=f108b05596f5415198db54192a6c8b61)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:45.371716 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aad40a-3364-439f-a27f-b85213fd1e9b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:45.373375 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 537/1090] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:30:45 2022] GET /identity/v3/users/f108b05596f5415198db54192a6c8b61 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:45.379083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aad40a-3364-439f-a27f-b85213fd1e9b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:45.382262 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 554/1091] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:30:45.405882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a34586-a54d-4685-be10-c1bd8935a2f7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:45.441028 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:45.488868 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:45.499841 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aad40a-3364-439f-a27f-b85213fd1e9b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:45.524383 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a34586-a54d-4685-be10-c1bd8935a2f7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:45.535622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9030c-be5e-4c1a-9c89-f2bfaa35a2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:45.536270 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9030c-be5e-4c1a-9c89-f2bfaa35a2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:45.536553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9030c-be5e-4c1a-9c89-f2bfaa35a2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:45.536826 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9030c-be5e-4c1a-9c89-f2bfaa35a2c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:45.559106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42357f4e-7fee-43a8-b8ed-f092f24bcc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:45.559860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42357f4e-7fee-43a8-b8ed-f092f24bcc9d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:45.560155 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42357f4e-7fee-43a8-b8ed-f092f24bcc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:45.560524 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42357f4e-7fee-43a8-b8ed-f092f24bcc9d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:45.579690 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42357f4e-7fee-43a8-b8ed-f092f24bcc9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:45.588364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-42357f4e-7fee-43a8-b8ed-f092f24bcc9d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:30:45.588364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:45.588364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:45.588364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:45.588364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:45.588364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:45.588364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:45.588364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:45.588364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:45.588364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:45.588364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:45.588364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:45.588364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:45.588364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:45.588364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:45.588364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:45.589402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:45.589402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:45.589402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:45.589402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:45.589402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:45.589402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:45.589402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:45.589402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:45.589402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:45.589402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:45.589402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:45.589402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:45.589402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:45.589402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:45.589402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:45.589402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:45.590306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:45.590306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:45.590306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:45.590306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:45.590306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:45.590306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:45.590306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:45.590306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:45.590306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:45.590306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:45.590306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:30:45.590306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:45.590306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 555/1092] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 26 16:30:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:45.596834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42357f4e-7fee-43a8-b8ed-f092f24bcc9d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:45.607768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9030c-be5e-4c1a-9c89-f2bfaa35a2c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:45.609239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9030c-be5e-4c1a-9c89-f2bfaa35a2c6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:45.692184 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:45.697875 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42357f4e-7fee-43a8-b8ed-f092f24bcc9d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:45.703975 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:45.717924 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 538/1093] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:30:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:45.724492 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9030c-be5e-4c1a-9c89-f2bfaa35a2c6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:45.733246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7c34e-f7d3-4447-931f-74277fa77afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:45.733949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7c34e-f7d3-4447-931f-74277fa77afa None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:45.734235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7c34e-f7d3-4447-931f-74277fa77afa None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:45.734512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7c34e-f7d3-4447-931f-74277fa77afa None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:45.735274 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7c34e-f7d3-4447-931f-74277fa77afa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:45.735561 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7c34e-f7d3-4447-931f-74277fa77afa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:45.736922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7c34e-f7d3-4447-931f-74277fa77afa None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:45.746225 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 556/1094] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 26 16:30:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:45.752842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7c34e-f7d3-4447-931f-74277fa77afa None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:45.823495 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9030c-be5e-4c1a-9c89-f2bfaa35a2c6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:45.857949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7c34e-f7d3-4447-931f-74277fa77afa None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:45.861564 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01302b-20fa-40a5-8e66-11fcee34dc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:45.862611 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01302b-20fa-40a5-8e66-11fcee34dc12 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:45.862903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01302b-20fa-40a5-8e66-11fcee34dc12 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:45.863187 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01302b-20fa-40a5-8e66-11fcee34dc12 None admin] PATH_INFO: `/v3/projects/26db2a53d4684e29ba0880cb405c512f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:45.864398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01302b-20fa-40a5-8e66-11fcee34dc12 None admin] RBAC: Authorizing `identity:get_project(project_id=26db2a53d4684e29ba0880cb405c512f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:45.865885 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01302b-20fa-40a5-8e66-11fcee34dc12 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:45.867675 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 539/1095] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:30:45 2022] GET /identity/v3/projects/26db2a53d4684e29ba0880cb405c512f => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:45.874239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01302b-20fa-40a5-8e66-11fcee34dc12 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:45.896526 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85350b9-7233-41a6-97ed-6d8a1bae82c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:45.897363 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85350b9-7233-41a6-97ed-6d8a1bae82c7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:45.897650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85350b9-7233-41a6-97ed-6d8a1bae82c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:45.897961 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85350b9-7233-41a6-97ed-6d8a1bae82c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:45.909578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85350b9-7233-41a6-97ed-6d8a1bae82c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:45.911031 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85350b9-7233-41a6-97ed-6d8a1bae82c7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:45.930530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e85350b9-7233-41a6-97ed-6d8a1bae82c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:45.930530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:45.930530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:45.930530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:45.930530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:45.930530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:45.930530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:45.930530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:45.930530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:45.930530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:45.930530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:45.930530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:45.930530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:45.930530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:45.930530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:45.931578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:45.931578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:45.931578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:45.931578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:45.931578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:45.931578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:45.931578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:45.931578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:45.931578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:45.931578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:45.931578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:45.931578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:45.931578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:45.931578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:45.931578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:45.931578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:45.931578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:45.937841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:45.937841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:45.937841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:45.937841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:45.937841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 557/1096] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:45.937841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85350b9-7233-41a6-97ed-6d8a1bae82c7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:45.938222 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:45.950532 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:45.981290 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01302b-20fa-40a5-8e66-11fcee34dc12 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:46.014412 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d3353-c60c-428e-9ef3-7a6b99f14147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:46.015059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d3353-c60c-428e-9ef3-7a6b99f14147 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:46.015358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d3353-c60c-428e-9ef3-7a6b99f14147 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:46.015629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d3353-c60c-428e-9ef3-7a6b99f14147 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:46.016433 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d3353-c60c-428e-9ef3-7a6b99f14147 None admin] RBAC: Adding query filter params (role.id=796e313fa8794ac885ccf6300d09332a, scope.project.id=26db2a53d4684e29ba0880cb405c512f, user.id=f108b05596f5415198db54192a6c8b61) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:46.016740 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d3353-c60c-428e-9ef3-7a6b99f14147 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:46.018300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d3353-c60c-428e-9ef3-7a6b99f14147 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:46.024639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 540/1097] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:30:45 2022] GET /identity/v3/role_assignments?user.id=f108b05596f5415198db54192a6c8b61&scope.project.id=26db2a53d4684e29ba0880cb405c512f&role.id=796e313fa8794ac885ccf6300d09332a => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:46.058584 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85350b9-7233-41a6-97ed-6d8a1bae82c7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:46.082731 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a2967-df90-4efb-9368-183fba4ddf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:46.083408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a2967-df90-4efb-9368-183fba4ddf59 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:46.083694 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a2967-df90-4efb-9368-183fba4ddf59 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:46.083969 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a2967-df90-4efb-9368-183fba4ddf59 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:46.084713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a2967-df90-4efb-9368-183fba4ddf59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:46.085020 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a2967-df90-4efb-9368-183fba4ddf59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:46.086563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a2967-df90-4efb-9368-183fba4ddf59 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:46.103871 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 558/1098] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:46.110462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d3353-c60c-428e-9ef3-7a6b99f14147 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:46.224130 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d3353-c60c-428e-9ef3-7a6b99f14147 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:46.249606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:46.261768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faf9e5-5ca5-4182-90c4-78ca43329aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:46.262572 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faf9e5-5ca5-4182-90c4-78ca43329aee None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:46.262852 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faf9e5-5ca5-4182-90c4-78ca43329aee None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:46.263126 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faf9e5-5ca5-4182-90c4-78ca43329aee None admin] PATH_INFO: `/v3/users/nova` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:46.271655 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97faf9e5-5ca5-4182-90c4-78ca43329aee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:46.273116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97faf9e5-5ca5-4182-90c4-78ca43329aee None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:46.288674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-97faf9e5-5ca5-4182-90c4-78ca43329aee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:30:46.288674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:46.288674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:46.288674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:46.288674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:46.288674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:46.288674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:46.288674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:46.288674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:46.288674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:46.288674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:46.288674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:46.288674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:30:46.288674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:30:46.288674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:30:46.288674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:30:46.289798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:46.289798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:46.289798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:30:46.289798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:46.289798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:30:46.289798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:46.289798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:46.289798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:46.289798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:46.289798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:46.289798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:46.289798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:30:46.289798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:46.289798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:46.289798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:46.289798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:46.289798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:46.289798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:46.290785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:46.290785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:46.290785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:30:46.290785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:30:46.290785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:30:46.290785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:30:46.290785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:30:46.290785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:30:46.290785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:30:46.290785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:30:46.290785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 541/1099] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 26 16:30:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:46.295663 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a2967-df90-4efb-9368-183fba4ddf59 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:46.367834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:46.400611 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a2967-df90-4efb-9368-183fba4ddf59 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:46.435256 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30929a2-a164-4102-82b2-a9b0035633d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:46.435939 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30929a2-a164-4102-82b2-a9b0035633d9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:46.436596 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30929a2-a164-4102-82b2-a9b0035633d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:46.436874 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30929a2-a164-4102-82b2-a9b0035633d9 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:46.437741 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30929a2-a164-4102-82b2-a9b0035633d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:46.438050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30929a2-a164-4102-82b2-a9b0035633d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:46.439474 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30929a2-a164-4102-82b2-a9b0035633d9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:46.539903 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 559/1100] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 26 16:30:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:46.541294 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faf9e5-5ca5-4182-90c4-78ca43329aee None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:46.731569 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faf9e5-5ca5-4182-90c4-78ca43329aee None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:46.772330 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9313af-1a12-4885-940f-9b4df8c70618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:46.773218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9313af-1a12-4885-940f-9b4df8c70618 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:46.773494 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9313af-1a12-4885-940f-9b4df8c70618 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:46.773775 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9313af-1a12-4885-940f-9b4df8c70618 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:46.829000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:46.848343 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9313af-1a12-4885-940f-9b4df8c70618 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:46.850973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9313af-1a12-4885-940f-9b4df8c70618 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:46.958762 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 542/1101] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:30:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:46.964835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30929a2-a164-4102-82b2-a9b0035633d9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:47.119881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30929a2-a164-4102-82b2-a9b0035633d9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:47.148707 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:47.158065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79325c1-b786-4202-9268-cbafc887341c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:47.160392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79325c1-b786-4202-9268-cbafc887341c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:47.160392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79325c1-b786-4202-9268-cbafc887341c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:47.160392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79325c1-b786-4202-9268-cbafc887341c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:47.170394 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79325c1-b786-4202-9268-cbafc887341c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:47.171922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79325c1-b786-4202-9268-cbafc887341c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:47.190246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e79325c1-b786-4202-9268-cbafc887341c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:47.190246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:47.190246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:47.190246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:47.190246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:47.190246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:47.190246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:47.190246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:47.190246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:47.190246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:47.190246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:47.190246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:47.190246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:47.190246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:47.190246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:47.192170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:47.192170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:47.192170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:47.192170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:47.192170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:47.192170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:47.192170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:47.192170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:47.192170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:47.192170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:47.192170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:47.192170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:47.192170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:47.192170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:47.192170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:47.192170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:47.192170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:47.193789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:47.193789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:47.193789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:47.193789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:47.193789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 560/1102] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:47.198425 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9313af-1a12-4885-940f-9b4df8c70618 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:47.288738 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:47.307231 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9313af-1a12-4885-940f-9b4df8c70618 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:47.352652 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60491ea0-fff8-4d1b-9d8d-2fbb62e76f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:47.353230 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60491ea0-fff8-4d1b-9d8d-2fbb62e76f76 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:47.353545 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60491ea0-fff8-4d1b-9d8d-2fbb62e76f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:47.353817 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60491ea0-fff8-4d1b-9d8d-2fbb62e76f76 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:47.354749 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60491ea0-fff8-4d1b-9d8d-2fbb62e76f76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:47.355079 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60491ea0-fff8-4d1b-9d8d-2fbb62e76f76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:47.356471 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60491ea0-fff8-4d1b-9d8d-2fbb62e76f76 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:47.369029 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 543/1103] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:47.374956 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79325c1-b786-4202-9268-cbafc887341c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:47.493865 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79325c1-b786-4202-9268-cbafc887341c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:47.538669 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47a4c4-3c00-4ebd-8c6a-6850dec895de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:47.543849 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47a4c4-3c00-4ebd-8c6a-6850dec895de None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:47.543849 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47a4c4-3c00-4ebd-8c6a-6850dec895de None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:47.543849 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47a4c4-3c00-4ebd-8c6a-6850dec895de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:47.549518 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47a4c4-3c00-4ebd-8c6a-6850dec895de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:47.550971 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47a4c4-3c00-4ebd-8c6a-6850dec895de None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:47.566109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-5e47a4c4-3c00-4ebd-8c6a-6850dec895de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:47.566109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:47.566109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:47.566109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:47.566109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:47.566109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:47.566109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:47.566109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:47.566109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:47.566109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:47.566109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:47.566109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:47.566109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:30:47.566109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:30:47.566109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:30:47.567486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:30:47.567486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:47.567486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:47.567486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:47.567486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:47.567486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:47.567486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:47.567486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:47.567486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:30:47.567486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:47.567486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:47.567486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:47.567486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:47.567486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:47.567486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:47.567486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:47.567486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:47.569006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:30:47.569006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:30:47.569006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:30:47.569006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:30:47.569006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:30:47.569006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:30:47.569006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:47.569006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:30:47.569006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 561/1104] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:30:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:47.573714 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60491ea0-fff8-4d1b-9d8d-2fbb62e76f76 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:47.681409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60491ea0-fff8-4d1b-9d8d-2fbb62e76f76 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:47.717671 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b6c6e-bf57-4cb2-8f42-307a75970a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:47.718332 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b6c6e-bf57-4cb2-8f42-307a75970a34 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:47.718607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b6c6e-bf57-4cb2-8f42-307a75970a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:47.718877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b6c6e-bf57-4cb2-8f42-307a75970a34 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:47.719724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b6c6e-bf57-4cb2-8f42-307a75970a34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:47.719993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b6c6e-bf57-4cb2-8f42-307a75970a34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:47.721791 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b6c6e-bf57-4cb2-8f42-307a75970a34 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:47.737516 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 544/1105] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:30:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:47.744144 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47a4c4-3c00-4ebd-8c6a-6850dec895de None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:47.789561 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:47.867151 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47a4c4-3c00-4ebd-8c6a-6850dec895de None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:47.918348 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d06bb8-1dbf-4d8e-9bb0-4e941b0687ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:47.919022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d06bb8-1dbf-4d8e-9bb0-4e941b0687ac None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:47.919309 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d06bb8-1dbf-4d8e-9bb0-4e941b0687ac None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:47.919583 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d06bb8-1dbf-4d8e-9bb0-4e941b0687ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:47.921002 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d06bb8-1dbf-4d8e-9bb0-4e941b0687ac None admin] RBAC: Adding query filter params (role.id=6380c038334a4884b6c85da311930a3e, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=35c9fa9c29494ff9b1f749974dca2719) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:47.921347 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d06bb8-1dbf-4d8e-9bb0-4e941b0687ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:47.922803 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d06bb8-1dbf-4d8e-9bb0-4e941b0687ac None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:47.929708 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 562/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:30:47 2022] GET /identity/v3/role_assignments?user.id=35c9fa9c29494ff9b1f749974dca2719&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=6380c038334a4884b6c85da311930a3e => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:48.387796 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21159f57-a0b3-4432-937c-551ac03c5e99 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:48.388291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21159f57-a0b3-4432-937c-551ac03c5e99 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:48.388291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21159f57-a0b3-4432-937c-551ac03c5e99 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:48.389702 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 545/1107] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:48.395645 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2997826-7768-4fe7-b34c-a9f0f3231182 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:48.396093 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2997826-7768-4fe7-b34c-a9f0f3231182 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:48.396240 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2997826-7768-4fe7-b34c-a9f0f3231182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:48.416176 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d2997826-7768-4fe7-b34c-a9f0f3231182 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:48.419231 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d2997826-7768-4fe7-b34c-a9f0f3231182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:48.501756 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 563/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:48.528126 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21159f57-a0b3-4432-937c-551ac03c5e99 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:48.531976 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:48.659068 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21159f57-a0b3-4432-937c-551ac03c5e99 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:48.710485 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad2078-0fc9-4d74-a2d3-5123828bc3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:48.711330 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad2078-0fc9-4d74-a2d3-5123828bc3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:48.711616 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad2078-0fc9-4d74-a2d3-5123828bc3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:48.711887 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad2078-0fc9-4d74-a2d3-5123828bc3b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:48.713120 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad2078-0fc9-4d74-a2d3-5123828bc3b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:48.714680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad2078-0fc9-4d74-a2d3-5123828bc3b6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:48.716365 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 546/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:30:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:48.724122 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2997826-7768-4fe7-b34c-a9f0f3231182 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:48.800719 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:48.885540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2997826-7768-4fe7-b34c-a9f0f3231182 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:48.922826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4c246-d3d4-4432-862b-3f1cb48c7cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:48.923431 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4c246-d3d4-4432-862b-3f1cb48c7cd0 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:48.923712 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4c246-d3d4-4432-862b-3f1cb48c7cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:48.923988 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4c246-d3d4-4432-862b-3f1cb48c7cd0 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:48.924711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4c246-d3d4-4432-862b-3f1cb48c7cd0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:48.926230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4c246-d3d4-4432-862b-3f1cb48c7cd0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:49.058982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 564/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 16:30:48 2022] POST /identity/v3/users => generated 286 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:30:51.313395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3820af-3e72-4abb-a769-f0ce397a1b95 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:51.313929 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3820af-3e72-4abb-a769-f0ce397a1b95 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:51.313929 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3820af-3e72-4abb-a769-f0ce397a1b95 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:51.315323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 547/1111] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:51.320633 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e5f55-de70-452b-b9d8-187ff7dcd7b8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:51.321047 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e5f55-de70-452b-b9d8-187ff7dcd7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:51.321142 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e5f55-de70-452b-b9d8-187ff7dcd7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:51.338947 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7c9e5f55-de70-452b-b9d8-187ff7dcd7b8 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:51.340121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7c9e5f55-de70-452b-b9d8-187ff7dcd7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:51.408386 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 565/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:51.432027 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3820af-3e72-4abb-a769-f0ce397a1b95 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:51.510673 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:51.543257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3820af-3e72-4abb-a769-f0ce397a1b95 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:51.582553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0319080-c11c-4a95-ab52-a58784cb08a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:51.582553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0319080-c11c-4a95-ab52-a58784cb08a7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:51.582553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0319080-c11c-4a95-ab52-a58784cb08a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:51.582553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0319080-c11c-4a95-ab52-a58784cb08a7 None admin] PATH_INFO: `/v3/roles/c8d1d9031cfc4ef8a0e62f6bfd7ff691` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:51.582994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0319080-c11c-4a95-ab52-a58784cb08a7 None admin] RBAC: Authorizing `identity:get_role(role_id=c8d1d9031cfc4ef8a0e62f6bfd7ff691)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:51.583290 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0319080-c11c-4a95-ab52-a58784cb08a7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:51.584654 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 548/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:30:51 2022] GET /identity/v3/roles/c8d1d9031cfc4ef8a0e62f6bfd7ff691 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:51.590488 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e5f55-de70-452b-b9d8-187ff7dcd7b8 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:51.612049 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:51.689354 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e5f55-de70-452b-b9d8-187ff7dcd7b8 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:51.722161 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26661d5b-33fa-416e-b497-0e55ce84ac63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:51.723027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26661d5b-33fa-416e-b497-0e55ce84ac63 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:51.723348 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26661d5b-33fa-416e-b497-0e55ce84ac63 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:51.723625 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26661d5b-33fa-416e-b497-0e55ce84ac63 None admin] PATH_INFO: `/v3/users/53f5dde8734947d597f7bb17cc061b5f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:51.737000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26661d5b-33fa-416e-b497-0e55ce84ac63 None admin] RBAC: Authorizing `identity:get_user(user_id=53f5dde8734947d597f7bb17cc061b5f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:51.738592 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26661d5b-33fa-416e-b497-0e55ce84ac63 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:51.740695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 566/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:30:51 2022] GET /identity/v3/users/53f5dde8734947d597f7bb17cc061b5f => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:51.746251 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0319080-c11c-4a95-ab52-a58784cb08a7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:51.844855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0319080-c11c-4a95-ab52-a58784cb08a7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:51.882018 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3ecda-acbf-45f9-b5a4-810c24dca7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:51.882656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3ecda-acbf-45f9-b5a4-810c24dca7ae None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:51.882934 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3ecda-acbf-45f9-b5a4-810c24dca7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:51.883205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3ecda-acbf-45f9-b5a4-810c24dca7ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:51.891551 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:51.951604 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3ecda-acbf-45f9-b5a4-810c24dca7ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:51.953072 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3ecda-acbf-45f9-b5a4-810c24dca7ae None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:52.052305 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 549/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:30:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:52.058483 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26661d5b-33fa-416e-b497-0e55ce84ac63 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:52.141001 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:52.162249 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26661d5b-33fa-416e-b497-0e55ce84ac63 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:52.196475 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e0bb9-d027-4eee-87ac-06dc2b819cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:52.197370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e0bb9-d027-4eee-87ac-06dc2b819cdf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:52.197658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e0bb9-d027-4eee-87ac-06dc2b819cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:52.197936 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e0bb9-d027-4eee-87ac-06dc2b819cdf None admin] PATH_INFO: `/v3/projects/26db2a53d4684e29ba0880cb405c512f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:52.199127 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e0bb9-d027-4eee-87ac-06dc2b819cdf None admin] RBAC: Authorizing `identity:get_project(project_id=26db2a53d4684e29ba0880cb405c512f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:52.200556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e0bb9-d027-4eee-87ac-06dc2b819cdf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:52.202429 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 567/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:30:52 2022] GET /identity/v3/projects/26db2a53d4684e29ba0880cb405c512f => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:52.208726 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3ecda-acbf-45f9-b5a4-810c24dca7ae None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:52.248663 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:52.308853 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3ecda-acbf-45f9-b5a4-810c24dca7ae None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:52.344193 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20097f7-bb67-49b9-a83f-b22e1724e7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:52.344847 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20097f7-bb67-49b9-a83f-b22e1724e7fb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:52.345119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20097f7-bb67-49b9-a83f-b22e1724e7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:52.345431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20097f7-bb67-49b9-a83f-b22e1724e7fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:52.346512 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20097f7-bb67-49b9-a83f-b22e1724e7fb None admin] RBAC: Adding query filter params (role.id=c8d1d9031cfc4ef8a0e62f6bfd7ff691, scope.project.id=26db2a53d4684e29ba0880cb405c512f, user.id=53f5dde8734947d597f7bb17cc061b5f) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:52.346821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20097f7-bb67-49b9-a83f-b22e1724e7fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:52.348276 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20097f7-bb67-49b9-a83f-b22e1724e7fb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:52.354398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 550/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:30:52 2022] GET /identity/v3/role_assignments?user.id=53f5dde8734947d597f7bb17cc061b5f&scope.project.id=26db2a53d4684e29ba0880cb405c512f&role.id=c8d1d9031cfc4ef8a0e62f6bfd7ff691 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:54.563995 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fc713-f8ea-4eba-8978-e8236451c634 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:54.564619 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fc713-f8ea-4eba-8978-e8236451c634 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:54.564619 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fc713-f8ea-4eba-8978-e8236451c634 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:54.566029 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 568/1118] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:54.571649 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2083d6f-7021-4cad-a73e-13b9dc0c75bf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:54.572113 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2083d6f-7021-4cad-a73e-13b9dc0c75bf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:54.572227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2083d6f-7021-4cad-a73e-13b9dc0c75bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:54.590111 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e2083d6f-7021-4cad-a73e-13b9dc0c75bf None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:54.591310 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e2083d6f-7021-4cad-a73e-13b9dc0c75bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:54.664681 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 551/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:54.687897 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fc713-f8ea-4eba-8978-e8236451c634 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:54.792423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fc713-f8ea-4eba-8978-e8236451c634 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:54.826734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad6105-93c0-434f-ac1e-261006ec72f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:54.827545 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad6105-93c0-434f-ac1e-261006ec72f7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:54.827821 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad6105-93c0-434f-ac1e-261006ec72f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:54.828089 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad6105-93c0-434f-ac1e-261006ec72f7 None admin] PATH_INFO: `/v3/roles/c8d1d9031cfc4ef8a0e62f6bfd7ff691` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:54.829676 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad6105-93c0-434f-ac1e-261006ec72f7 None admin] RBAC: Authorizing `identity:get_role(role_id=c8d1d9031cfc4ef8a0e62f6bfd7ff691)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:54.831087 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad6105-93c0-434f-ac1e-261006ec72f7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:54.832464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 569/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:30:54 2022] GET /identity/v3/roles/c8d1d9031cfc4ef8a0e62f6bfd7ff691 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:54.839217 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2083d6f-7021-4cad-a73e-13b9dc0c75bf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:54.870024 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:54.940035 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2083d6f-7021-4cad-a73e-13b9dc0c75bf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:54.977848 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48361b0-c135-49b9-874f-153479d81f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:54.978733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48361b0-c135-49b9-874f-153479d81f25 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:54.979013 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48361b0-c135-49b9-874f-153479d81f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:54.979285 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48361b0-c135-49b9-874f-153479d81f25 None admin] PATH_INFO: `/v3/users/53f5dde8734947d597f7bb17cc061b5f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:54.980548 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48361b0-c135-49b9-874f-153479d81f25 None admin] RBAC: Authorizing `identity:get_user(user_id=53f5dde8734947d597f7bb17cc061b5f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:54.982160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48361b0-c135-49b9-874f-153479d81f25 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:54.983888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 552/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:30:54 2022] GET /identity/v3/users/53f5dde8734947d597f7bb17cc061b5f => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:54.989983 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad6105-93c0-434f-ac1e-261006ec72f7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:55.009225 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:55.105444 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad6105-93c0-434f-ac1e-261006ec72f7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:55.140375 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ff7ad-76fa-4b5e-98ea-45576706a68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:55.141231 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ff7ad-76fa-4b5e-98ea-45576706a68a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:55.141541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ff7ad-76fa-4b5e-98ea-45576706a68a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:55.141816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ff7ad-76fa-4b5e-98ea-45576706a68a None admin] PATH_INFO: `/v3/projects/26db2a53d4684e29ba0880cb405c512f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:55.143035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ff7ad-76fa-4b5e-98ea-45576706a68a None admin] RBAC: Authorizing `identity:get_project(project_id=26db2a53d4684e29ba0880cb405c512f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:55.144457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ff7ad-76fa-4b5e-98ea-45576706a68a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:55.146185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 570/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:30:54 2022] GET /identity/v3/projects/26db2a53d4684e29ba0880cb405c512f => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:55.152122 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48361b0-c135-49b9-874f-153479d81f25 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:55.252387 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:55.255395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48361b0-c135-49b9-874f-153479d81f25 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:55.289021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761cc8b-52fd-4bad-970b-5a4cf94e49b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:55.289957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761cc8b-52fd-4bad-970b-5a4cf94e49b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:55.290236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761cc8b-52fd-4bad-970b-5a4cf94e49b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:55.290511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761cc8b-52fd-4bad-970b-5a4cf94e49b7 None admin] PATH_INFO: `/v3/projects/26db2a53d4684e29ba0880cb405c512f/users/53f5dde8734947d597f7bb17cc061b5f/roles/c8d1d9031cfc4ef8a0e62f6bfd7ff691` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:55.292946 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761cc8b-52fd-4bad-970b-5a4cf94e49b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=26db2a53d4684e29ba0880cb405c512f, user_id=53f5dde8734947d597f7bb17cc061b5f, role_id=c8d1d9031cfc4ef8a0e62f6bfd7ff691)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:55.294868 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761cc8b-52fd-4bad-970b-5a4cf94e49b7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:55.390602 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 553/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:30:55 2022] PUT /identity/v3/projects/26db2a53d4684e29ba0880cb405c512f/users/53f5dde8734947d597f7bb17cc061b5f/roles/c8d1d9031cfc4ef8a0e62f6bfd7ff691 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:30:57.614081 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60ee6b-bd76-43f3-893b-fc185d9b54c5 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:57.614711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60ee6b-bd76-43f3-893b-fc185d9b54c5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:57.614711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60ee6b-bd76-43f3-893b-fc185d9b54c5 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:57.615976 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 571/1124] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:30:57.621582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec71523-5a07-4703-8bb5-d61ae1672d60 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:57.622026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec71523-5a07-4703-8bb5-d61ae1672d60 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:57.622145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec71523-5a07-4703-8bb5-d61ae1672d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:57.639917 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4ec71523-5a07-4703-8bb5-d61ae1672d60 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:57.641337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4ec71523-5a07-4703-8bb5-d61ae1672d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:57.710033 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 554/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:30:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:57.735108 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60ee6b-bd76-43f3-893b-fc185d9b54c5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:57.843696 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:57.875236 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60ee6b-bd76-43f3-893b-fc185d9b54c5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:57.910950 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c57ca5-90ed-4429-b043-7ad56ae20c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:57.911820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c57ca5-90ed-4429-b043-7ad56ae20c09 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:57.912099 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c57ca5-90ed-4429-b043-7ad56ae20c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:57.912370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c57ca5-90ed-4429-b043-7ad56ae20c09 None admin] PATH_INFO: `/v3/roles/c8d1d9031cfc4ef8a0e62f6bfd7ff691` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:57.913934 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c57ca5-90ed-4429-b043-7ad56ae20c09 None admin] RBAC: Authorizing `identity:get_role(role_id=c8d1d9031cfc4ef8a0e62f6bfd7ff691)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:57.915298 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c57ca5-90ed-4429-b043-7ad56ae20c09 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:57.916714 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 572/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:30:57 2022] GET /identity/v3/roles/c8d1d9031cfc4ef8a0e62f6bfd7ff691 => generated 223 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:57.922783 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec71523-5a07-4703-8bb5-d61ae1672d60 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:58.020063 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:58.029534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec71523-5a07-4703-8bb5-d61ae1672d60 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:58.063847 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b352e8-9e31-496c-9e7e-902ca733e925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:58.064718 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b352e8-9e31-496c-9e7e-902ca733e925 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:58.064998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b352e8-9e31-496c-9e7e-902ca733e925 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:58.065292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b352e8-9e31-496c-9e7e-902ca733e925 None admin] PATH_INFO: `/v3/users/53f5dde8734947d597f7bb17cc061b5f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:58.066662 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b352e8-9e31-496c-9e7e-902ca733e925 None admin] RBAC: Authorizing `identity:get_user(user_id=53f5dde8734947d597f7bb17cc061b5f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:58.068106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b352e8-9e31-496c-9e7e-902ca733e925 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:58.069981 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 555/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:30:57 2022] GET /identity/v3/users/53f5dde8734947d597f7bb17cc061b5f => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:58.075738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c57ca5-90ed-4429-b043-7ad56ae20c09 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:58.175578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c57ca5-90ed-4429-b043-7ad56ae20c09 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:58.210586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021c846-95f0-4c51-9e00-8ee6ab20feaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:58.211239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021c846-95f0-4c51-9e00-8ee6ab20feaa None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:58.211516 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021c846-95f0-4c51-9e00-8ee6ab20feaa None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:58.211787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021c846-95f0-4c51-9e00-8ee6ab20feaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:58.230977 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:58.279780 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021c846-95f0-4c51-9e00-8ee6ab20feaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:58.281220 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021c846-95f0-4c51-9e00-8ee6ab20feaa None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:58.383650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 573/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:30:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:58.389617 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b352e8-9e31-496c-9e7e-902ca733e925 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:58.500479 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b352e8-9e31-496c-9e7e-902ca733e925 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:58.535331 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf436c-ac54-4e22-a7d0-a93dee7f0a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:58.536192 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf436c-ac54-4e22-a7d0-a93dee7f0a42 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:58.536468 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf436c-ac54-4e22-a7d0-a93dee7f0a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:58.536744 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf436c-ac54-4e22-a7d0-a93dee7f0a42 None admin] PATH_INFO: `/v3/projects/26db2a53d4684e29ba0880cb405c512f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:58.537950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf436c-ac54-4e22-a7d0-a93dee7f0a42 None admin] RBAC: Authorizing `identity:get_project(project_id=26db2a53d4684e29ba0880cb405c512f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:58.539383 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf436c-ac54-4e22-a7d0-a93dee7f0a42 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:58.541079 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 556/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:30:58 2022] GET /identity/v3/projects/26db2a53d4684e29ba0880cb405c512f => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:58.547765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021c846-95f0-4c51-9e00-8ee6ab20feaa None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:58.600556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:58.650046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021c846-95f0-4c51-9e00-8ee6ab20feaa None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:58.684896 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930b22c-835b-44fc-9481-ec44d5f6bd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:58.685624 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930b22c-835b-44fc-9481-ec44d5f6bd8d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:58.685908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930b22c-835b-44fc-9481-ec44d5f6bd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:58.686178 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930b22c-835b-44fc-9481-ec44d5f6bd8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:58.687005 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930b22c-835b-44fc-9481-ec44d5f6bd8d None admin] RBAC: Adding query filter params (role.id=c8d1d9031cfc4ef8a0e62f6bfd7ff691, scope.project.id=26db2a53d4684e29ba0880cb405c512f, user.id=53f5dde8734947d597f7bb17cc061b5f) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:58.687311 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930b22c-835b-44fc-9481-ec44d5f6bd8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:58.688751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930b22c-835b-44fc-9481-ec44d5f6bd8d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:58.699025 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 574/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:30:58 2022] GET /identity/v3/role_assignments?user.id=53f5dde8734947d597f7bb17cc061b5f&scope.project.id=26db2a53d4684e29ba0880cb405c512f&role.id=c8d1d9031cfc4ef8a0e62f6bfd7ff691 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:00.978929 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574a6de-9f63-4f68-ae92-4234f5c6c366 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:00.979472 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574a6de-9f63-4f68-ae92-4234f5c6c366 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:00.979472 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574a6de-9f63-4f68-ae92-4234f5c6c366 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:00.980852 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 557/1131] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:31:00.987351 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f7571-708f-47e3-a376-79157a84a660 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:00.987829 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f7571-708f-47e3-a376-79157a84a660 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:00.988208 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f7571-708f-47e3-a376-79157a84a660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:01.006092 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-648f7571-708f-47e3-a376-79157a84a660 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:31:01.007273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-648f7571-708f-47e3-a376-79157a84a660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:31:01.073641 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 575/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:31:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:31:01.098590 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574a6de-9f63-4f68-ae92-4234f5c6c366 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:01.126736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:01.205185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574a6de-9f63-4f68-ae92-4234f5c6c366 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:01.240157 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fd4ad-a92e-442d-985f-71f5f3ca4336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:01.240946 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fd4ad-a92e-442d-985f-71f5f3ca4336 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:01.241228 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fd4ad-a92e-442d-985f-71f5f3ca4336 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:01.241536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fd4ad-a92e-442d-985f-71f5f3ca4336 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:01.242699 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fd4ad-a92e-442d-985f-71f5f3ca4336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:01.244196 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fd4ad-a92e-442d-985f-71f5f3ca4336 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:01.246062 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 558/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:31:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:01.252575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f7571-708f-47e3-a376-79157a84a660 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:01.298234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:01.353677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f7571-708f-47e3-a376-79157a84a660 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:01.390379 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec4093-2811-4c10-848a-8465033434f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:01.391007 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec4093-2811-4c10-848a-8465033434f6 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:01.391308 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec4093-2811-4c10-848a-8465033434f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:01.391648 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec4093-2811-4c10-848a-8465033434f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:01.392355 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec4093-2811-4c10-848a-8465033434f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:01.393823 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec4093-2811-4c10-848a-8465033434f6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:01.683092 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 576/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 16:31:01 2022] POST /identity/v3/projects => generated 311 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:31:03.990283 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d7803-0600-45be-a4af-6b8e94e18cd5 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:03.990816 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d7803-0600-45be-a4af-6b8e94e18cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:03.990816 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d7803-0600-45be-a4af-6b8e94e18cd5 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:03.992231 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 559/1135] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:31:03.997660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab05b3-97fd-45b8-a3e4-cc9cfcff779c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:03.998095 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab05b3-97fd-45b8-a3e4-cc9cfcff779c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:03.998231 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab05b3-97fd-45b8-a3e4-cc9cfcff779c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:04.017219 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-adab05b3-97fd-45b8-a3e4-cc9cfcff779c None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:31:04.018478 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-adab05b3-97fd-45b8-a3e4-cc9cfcff779c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:31:04.094691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 577/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:31:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:31:04.120573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d7803-0600-45be-a4af-6b8e94e18cd5 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:04.219402 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:04.227115 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d7803-0600-45be-a4af-6b8e94e18cd5 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:04.261839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f427a40-0b92-4bfb-ac62-b47f5a3bd954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:04.262555 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f427a40-0b92-4bfb-ac62-b47f5a3bd954 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:04.262837 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f427a40-0b92-4bfb-ac62-b47f5a3bd954 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:04.263118 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f427a40-0b92-4bfb-ac62-b47f5a3bd954 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:04.264277 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f427a40-0b92-4bfb-ac62-b47f5a3bd954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:04.265743 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f427a40-0b92-4bfb-ac62-b47f5a3bd954 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:04.267359 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 560/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:31:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:04.273391 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab05b3-97fd-45b8-a3e4-cc9cfcff779c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:04.301535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:04.374383 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab05b3-97fd-45b8-a3e4-cc9cfcff779c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:04.410350 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56958e2c-38f4-48f9-9edf-d696414310e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:04.411029 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56958e2c-38f4-48f9-9edf-d696414310e2 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:04.411311 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56958e2c-38f4-48f9-9edf-d696414310e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:04.411584 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56958e2c-38f4-48f9-9edf-d696414310e2 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:04.412292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56958e2c-38f4-48f9-9edf-d696414310e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:04.413782 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56958e2c-38f4-48f9-9edf-d696414310e2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:04.527334 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 578/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 16:31:04 2022] POST /identity/v3/users => generated 286 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:31:06.855515 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc8668-690f-4e8c-8c54-44f529e237bb None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:06.856112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc8668-690f-4e8c-8c54-44f529e237bb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:06.856112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc8668-690f-4e8c-8c54-44f529e237bb None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:06.857689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 561/1139] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:31:06.865446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf9cd9-5d43-4a90-b520-013b49f8fc0e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:06.865976 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf9cd9-5d43-4a90-b520-013b49f8fc0e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:06.866327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf9cd9-5d43-4a90-b520-013b49f8fc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:06.893114 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4aaf9cd9-5d43-4a90-b520-013b49f8fc0e None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:31:06.894912 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4aaf9cd9-5d43-4a90-b520-013b49f8fc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:31:06.970437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 579/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:31:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:31:06.994245 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc8668-690f-4e8c-8c54-44f529e237bb None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:07.105493 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc8668-690f-4e8c-8c54-44f529e237bb None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:07.139912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6cc08-aeae-43f7-8240-4e439b942493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:07.140614 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6cc08-aeae-43f7-8240-4e439b942493 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:07.140892 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6cc08-aeae-43f7-8240-4e439b942493 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:07.141161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6cc08-aeae-43f7-8240-4e439b942493 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:07.151194 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6cc08-aeae-43f7-8240-4e439b942493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:31:07.158779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-30d6cc08-aeae-43f7-8240-4e439b942493 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:31:07.158779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:31:07.158779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:31:07.158779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:31:07.158779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:31:07.158779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:31:07.158779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:31:07.158779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:31:07.158779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:31:07.158779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:31:07.158779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:31:07.158779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:31:07.158779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:31:07.158779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:31:07.158779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:31:07.158779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:31:07.159910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:31:07.159910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:31:07.159910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:31:07.159910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:31:07.159910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:31:07.159910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:31:07.159910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:31:07.159910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:31:07.159910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:31:07.159910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:31:07.159910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:31:07.159910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:31:07.159910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:31:07.159910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:31:07.159910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:31:07.159910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:31:07.160808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:31:07.160808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:31:07.160808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:31:07.160808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:31:07.160808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:31:07.160808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:31:07.160808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:31:07.160808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:31:07.160808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:31:07.160808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:31:07.160808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:31:07.160808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:31:07.160808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 562/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:31:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:31:07.166052 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf9cd9-5d43-4a90-b520-013b49f8fc0e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:07.180430 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:07.264670 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf9cd9-5d43-4a90-b520-013b49f8fc0e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:07.298764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041255e2-c485-40d0-bd50-f297245eb06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:07.299426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041255e2-c485-40d0-bd50-f297245eb06f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:07.299707 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041255e2-c485-40d0-bd50-f297245eb06f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:07.299982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041255e2-c485-40d0-bd50-f297245eb06f None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:07.300714 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041255e2-c485-40d0-bd50-f297245eb06f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:31:07.301017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041255e2-c485-40d0-bd50-f297245eb06f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:07.302419 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041255e2-c485-40d0-bd50-f297245eb06f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:07.310866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 580/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:31:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:07.317721 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6cc08-aeae-43f7-8240-4e439b942493 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:07.343345 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:07.419205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6cc08-aeae-43f7-8240-4e439b942493 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:07.453243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c6472-de5e-4963-bf8d-50eace603815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:07.454143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c6472-de5e-4963-bf8d-50eace603815 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:07.454417 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c6472-de5e-4963-bf8d-50eace603815 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:07.454684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c6472-de5e-4963-bf8d-50eace603815 None admin] PATH_INFO: `/v3/users/fa8f230c3bb841a2b8e1bad921ef3882` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:07.467884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c6472-de5e-4963-bf8d-50eace603815 None admin] RBAC: Authorizing `identity:get_user(user_id=fa8f230c3bb841a2b8e1bad921ef3882)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:07.469401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c6472-de5e-4963-bf8d-50eace603815 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:07.471364 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 563/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:31:07 2022] GET /identity/v3/users/fa8f230c3bb841a2b8e1bad921ef3882 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:07.477297 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041255e2-c485-40d0-bd50-f297245eb06f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:07.554345 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:07.579792 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041255e2-c485-40d0-bd50-f297245eb06f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:07.613703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2efc4-2d9a-4bb8-972b-3b817f886e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:07.614354 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2efc4-2d9a-4bb8-972b-3b817f886e0a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:07.614640 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2efc4-2d9a-4bb8-972b-3b817f886e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:07.614914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2efc4-2d9a-4bb8-972b-3b817f886e0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:07.682093 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2efc4-2d9a-4bb8-972b-3b817f886e0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:07.683453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2efc4-2d9a-4bb8-972b-3b817f886e0a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:07.759008 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:07.783848 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 581/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:31:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:31:07.789842 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c6472-de5e-4963-bf8d-50eace603815 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:07.873357 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:07.892836 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c6472-de5e-4963-bf8d-50eace603815 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:07.927945 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656184a2-2cf8-4765-8da3-625d216249d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:07.928822 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656184a2-2cf8-4765-8da3-625d216249d3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:07.929105 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656184a2-2cf8-4765-8da3-625d216249d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:07.929416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656184a2-2cf8-4765-8da3-625d216249d3 None admin] PATH_INFO: `/v3/projects/f2a07276e9ec4293ba8268853c7199ac` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:07.930823 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656184a2-2cf8-4765-8da3-625d216249d3 None admin] RBAC: Authorizing `identity:get_project(project_id=f2a07276e9ec4293ba8268853c7199ac)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:07.932862 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656184a2-2cf8-4765-8da3-625d216249d3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:07.935565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 564/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:31:07 2022] GET /identity/v3/projects/f2a07276e9ec4293ba8268853c7199ac => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:07.941377 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2efc4-2d9a-4bb8-972b-3b817f886e0a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:08.042374 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2efc4-2d9a-4bb8-972b-3b817f886e0a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:08.079513 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45601908-5206-4af5-a260-8bb12cbf9071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:08.080238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45601908-5206-4af5-a260-8bb12cbf9071 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:08.080464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45601908-5206-4af5-a260-8bb12cbf9071 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:08.080737 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45601908-5206-4af5-a260-8bb12cbf9071 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:08.081604 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45601908-5206-4af5-a260-8bb12cbf9071 None admin] RBAC: Adding query filter params (role.id=796e313fa8794ac885ccf6300d09332a, scope.project.id=f2a07276e9ec4293ba8268853c7199ac, user.id=fa8f230c3bb841a2b8e1bad921ef3882) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:31:08.081966 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45601908-5206-4af5-a260-8bb12cbf9071 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:08.083355 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45601908-5206-4af5-a260-8bb12cbf9071 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:08.089303 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 582/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:31:07 2022] GET /identity/v3/role_assignments?user.id=fa8f230c3bb841a2b8e1bad921ef3882&scope.project.id=f2a07276e9ec4293ba8268853c7199ac&role.id=796e313fa8794ac885ccf6300d09332a => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:10.329649 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da1847-ed52-4182-9e8e-08546bfba9af None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:10.330171 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da1847-ed52-4182-9e8e-08546bfba9af None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:10.330171 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da1847-ed52-4182-9e8e-08546bfba9af None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:10.331829 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 565/1147] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:31:10.337765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5297b-4c3a-4eb1-b824-d0ea110294b2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:10.338204 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5297b-4c3a-4eb1-b824-d0ea110294b2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:10.338325 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5297b-4c3a-4eb1-b824-d0ea110294b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:10.356263 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-20f5297b-4c3a-4eb1-b824-d0ea110294b2 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:31:10.357593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-20f5297b-4c3a-4eb1-b824-d0ea110294b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:31:10.386900 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:10.425646 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 583/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:31:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:31:10.448418 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da1847-ed52-4182-9e8e-08546bfba9af None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:10.553658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da1847-ed52-4182-9e8e-08546bfba9af None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:10.587626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e7592-5c1c-4ff4-aa12-b7e8774ffec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:10.588348 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e7592-5c1c-4ff4-aa12-b7e8774ffec7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:10.588633 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e7592-5c1c-4ff4-aa12-b7e8774ffec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:10.588911 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e7592-5c1c-4ff4-aa12-b7e8774ffec7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:10.600355 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e7592-5c1c-4ff4-aa12-b7e8774ffec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:31:10.614768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-da5e7592-5c1c-4ff4-aa12-b7e8774ffec7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:31:10.614768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:31:10.614768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:31:10.614768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:31:10.614768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:31:10.614768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:31:10.614768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:31:10.614768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:31:10.614768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:31:10.614768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:31:10.614768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:31:10.614768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:31:10.614768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:31:10.614768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:31:10.614768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:31:10.614768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:31:10.616021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:31:10.616021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:31:10.616021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:31:10.616021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:31:10.616021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:31:10.616021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:31:10.616021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:31:10.616021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:31:10.616021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:31:10.616021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:31:10.616021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:31:10.616021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:31:10.616021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:31:10.616021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:31:10.616021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:31:10.616021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:31:10.617021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:31:10.617021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:31:10.617021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:31:10.617021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:31:10.617021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:31:10.617021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:31:10.617021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:31:10.617021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:31:10.617021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:31:10.617021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:31:10.617021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:31:10.617021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:31:10.617021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 566/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:31:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:31:10.623432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5297b-4c3a-4eb1-b824-d0ea110294b2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:10.728845 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5297b-4c3a-4eb1-b824-d0ea110294b2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:10.767490 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae94da5-cd4d-4b2c-85eb-acc2b568ba7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:10.768126 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae94da5-cd4d-4b2c-85eb-acc2b568ba7a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:10.768404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae94da5-cd4d-4b2c-85eb-acc2b568ba7a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:10.768675 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae94da5-cd4d-4b2c-85eb-acc2b568ba7a None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:10.769492 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae94da5-cd4d-4b2c-85eb-acc2b568ba7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:31:10.769815 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae94da5-cd4d-4b2c-85eb-acc2b568ba7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:10.771223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae94da5-cd4d-4b2c-85eb-acc2b568ba7a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:10.779759 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 584/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:31:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:10.785793 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e7592-5c1c-4ff4-aa12-b7e8774ffec7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:10.796988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:10.887380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e7592-5c1c-4ff4-aa12-b7e8774ffec7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:10.926942 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a5a12-a7bb-406b-b0d1-551aba50cf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:10.927828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a5a12-a7bb-406b-b0d1-551aba50cf83 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:10.928109 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a5a12-a7bb-406b-b0d1-551aba50cf83 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:10.928391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a5a12-a7bb-406b-b0d1-551aba50cf83 None admin] PATH_INFO: `/v3/users/fa8f230c3bb841a2b8e1bad921ef3882` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:10.929637 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a5a12-a7bb-406b-b0d1-551aba50cf83 None admin] RBAC: Authorizing `identity:get_user(user_id=fa8f230c3bb841a2b8e1bad921ef3882)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:10.931085 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a5a12-a7bb-406b-b0d1-551aba50cf83 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:10.932731 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 567/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:31:10 2022] GET /identity/v3/users/fa8f230c3bb841a2b8e1bad921ef3882 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:10.939057 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae94da5-cd4d-4b2c-85eb-acc2b568ba7a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:10.971784 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:11.042577 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae94da5-cd4d-4b2c-85eb-acc2b568ba7a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:11.076531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5883c-4501-4cd3-9295-808d60383525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:11.077425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5883c-4501-4cd3-9295-808d60383525 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:11.077706 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5883c-4501-4cd3-9295-808d60383525 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:11.077977 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5883c-4501-4cd3-9295-808d60383525 None admin] PATH_INFO: `/v3/projects/f2a07276e9ec4293ba8268853c7199ac` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:11.079141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5883c-4501-4cd3-9295-808d60383525 None admin] RBAC: Authorizing `identity:get_project(project_id=f2a07276e9ec4293ba8268853c7199ac)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:11.080570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5883c-4501-4cd3-9295-808d60383525 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:11.082307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 585/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:31:10 2022] GET /identity/v3/projects/f2a07276e9ec4293ba8268853c7199ac => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:11.088242 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a5a12-a7bb-406b-b0d1-551aba50cf83 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:11.167689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:11.192407 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a5a12-a7bb-406b-b0d1-551aba50cf83 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:11.227147 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f58a27-9d07-424c-977e-50f0a72380c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:11.228101 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f58a27-9d07-424c-977e-50f0a72380c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:11.228379 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f58a27-9d07-424c-977e-50f0a72380c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:11.228651 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f58a27-9d07-424c-977e-50f0a72380c1 None admin] PATH_INFO: `/v3/projects/f2a07276e9ec4293ba8268853c7199ac/users/fa8f230c3bb841a2b8e1bad921ef3882/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:11.230673 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f58a27-9d07-424c-977e-50f0a72380c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2a07276e9ec4293ba8268853c7199ac, user_id=fa8f230c3bb841a2b8e1bad921ef3882, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:11.232653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f58a27-9d07-424c-977e-50f0a72380c1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:11.366788 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 568/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:31:11 2022] PUT /identity/v3/projects/f2a07276e9ec4293ba8268853c7199ac/users/fa8f230c3bb841a2b8e1bad921ef3882/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:31:13.578557 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879339d-47da-49a6-9991-76f8521dddfb None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:13.579229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879339d-47da-49a6-9991-76f8521dddfb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:13.579229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879339d-47da-49a6-9991-76f8521dddfb None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:13.580479 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 586/1154] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:31:13.585771 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed952666-21ea-40f9-a3fe-213db17ca130 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:13.586215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed952666-21ea-40f9-a3fe-213db17ca130 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:13.586347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed952666-21ea-40f9-a3fe-213db17ca130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:13.608483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ed952666-21ea-40f9-a3fe-213db17ca130 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:31:13.610486 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ed952666-21ea-40f9-a3fe-213db17ca130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:31:13.707141 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 569/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:31:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:31:13.733655 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879339d-47da-49a6-9991-76f8521dddfb None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:13.836260 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:13.841646 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879339d-47da-49a6-9991-76f8521dddfb None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:13.878149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c5dda-8d2f-469c-a05a-43ac015922c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:13.878971 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c5dda-8d2f-469c-a05a-43ac015922c3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:13.879259 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c5dda-8d2f-469c-a05a-43ac015922c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:13.879771 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c5dda-8d2f-469c-a05a-43ac015922c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:13.890625 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c5dda-8d2f-469c-a05a-43ac015922c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:31:13.898505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-9c3c5dda-8d2f-469c-a05a-43ac015922c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:31:13.898505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:31:13.898505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:31:13.898505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:31:13.898505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:31:13.898505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:31:13.898505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:31:13.898505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:31:13.898505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:31:13.898505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:31:13.898505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:31:13.898505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:31:13.898505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:31:13.898505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:31:13.898505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:31:13.898505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:31:13.899702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:31:13.899702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:31:13.899702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:31:13.899702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:31:13.899702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:31:13.899702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:31:13.899702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:31:13.899702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:31:13.899702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:31:13.899702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:31:13.899702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:31:13.899702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:31:13.899702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:31:13.899702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:31:13.899702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:31:13.899702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:31:13.900668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:31:13.900668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:31:13.900668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:31:13.900668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:31:13.900668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:31:13.900668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:31:13.900668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:31:13.900668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:31:13.900668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:31:13.900668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:31:13.900668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:31:13.900668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:31:13.900668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 587/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:31:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:31:13.906749 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed952666-21ea-40f9-a3fe-213db17ca130 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:13.974172 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:14.010307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed952666-21ea-40f9-a3fe-213db17ca130 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:14.045420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c24ebc-938f-45e9-90be-9e5dd9e866c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:14.046086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c24ebc-938f-45e9-90be-9e5dd9e866c5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:14.046371 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c24ebc-938f-45e9-90be-9e5dd9e866c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:14.046799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c24ebc-938f-45e9-90be-9e5dd9e866c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:14.047534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c24ebc-938f-45e9-90be-9e5dd9e866c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:31:14.047841 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c24ebc-938f-45e9-90be-9e5dd9e866c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:14.049214 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c24ebc-938f-45e9-90be-9e5dd9e866c5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:14.057539 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 570/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:31:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:14.063567 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c5dda-8d2f-469c-a05a-43ac015922c3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:14.164668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c5dda-8d2f-469c-a05a-43ac015922c3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:14.197341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb0734-43d2-4d42-8302-9d5ce916f2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:14.198212 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb0734-43d2-4d42-8302-9d5ce916f2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:14.198496 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb0734-43d2-4d42-8302-9d5ce916f2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:14.198770 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb0734-43d2-4d42-8302-9d5ce916f2f7 None admin] PATH_INFO: `/v3/users/fa8f230c3bb841a2b8e1bad921ef3882` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:14.200026 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb0734-43d2-4d42-8302-9d5ce916f2f7 None admin] RBAC: Authorizing `identity:get_user(user_id=fa8f230c3bb841a2b8e1bad921ef3882)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:14.202109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb0734-43d2-4d42-8302-9d5ce916f2f7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:14.203735 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 588/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:31:14 2022] GET /identity/v3/users/fa8f230c3bb841a2b8e1bad921ef3882 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:14.209554 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c24ebc-938f-45e9-90be-9e5dd9e866c5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:14.310987 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c24ebc-938f-45e9-90be-9e5dd9e866c5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:14.339099 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:14.347622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135be71-5576-4e8c-99b8-f3d4eab220c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:14.356913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135be71-5576-4e8c-99b8-f3d4eab220c2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:14.356913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135be71-5576-4e8c-99b8-f3d4eab220c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:14.356913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135be71-5576-4e8c-99b8-f3d4eab220c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:14.415135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135be71-5576-4e8c-99b8-f3d4eab220c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:14.416585 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135be71-5576-4e8c-99b8-f3d4eab220c2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:14.512370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 571/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:31:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:31:14.519037 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb0734-43d2-4d42-8302-9d5ce916f2f7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:14.548354 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:14.625465 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb0734-43d2-4d42-8302-9d5ce916f2f7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:14.658810 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972c659-41e9-4e01-967c-5734654e071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:14.659676 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972c659-41e9-4e01-967c-5734654e071b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:14.659960 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972c659-41e9-4e01-967c-5734654e071b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:14.660236 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972c659-41e9-4e01-967c-5734654e071b None admin] PATH_INFO: `/v3/projects/f2a07276e9ec4293ba8268853c7199ac` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:14.661435 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972c659-41e9-4e01-967c-5734654e071b None admin] RBAC: Authorizing `identity:get_project(project_id=f2a07276e9ec4293ba8268853c7199ac)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:14.662927 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972c659-41e9-4e01-967c-5734654e071b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:14.664635 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 589/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:31:14 2022] GET /identity/v3/projects/f2a07276e9ec4293ba8268853c7199ac => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:14.671709 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135be71-5576-4e8c-99b8-f3d4eab220c2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:14.698526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:14.773802 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135be71-5576-4e8c-99b8-f3d4eab220c2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:14.807067 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab00649-ffb0-46ff-af26-79f0b9477095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:14.807714 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab00649-ffb0-46ff-af26-79f0b9477095 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:14.807992 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab00649-ffb0-46ff-af26-79f0b9477095 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:14.808261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab00649-ffb0-46ff-af26-79f0b9477095 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:14.809073 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab00649-ffb0-46ff-af26-79f0b9477095 None admin] RBAC: Adding query filter params (role.id=796e313fa8794ac885ccf6300d09332a, scope.project.id=f2a07276e9ec4293ba8268853c7199ac, user.id=fa8f230c3bb841a2b8e1bad921ef3882) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:31:14.809415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab00649-ffb0-46ff-af26-79f0b9477095 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:14.810841 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab00649-ffb0-46ff-af26-79f0b9477095 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:14.816506 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 572/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:31:14 2022] GET /identity/v3/role_assignments?user.id=fa8f230c3bb841a2b8e1bad921ef3882&scope.project.id=f2a07276e9ec4293ba8268853c7199ac&role.id=796e313fa8794ac885ccf6300d09332a => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:17.022677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8354f6-87e0-40ff-b6f3-70447ba6ae29 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:17.023239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8354f6-87e0-40ff-b6f3-70447ba6ae29 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:17.023239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8354f6-87e0-40ff-b6f3-70447ba6ae29 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:17.024570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 590/1162] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:31:17.029956 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09455082-f02a-4a55-b1a1-63e40bb5829d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:17.030363 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09455082-f02a-4a55-b1a1-63e40bb5829d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:17.030507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09455082-f02a-4a55-b1a1-63e40bb5829d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:17.047380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-09455082-f02a-4a55-b1a1-63e40bb5829d None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:31:17.048552 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-09455082-f02a-4a55-b1a1-63e40bb5829d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:31:17.117013 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 573/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:31:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:31:17.139461 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8354f6-87e0-40ff-b6f3-70447ba6ae29 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:17.236658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:17.243805 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8354f6-87e0-40ff-b6f3-70447ba6ae29 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:17.277611 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ad682-012e-4fbd-a9a4-dc85fcd485e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:17.278275 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ad682-012e-4fbd-a9a4-dc85fcd485e9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:17.279187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ad682-012e-4fbd-a9a4-dc85fcd485e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:17.279467 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ad682-012e-4fbd-a9a4-dc85fcd485e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:17.346722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ad682-012e-4fbd-a9a4-dc85fcd485e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:17.348161 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ad682-012e-4fbd-a9a4-dc85fcd485e9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:17.437875 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:17.445110 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 591/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:31:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:31:17.451690 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09455082-f02a-4a55-b1a1-63e40bb5829d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:17.475985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:17.549875 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09455082-f02a-4a55-b1a1-63e40bb5829d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:17.584704 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6818d-238d-4422-aaed-04ef1946a2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:17.585532 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6818d-238d-4422-aaed-04ef1946a2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:17.585858 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6818d-238d-4422-aaed-04ef1946a2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:17.586131 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6818d-238d-4422-aaed-04ef1946a2a0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:17.592703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6818d-238d-4422-aaed-04ef1946a2a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:17.594179 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6818d-238d-4422-aaed-04ef1946a2a0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:17.608334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-35b6818d-238d-4422-aaed-04ef1946a2a0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 16:31:17.608334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:31:17.608334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 26 16:31:17.608334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 26 16:31:17.608334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:31:17.608334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:31:17.608334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:31:17.608334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:31:17.608334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 26 16:31:17.608334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:31:17.608334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:31:17.608334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:31:17.608334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:31:17.608334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:31:17.608334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:31:17.608334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:31:17.608334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:31:17.609610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:31:17.609610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:31:17.609610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:31:17.609610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:31:17.609610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:31:17.609610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:31:17.609610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:31:17.609610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:31:17.609610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:31:17.609610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:31:17.609610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:31:17.609610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:31:17.609610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:31:17.609610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:31:17.609610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:31:17.609610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:31:17.610672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:31:17.610672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:31:17.610672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:31:17.610672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:31:17.610672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:31:17.610672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:31:17.610672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:31:17.610672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:31:17.610672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:31:17.610672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:31:17.610672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 26 16:31:17.610672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:31:17.610672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 16:31:17.610672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:31:17.610672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 574/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 26 16:31:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:31:17.615664 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ad682-012e-4fbd-a9a4-dc85fcd485e9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:17.714402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ad682-012e-4fbd-a9a4-dc85fcd485e9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:17.749444 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8fba4-4201-4065-8e11-09c02979eca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:17.750108 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8fba4-4201-4065-8e11-09c02979eca8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:17.750391 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8fba4-4201-4065-8e11-09c02979eca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:17.750664 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8fba4-4201-4065-8e11-09c02979eca8 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:17.751381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8fba4-4201-4065-8e11-09c02979eca8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:31:17.751688 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8fba4-4201-4065-8e11-09c02979eca8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:17.753043 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8fba4-4201-4065-8e11-09c02979eca8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:17.760094 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 592/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 26 16:31:17 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:19.992329 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f1d53-fda3-4e8e-92c1-20046e6e7972 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:19.992889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f1d53-fda3-4e8e-92c1-20046e6e7972 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:19.992889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f1d53-fda3-4e8e-92c1-20046e6e7972 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:19.994317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 575/1167] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:31:19.999709 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f927494-91ba-44b8-a2f2-c3fded6f2de3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:20.000146 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f927494-91ba-44b8-a2f2-c3fded6f2de3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:20.000248 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f927494-91ba-44b8-a2f2-c3fded6f2de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:20.018021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6f927494-91ba-44b8-a2f2-c3fded6f2de3 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:31:20.019202 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6f927494-91ba-44b8-a2f2-c3fded6f2de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:31:20.071289 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:20.085226 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 593/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:31:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:31:20.109808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f1d53-fda3-4e8e-92c1-20046e6e7972 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:20.197697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:20.216818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f1d53-fda3-4e8e-92c1-20046e6e7972 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:20.252105 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8ea2a-96c0-4acd-8046-d7c41fbc3dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:20.252686 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8ea2a-96c0-4acd-8046-d7c41fbc3dc2 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:20.252972 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8ea2a-96c0-4acd-8046-d7c41fbc3dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:20.253251 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8ea2a-96c0-4acd-8046-d7c41fbc3dc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:20.254011 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8ea2a-96c0-4acd-8046-d7c41fbc3dc2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:20.255388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8ea2a-96c0-4acd-8046-d7c41fbc3dc2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:20.350757 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 576/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Thu May 26 16:31:20 2022] POST /identity/v3/domains => generated 267 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:31:22.624468 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977027e6-0f10-4e71-b152-987f96922eee None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:22.625032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977027e6-0f10-4e71-b152-987f96922eee None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:22.625032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977027e6-0f10-4e71-b152-987f96922eee None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:22.626426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 594/1170] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:31:22.632079 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467345a9-cbe1-4d94-b99d-0b2c49055eb0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:22.632594 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467345a9-cbe1-4d94-b99d-0b2c49055eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:22.632695 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467345a9-cbe1-4d94-b99d-0b2c49055eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:22.650868 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-467345a9-cbe1-4d94-b99d-0b2c49055eb0 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:31:22.652076 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-467345a9-cbe1-4d94-b99d-0b2c49055eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:31:22.722547 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 577/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:31:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:31:22.746255 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977027e6-0f10-4e71-b152-987f96922eee None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:22.858093 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977027e6-0f10-4e71-b152-987f96922eee None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:22.896179 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba73a23-07e5-4c6d-9272-0deffa8afe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:22.897209 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba73a23-07e5-4c6d-9272-0deffa8afe57 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:22.897605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba73a23-07e5-4c6d-9272-0deffa8afe57 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:22.897927 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba73a23-07e5-4c6d-9272-0deffa8afe57 None admin] PATH_INFO: `/v3/domains/24b6b505629f48e2afac8c7b05254944` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:22.911018 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba73a23-07e5-4c6d-9272-0deffa8afe57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=24b6b505629f48e2afac8c7b05254944)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:22.912492 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba73a23-07e5-4c6d-9272-0deffa8afe57 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:22.914280 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 595/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Thu May 26 16:31:22 2022] GET /identity/v3/domains/24b6b505629f48e2afac8c7b05254944 => generated 267 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:22.920372 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467345a9-cbe1-4d94-b99d-0b2c49055eb0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:22.991018 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:23.021735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467345a9-cbe1-4d94-b99d-0b2c49055eb0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:23.055969 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f89ab-2538-4191-9550-1599b531d739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:23.056647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f89ab-2538-4191-9550-1599b531d739 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:23.057146 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f89ab-2538-4191-9550-1599b531d739 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:23.057500 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f89ab-2538-4191-9550-1599b531d739 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:23.058447 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f89ab-2538-4191-9550-1599b531d739 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:23.060908 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f89ab-2538-4191-9550-1599b531d739 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:23.277027 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 578/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 16:31:22 2022] POST /identity/v3/projects => generated 361 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:31:25.569151 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2b353-91f6-4a2d-95a5-0dd5ee7976ba None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:25.569719 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2b353-91f6-4a2d-95a5-0dd5ee7976ba None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:25.569719 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2b353-91f6-4a2d-95a5-0dd5ee7976ba None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:25.571233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 596/1174] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:31:25.577228 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a8424-c813-4f11-99d2-fcf013e16038 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:25.577710 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a8424-c813-4f11-99d2-fcf013e16038 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:25.577799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a8424-c813-4f11-99d2-fcf013e16038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:25.595180 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9a9a8424-c813-4f11-99d2-fcf013e16038 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:31:25.596654 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9a9a8424-c813-4f11-99d2-fcf013e16038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:31:25.665241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 579/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:31:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:31:25.690564 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2b353-91f6-4a2d-95a5-0dd5ee7976ba None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:25.743997 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:25.797276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2b353-91f6-4a2d-95a5-0dd5ee7976ba None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:25.832898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8697b08-83f6-457a-82a0-4d3e7e59cf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:25.833712 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8697b08-83f6-457a-82a0-4d3e7e59cf76 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:25.833994 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8697b08-83f6-457a-82a0-4d3e7e59cf76 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:25.834266 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8697b08-83f6-457a-82a0-4d3e7e59cf76 None admin] PATH_INFO: `/v3/domains/24b6b505629f48e2afac8c7b05254944` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:25.835448 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8697b08-83f6-457a-82a0-4d3e7e59cf76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=24b6b505629f48e2afac8c7b05254944)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:25.836882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8697b08-83f6-457a-82a0-4d3e7e59cf76 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:25.838628 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 597/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Thu May 26 16:31:25 2022] GET /identity/v3/domains/24b6b505629f48e2afac8c7b05254944 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:25.844474 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a8424-c813-4f11-99d2-fcf013e16038 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:25.903467 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:25.953779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a8424-c813-4f11-99d2-fcf013e16038 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:25.991172 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b860e-8e33-48d9-9cb5-74adf0b92964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:25.991853 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b860e-8e33-48d9-9cb5-74adf0b92964 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:25.992138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b860e-8e33-48d9-9cb5-74adf0b92964 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:25.992412 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b860e-8e33-48d9-9cb5-74adf0b92964 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:25.993162 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b860e-8e33-48d9-9cb5-74adf0b92964 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:25.995022 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b860e-8e33-48d9-9cb5-74adf0b92964 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:26.167536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 580/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 16:31:25 2022] POST /identity/v3/users => generated 311 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:31:28.507627 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b449d-6d56-4a92-affe-e9bb76f94513 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:28.508185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b449d-6d56-4a92-affe-e9bb76f94513 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:28.508185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b449d-6d56-4a92-affe-e9bb76f94513 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:28.509702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 598/1178] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:31:28.515693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e19f54-7bd2-4abf-8437-c8e907085fe7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:28.516099 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e19f54-7bd2-4abf-8437-c8e907085fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:28.516256 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e19f54-7bd2-4abf-8437-c8e907085fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:28.539940 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b3e19f54-7bd2-4abf-8437-c8e907085fe7 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:31:28.541954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b3e19f54-7bd2-4abf-8437-c8e907085fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:31:28.630547 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 581/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:31:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:31:28.654792 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b449d-6d56-4a92-affe-e9bb76f94513 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:28.780296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b449d-6d56-4a92-affe-e9bb76f94513 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:28.805428 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:28.830340 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8ec7b-c6f4-4296-a7ca-2a118aca34f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:28.831554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8ec7b-c6f4-4296-a7ca-2a118aca34f2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:28.831993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8ec7b-c6f4-4296-a7ca-2a118aca34f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:28.832422 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8ec7b-c6f4-4296-a7ca-2a118aca34f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:28.847321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8ec7b-c6f4-4296-a7ca-2a118aca34f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:31:28.855962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-f5a8ec7b-c6f4-4296-a7ca-2a118aca34f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:31:28.855962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:31:28.855962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:31:28.855962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:31:28.855962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:31:28.855962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:31:28.855962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:31:28.855962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:31:28.855962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:31:28.855962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:31:28.855962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:31:28.855962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:31:28.855962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:31:28.855962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:31:28.855962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:31:28.855962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:31:28.857703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:31:28.857703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:31:28.857703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:31:28.857703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:31:28.857703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:31:28.857703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:31:28.857703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:31:28.857703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:31:28.857703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:31:28.857703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:31:28.857703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:31:28.857703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:31:28.857703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:31:28.857703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:31:28.857703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:31:28.857703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:31:28.858793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:31:28.858793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:31:28.858793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:31:28.858793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:31:28.858793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:31:28.858793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:31:28.858793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:31:28.858793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:31:28.858793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:31:28.858793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:31:28.858793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:31:28.858793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:31:28.858793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 599/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:31:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:31:28.864374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e19f54-7bd2-4abf-8437-c8e907085fe7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:28.909483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:28.970824 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e19f54-7bd2-4abf-8437-c8e907085fe7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:29.006019 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd65a8-9237-4b53-aa53-d791e3125650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:29.006682 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd65a8-9237-4b53-aa53-d791e3125650 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:29.006960 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd65a8-9237-4b53-aa53-d791e3125650 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:29.007239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd65a8-9237-4b53-aa53-d791e3125650 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:29.008025 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd65a8-9237-4b53-aa53-d791e3125650 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:31:29.008287 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd65a8-9237-4b53-aa53-d791e3125650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:29.009706 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd65a8-9237-4b53-aa53-d791e3125650 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:29.018655 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 582/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:31:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:29.024493 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8ec7b-c6f4-4296-a7ca-2a118aca34f2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:29.127457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8ec7b-c6f4-4296-a7ca-2a118aca34f2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:29.164048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2914c-49d2-4dca-9a7f-eac2ed3412ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:29.164933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2914c-49d2-4dca-9a7f-eac2ed3412ad None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:29.165219 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2914c-49d2-4dca-9a7f-eac2ed3412ad None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:29.165530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2914c-49d2-4dca-9a7f-eac2ed3412ad None admin] PATH_INFO: `/v3/users/e236b545de204baf98c35d1e2d220f08` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:29.179698 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2914c-49d2-4dca-9a7f-eac2ed3412ad None admin] RBAC: Authorizing `identity:get_user(user_id=e236b545de204baf98c35d1e2d220f08)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:29.181222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2914c-49d2-4dca-9a7f-eac2ed3412ad None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:29.183180 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 600/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:31:29 2022] GET /identity/v3/users/e236b545de204baf98c35d1e2d220f08 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:29.189290 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd65a8-9237-4b53-aa53-d791e3125650 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:29.299682 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd65a8-9237-4b53-aa53-d791e3125650 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:29.301319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:29.364801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bfd1b-ea4e-4f7f-bed5-e21173ca5c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:29.364801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bfd1b-ea4e-4f7f-bed5-e21173ca5c44 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:29.364801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bfd1b-ea4e-4f7f-bed5-e21173ca5c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:29.364801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bfd1b-ea4e-4f7f-bed5-e21173ca5c44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:29.413987 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26bfd1b-ea4e-4f7f-bed5-e21173ca5c44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:29.415434 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26bfd1b-ea4e-4f7f-bed5-e21173ca5c44 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:29.530954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 583/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:31:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:31:29.537235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2914c-49d2-4dca-9a7f-eac2ed3412ad None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:29.572217 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:29.643286 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2914c-49d2-4dca-9a7f-eac2ed3412ad None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:29.676479 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0dbdc-e72c-402a-8f2f-893cc0ed3b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:29.677396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0dbdc-e72c-402a-8f2f-893cc0ed3b94 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:29.677679 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0dbdc-e72c-402a-8f2f-893cc0ed3b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:29.677952 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0dbdc-e72c-402a-8f2f-893cc0ed3b94 None admin] PATH_INFO: `/v3/projects/9749e7804ce14ef192cc59411b97f031` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:29.679131 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0dbdc-e72c-402a-8f2f-893cc0ed3b94 None admin] RBAC: Authorizing `identity:get_project(project_id=9749e7804ce14ef192cc59411b97f031)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:29.680565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0dbdc-e72c-402a-8f2f-893cc0ed3b94 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:29.682321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 601/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:31:29 2022] GET /identity/v3/projects/9749e7804ce14ef192cc59411b97f031 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:31:29.688984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bfd1b-ea4e-4f7f-bed5-e21173ca5c44 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:29.691196 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:29.792825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bfd1b-ea4e-4f7f-bed5-e21173ca5c44 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:29.827287 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede5e5b-c93d-4e3e-abc9-9aef95f493d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:29.827935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede5e5b-c93d-4e3e-abc9-9aef95f493d1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:29.828218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede5e5b-c93d-4e3e-abc9-9aef95f493d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:29.828488 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede5e5b-c93d-4e3e-abc9-9aef95f493d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:29.829328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede5e5b-c93d-4e3e-abc9-9aef95f493d1 None admin] RBAC: Adding query filter params (role.id=796e313fa8794ac885ccf6300d09332a, scope.project.id=9749e7804ce14ef192cc59411b97f031, user.id=e236b545de204baf98c35d1e2d220f08) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:31:29.829642 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede5e5b-c93d-4e3e-abc9-9aef95f493d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:29.831058 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede5e5b-c93d-4e3e-abc9-9aef95f493d1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:29.836677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 584/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:31:29 2022] GET /identity/v3/role_assignments?user.id=e236b545de204baf98c35d1e2d220f08&scope.project.id=9749e7804ce14ef192cc59411b97f031&role.id=796e313fa8794ac885ccf6300d09332a => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:32.057784 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f100d-34a9-4a3f-912d-f0e03ea7eab7 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:32.058323 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f100d-34a9-4a3f-912d-f0e03ea7eab7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:32.058323 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f100d-34a9-4a3f-912d-f0e03ea7eab7 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:32.059676 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 602/1186] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:31:32.065431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8ce3c-0592-4c10-9587-4c95dec466d2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:32.065850 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8ce3c-0592-4c10-9587-4c95dec466d2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:32.066004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8ce3c-0592-4c10-9587-4c95dec466d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:32.083068 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-46e8ce3c-0592-4c10-9587-4c95dec466d2 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:31:32.084243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-46e8ce3c-0592-4c10-9587-4c95dec466d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:31:32.143693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:32.151234 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 585/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:31:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:31:32.174810 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f100d-34a9-4a3f-912d-f0e03ea7eab7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:32.277821 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f100d-34a9-4a3f-912d-f0e03ea7eab7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:32.279394 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:32.320150 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4f463-49d7-4228-a22a-7f922d03d1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:32.320889 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4f463-49d7-4228-a22a-7f922d03d1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:32.321169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4f463-49d7-4228-a22a-7f922d03d1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:32.321472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4f463-49d7-4228-a22a-7f922d03d1d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:32.332663 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4f463-49d7-4228-a22a-7f922d03d1d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:31:32.341361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-c3f4f463-49d7-4228-a22a-7f922d03d1d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:31:32.341361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:31:32.341361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:31:32.341361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:31:32.341361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:31:32.341361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:31:32.341361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:31:32.341361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:31:32.341361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:31:32.341361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:31:32.341361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:31:32.341361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:31:32.341361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:31:32.341361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:31:32.341361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:31:32.341361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:31:32.342511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:31:32.342511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:31:32.342511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:31:32.342511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:31:32.342511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:31:32.342511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:31:32.342511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:31:32.342511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:31:32.342511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:31:32.342511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:31:32.342511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:31:32.342511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:31:32.342511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:31:32.342511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:31:32.342511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:31:32.342511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:31:32.343423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:31:32.343423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:31:32.343423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:31:32.343423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:31:32.343423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:31:32.343423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:31:32.343423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:31:32.343423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:31:32.343423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:31:32.343423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:31:32.343423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:31:32.343423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:31:32.343423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 603/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:31:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:31:32.349066 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8ce3c-0592-4c10-9587-4c95dec466d2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:32.453840 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8ce3c-0592-4c10-9587-4c95dec466d2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:32.499271 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d101cb-7278-47fb-88fb-69f4e705865d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:32.499957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d101cb-7278-47fb-88fb-69f4e705865d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:32.500235 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d101cb-7278-47fb-88fb-69f4e705865d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:32.500510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d101cb-7278-47fb-88fb-69f4e705865d None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:32.501283 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d101cb-7278-47fb-88fb-69f4e705865d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:31:32.501587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d101cb-7278-47fb-88fb-69f4e705865d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:32.502979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d101cb-7278-47fb-88fb-69f4e705865d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:32.511799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 586/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:31:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:32.518372 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4f463-49d7-4228-a22a-7f922d03d1d0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:32.623487 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4f463-49d7-4228-a22a-7f922d03d1d0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:32.659668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04d0bf-0537-43fc-af45-510de8522f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:32.660867 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04d0bf-0537-43fc-af45-510de8522f36 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:32.661281 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04d0bf-0537-43fc-af45-510de8522f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:32.661691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04d0bf-0537-43fc-af45-510de8522f36 None admin] PATH_INFO: `/v3/users/e236b545de204baf98c35d1e2d220f08` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:32.663352 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04d0bf-0537-43fc-af45-510de8522f36 None admin] RBAC: Authorizing `identity:get_user(user_id=e236b545de204baf98c35d1e2d220f08)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:32.665382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04d0bf-0537-43fc-af45-510de8522f36 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:32.667915 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 604/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:31:32 2022] GET /identity/v3/users/e236b545de204baf98c35d1e2d220f08 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:32.673715 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d101cb-7278-47fb-88fb-69f4e705865d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:32.736300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:32.780283 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d101cb-7278-47fb-88fb-69f4e705865d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:32.813897 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8c654-040a-4e01-91f4-b9ce35ddfc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:32.814785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8c654-040a-4e01-91f4-b9ce35ddfc38 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:32.815061 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8c654-040a-4e01-91f4-b9ce35ddfc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:32.815341 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8c654-040a-4e01-91f4-b9ce35ddfc38 None admin] PATH_INFO: `/v3/projects/9749e7804ce14ef192cc59411b97f031` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:32.816517 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8c654-040a-4e01-91f4-b9ce35ddfc38 None admin] RBAC: Authorizing `identity:get_project(project_id=9749e7804ce14ef192cc59411b97f031)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:32.817993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8c654-040a-4e01-91f4-b9ce35ddfc38 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:32.819700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 587/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:31:32 2022] GET /identity/v3/projects/9749e7804ce14ef192cc59411b97f031 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:32.826067 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04d0bf-0537-43fc-af45-510de8522f36 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:32.858315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:32.930622 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04d0bf-0537-43fc-af45-510de8522f36 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:32.965447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df704ea-c278-41b8-9f2c-9fb9edb09372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:32.966342 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df704ea-c278-41b8-9f2c-9fb9edb09372 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:32.966623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df704ea-c278-41b8-9f2c-9fb9edb09372 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:32.966898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df704ea-c278-41b8-9f2c-9fb9edb09372 None admin] PATH_INFO: `/v3/projects/9749e7804ce14ef192cc59411b97f031/users/e236b545de204baf98c35d1e2d220f08/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:32.969070 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df704ea-c278-41b8-9f2c-9fb9edb09372 None admin] RBAC: Authorizing `identity:create_grant(project_id=9749e7804ce14ef192cc59411b97f031, user_id=e236b545de204baf98c35d1e2d220f08, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:32.970818 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df704ea-c278-41b8-9f2c-9fb9edb09372 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:33.155203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 605/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:31:32 2022] PUT /identity/v3/projects/9749e7804ce14ef192cc59411b97f031/users/e236b545de204baf98c35d1e2d220f08/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:31:35.412085 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbda36-2519-4f32-8ba9-9979edf76dba None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:35.412589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbda36-2519-4f32-8ba9-9979edf76dba None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:35.412589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbda36-2519-4f32-8ba9-9979edf76dba None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:35.414005 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 588/1193] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:31:35.420654 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b1e68-fcb2-42ec-8d1d-cd162d17c05f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:35.421240 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b1e68-fcb2-42ec-8d1d-cd162d17c05f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:35.421240 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b1e68-fcb2-42ec-8d1d-cd162d17c05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:35.439233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-882b1e68-fcb2-42ec-8d1d-cd162d17c05f None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:31:35.440425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-882b1e68-fcb2-42ec-8d1d-cd162d17c05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:31:35.514642 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 606/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:31:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:31:35.538382 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dbda36-2519-4f32-8ba9-9979edf76dba None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:35.638712 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dbda36-2519-4f32-8ba9-9979edf76dba None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:35.666198 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:35.675409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bc758-e3e9-465c-b3de-26fbc5fbab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:35.676202 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bc758-e3e9-465c-b3de-26fbc5fbab04 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:35.676483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bc758-e3e9-465c-b3de-26fbc5fbab04 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:35.676755 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bc758-e3e9-465c-b3de-26fbc5fbab04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:35.686917 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bc758-e3e9-465c-b3de-26fbc5fbab04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:31:35.694676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-190bc758-e3e9-465c-b3de-26fbc5fbab04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:31:35.694676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:31:35.694676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:31:35.694676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:31:35.694676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:31:35.694676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:31:35.694676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:31:35.694676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:31:35.694676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:31:35.694676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:31:35.694676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:31:35.694676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:31:35.694676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:31:35.694676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:31:35.694676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:31:35.694676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:31:35.695839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:31:35.695839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:31:35.695839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:31:35.695839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:31:35.695839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:31:35.695839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:31:35.695839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:31:35.695839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:31:35.695839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:31:35.695839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:31:35.695839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:31:35.695839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:31:35.695839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:31:35.695839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:31:35.695839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:31:35.695839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:31:35.696913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:31:35.696913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:31:35.696913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:31:35.696913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:31:35.696913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:31:35.696913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:31:35.696913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:31:35.696913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:31:35.696913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:31:35.696913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:31:35.696913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:31:35.696913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:31:35.696913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 589/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:31:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:31:35.702035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b1e68-fcb2-42ec-8d1d-cd162d17c05f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:35.723303 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:35.801185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b1e68-fcb2-42ec-8d1d-cd162d17c05f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:35.834872 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b18a5e-0417-405d-9841-bfc664ad4abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:35.835538 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b18a5e-0417-405d-9841-bfc664ad4abb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:35.835823 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b18a5e-0417-405d-9841-bfc664ad4abb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:35.836099 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b18a5e-0417-405d-9841-bfc664ad4abb None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:35.836871 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b18a5e-0417-405d-9841-bfc664ad4abb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:31:35.837248 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b18a5e-0417-405d-9841-bfc664ad4abb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:35.838617 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b18a5e-0417-405d-9841-bfc664ad4abb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:35.847677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 607/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:31:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:35.853608 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bc758-e3e9-465c-b3de-26fbc5fbab04 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:35.975320 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bc758-e3e9-465c-b3de-26fbc5fbab04 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:36.009519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec43647-9685-4902-a788-ee61e2b05cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:36.010452 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec43647-9685-4902-a788-ee61e2b05cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:36.010741 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec43647-9685-4902-a788-ee61e2b05cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:36.011021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec43647-9685-4902-a788-ee61e2b05cb0 None admin] PATH_INFO: `/v3/users/e236b545de204baf98c35d1e2d220f08` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:36.012734 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec43647-9685-4902-a788-ee61e2b05cb0 None admin] RBAC: Authorizing `identity:get_user(user_id=e236b545de204baf98c35d1e2d220f08)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:36.014200 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec43647-9685-4902-a788-ee61e2b05cb0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:36.015904 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 590/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 16:31:35 2022] GET /identity/v3/users/e236b545de204baf98c35d1e2d220f08 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:36.021906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b18a5e-0417-405d-9841-bfc664ad4abb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:36.112880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:36.131369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b18a5e-0417-405d-9841-bfc664ad4abb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:36.164335 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e57d2f-213e-46c9-be8d-1235d3a5f971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:36.165239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e57d2f-213e-46c9-be8d-1235d3a5f971 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:36.165745 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e57d2f-213e-46c9-be8d-1235d3a5f971 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:36.166374 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e57d2f-213e-46c9-be8d-1235d3a5f971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:36.234584 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e57d2f-213e-46c9-be8d-1235d3a5f971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:36.235990 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e57d2f-213e-46c9-be8d-1235d3a5f971 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:36.313775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:36.331799 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 608/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:31:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:31:36.338145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec43647-9685-4902-a788-ee61e2b05cb0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:36.397540 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:36.442171 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec43647-9685-4902-a788-ee61e2b05cb0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:36.475838 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ea6e5-e20c-4739-ba66-9815ed667e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:36.476689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ea6e5-e20c-4739-ba66-9815ed667e6f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:36.476973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ea6e5-e20c-4739-ba66-9815ed667e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:36.477246 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ea6e5-e20c-4739-ba66-9815ed667e6f None admin] PATH_INFO: `/v3/projects/9749e7804ce14ef192cc59411b97f031` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:36.478492 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ea6e5-e20c-4739-ba66-9815ed667e6f None admin] RBAC: Authorizing `identity:get_project(project_id=9749e7804ce14ef192cc59411b97f031)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:36.479915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ea6e5-e20c-4739-ba66-9815ed667e6f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:36.482157 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 591/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 16:31:36 2022] GET /identity/v3/projects/9749e7804ce14ef192cc59411b97f031 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:36.488328 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e57d2f-213e-46c9-be8d-1235d3a5f971 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:31:36.589723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e57d2f-213e-46c9-be8d-1235d3a5f971 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:31:36.624535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b9970-d97b-4a7b-929a-58f1f3b53c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:31:36.625194 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b9970-d97b-4a7b-929a-58f1f3b53c34 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:31:36.625503 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b9970-d97b-4a7b-929a-58f1f3b53c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:31:36.625782 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b9970-d97b-4a7b-929a-58f1f3b53c34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:31:36.626644 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b9970-d97b-4a7b-929a-58f1f3b53c34 None admin] RBAC: Adding query filter params (role.id=796e313fa8794ac885ccf6300d09332a, scope.project.id=9749e7804ce14ef192cc59411b97f031, user.id=e236b545de204baf98c35d1e2d220f08) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:31:36.626959 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b9970-d97b-4a7b-929a-58f1f3b53c34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:31:36.628392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b9970-d97b-4a7b-929a-58f1f3b53c34 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:31:36.634488 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 609/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:31:36 2022] GET /identity/v3/role_assignments?user.id=e236b545de204baf98c35d1e2d220f08&scope.project.id=9749e7804ce14ef192cc59411b97f031&role.id=796e313fa8794ac885ccf6300d09332a => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:31:46.471727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=39 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:46.631720 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=77 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:11.376758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab4f54-936a-4479-b2fc-846c3c6ac981 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:11.377353 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab4f54-936a-4479-b2fc-846c3c6ac981 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:11.377353 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab4f54-936a-4479-b2fc-846c3c6ac981 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:11.378773 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 592/1201] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:33:11.385493 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691124a8-c742-4855-88f1-ed17b5a5b92f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:11.388298 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691124a8-c742-4855-88f1-ed17b5a5b92f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:11.388298 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691124a8-c742-4855-88f1-ed17b5a5b92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:11.404445 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-691124a8-c742-4855-88f1-ed17b5a5b92f None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:11.405740 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-691124a8-c742-4855-88f1-ed17b5a5b92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:11.478298 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 610/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:33:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:33:11.504034 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab4f54-936a-4479-b2fc-846c3c6ac981 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:11.625859 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab4f54-936a-4479-b2fc-846c3c6ac981 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:11.662870 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bdb06-71eb-4388-9f0c-3c08f92d2b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:11.663607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bdb06-71eb-4388-9f0c-3c08f92d2b05 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:11.664578 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bdb06-71eb-4388-9f0c-3c08f92d2b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:11.664856 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bdb06-71eb-4388-9f0c-3c08f92d2b05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:11.678200 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4bdb06-71eb-4388-9f0c-3c08f92d2b05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:11.679706 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4bdb06-71eb-4388-9f0c-3c08f92d2b05 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:11.701001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-1f4bdb06-71eb-4388-9f0c-3c08f92d2b05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:11.701001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:11.701001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:11.701001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:11.701001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:11.701001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:11.701001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:11.701001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:11.701001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:11.701001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:11.701001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:11.701001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:11.701001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:11.701001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:11.701001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:11.706678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:11.706678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:11.706678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:11.706678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:11.706678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:11.706678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:11.706678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:11.706678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:11.706678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:33:11.706678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:11.706678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:11.706678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:11.706678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:11.706678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:11.706678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:11.706678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:11.706678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:11.707880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:11.707880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:11.707880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:11.707880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:33:11.707880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 593/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:33:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:11.708585 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691124a8-c742-4855-88f1-ed17b5a5b92f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:11.816964 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691124a8-c742-4855-88f1-ed17b5a5b92f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:11.851601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:11.860360 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb3701-6e62-40d5-a6cc-b99032cba5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:11.871950 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb3701-6e62-40d5-a6cc-b99032cba5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:11.871950 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb3701-6e62-40d5-a6cc-b99032cba5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:11.871950 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb3701-6e62-40d5-a6cc-b99032cba5c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:11.871950 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb3701-6e62-40d5-a6cc-b99032cba5c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:11.871950 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb3701-6e62-40d5-a6cc-b99032cba5c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:11.871950 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb3701-6e62-40d5-a6cc-b99032cba5c6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:11.876194 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 611/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:11.882982 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bdb06-71eb-4388-9f0c-3c08f92d2b05 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:11.939962 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:11.990870 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bdb06-71eb-4388-9f0c-3c08f92d2b05 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:12.026940 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e79794-adbd-4bb2-b57e-5cf98832dec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:12.027637 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e79794-adbd-4bb2-b57e-5cf98832dec6 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:12.027922 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e79794-adbd-4bb2-b57e-5cf98832dec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:12.028202 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e79794-adbd-4bb2-b57e-5cf98832dec6 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:12.028916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e79794-adbd-4bb2-b57e-5cf98832dec6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:12.030486 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e79794-adbd-4bb2-b57e-5cf98832dec6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:12.235961 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 594/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 16:33:11 2022] POST /identity/v3/users => generated 251 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:33:14.568299 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b7e72-c8b1-494f-9f30-157d57cf8c31 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:14.568909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b7e72-c8b1-494f-9f30-157d57cf8c31 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:14.568909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b7e72-c8b1-494f-9f30-157d57cf8c31 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:14.570910 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 612/1206] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:33:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:33:14.576299 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d369b-0a9f-4867-9240-510acc48c590 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:14.576812 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d369b-0a9f-4867-9240-510acc48c590 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:14.576934 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d369b-0a9f-4867-9240-510acc48c590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:14.594830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b19d369b-0a9f-4867-9240-510acc48c590 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:14.596044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b19d369b-0a9f-4867-9240-510acc48c590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:14.676724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 595/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:33:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:33:14.702573 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b7e72-c8b1-494f-9f30-157d57cf8c31 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:14.822080 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b7e72-c8b1-494f-9f30-157d57cf8c31 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:14.857875 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7281b2-e788-479b-90bf-9d763422cae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:14.858685 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7281b2-e788-479b-90bf-9d763422cae4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:14.858958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7281b2-e788-479b-90bf-9d763422cae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:14.859228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7281b2-e788-479b-90bf-9d763422cae4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:14.870965 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7281b2-e788-479b-90bf-9d763422cae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:14.879279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-aa7281b2-e788-479b-90bf-9d763422cae4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:33:14.879279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:14.879279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:14.879279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:14.879279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:14.879279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:14.879279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:14.879279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:14.879279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:14.879279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:14.879279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:14.879279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:14.879279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:14.879279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:14.879279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:14.879279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:14.880460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:14.880460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:14.880460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:14.880460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:14.880460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:14.880460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:14.880460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:14.880460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:14.880460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:14.880460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:14.880460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:14.880460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:33:14.880460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:14.880460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:14.880460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:14.880460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:14.881613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:14.881613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:14.881613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:14.881613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:14.881613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:14.881613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:14.881613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:14.881613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:14.881613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:14.881613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:14.881613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:33:14.881613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:14.881613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 613/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:33:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:14.886997 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d369b-0a9f-4867-9240-510acc48c590 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:14.935751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:14.996426 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d369b-0a9f-4867-9240-510acc48c590 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:15.032968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ec4ea-299a-40b8-b82b-418e277e8eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:15.033727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ec4ea-299a-40b8-b82b-418e277e8eaf None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:15.034007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ec4ea-299a-40b8-b82b-418e277e8eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:15.034284 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ec4ea-299a-40b8-b82b-418e277e8eaf None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:15.035173 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ec4ea-299a-40b8-b82b-418e277e8eaf None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:15.035587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ec4ea-299a-40b8-b82b-418e277e8eaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:15.037001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ec4ea-299a-40b8-b82b-418e277e8eaf None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:15.045902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 596/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 16:33:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:15.051678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7281b2-e788-479b-90bf-9d763422cae4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:15.112172 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:15.166355 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7281b2-e788-479b-90bf-9d763422cae4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:15.201806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55e8a1-f0f4-4621-b9ca-34569625d0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:15.202616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55e8a1-f0f4-4621-b9ca-34569625d0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:15.202893 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55e8a1-f0f4-4621-b9ca-34569625d0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:15.203161 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55e8a1-f0f4-4621-b9ca-34569625d0a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:15.214593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55e8a1-f0f4-4621-b9ca-34569625d0a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:15.216088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55e8a1-f0f4-4621-b9ca-34569625d0a0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:15.235318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-af55e8a1-f0f4-4621-b9ca-34569625d0a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:15.235318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:15.235318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:15.235318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:15.235318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:15.235318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:15.235318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:15.235318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:15.235318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:15.235318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:15.235318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:15.235318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:15.235318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:15.235318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:15.235318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:15.236512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:15.236512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:15.236512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:15.236512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:15.236512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:15.236512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:15.236512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:15.236512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:15.236512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:33:15.236512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:15.236512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:15.236512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:15.236512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:15.236512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:15.236512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:15.236512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:15.236512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:15.237517 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:15.237517 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:15.237517 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:15.237517 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:15.237517 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 614/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:33:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:15.243373 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ec4ea-299a-40b8-b82b-418e277e8eaf None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:15.347746 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:15.350936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ec4ea-299a-40b8-b82b-418e277e8eaf None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:15.386235 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb5a8e-b2fc-4b9c-9fec-7d0ce92451ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:15.386812 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb5a8e-b2fc-4b9c-9fec-7d0ce92451ac None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:15.387112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb5a8e-b2fc-4b9c-9fec-7d0ce92451ac None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:15.387386 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb5a8e-b2fc-4b9c-9fec-7d0ce92451ac None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:15.388101 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb5a8e-b2fc-4b9c-9fec-7d0ce92451ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:15.388403 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb5a8e-b2fc-4b9c-9fec-7d0ce92451ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:15.389818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb5a8e-b2fc-4b9c-9fec-7d0ce92451ac None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:15.406077 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 597/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:15.407867 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55e8a1-f0f4-4621-b9ca-34569625d0a0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:15.517511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55e8a1-f0f4-4621-b9ca-34569625d0a0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:15.519104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:15.553774 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b86228-0f7a-4ef4-9a6c-9ec0b7df1584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:15.554695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b86228-0f7a-4ef4-9a6c-9ec0b7df1584 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:15.555067 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b86228-0f7a-4ef4-9a6c-9ec0b7df1584 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:15.555344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b86228-0f7a-4ef4-9a6c-9ec0b7df1584 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:15.564038 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b86228-0f7a-4ef4-9a6c-9ec0b7df1584 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:15.565620 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b86228-0f7a-4ef4-9a6c-9ec0b7df1584 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:15.586711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-91b86228-0f7a-4ef4-9a6c-9ec0b7df1584 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:33:15.586711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:15.586711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:15.586711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:15.586711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:15.586711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:15.586711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:15.586711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:15.586711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:15.586711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:15.586711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:15.586711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:15.586711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:33:15.586711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:33:15.586711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:33:15.586711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:33:15.588229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:15.588229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:15.588229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:33:15.588229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:33:15.588229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:33:15.588229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:33:15.588229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:15.588229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:15.588229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:15.588229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:15.588229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:15.588229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:33:15.588229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:15.588229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:15.588229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:15.588229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:15.588229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:15.588229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:15.589425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:15.589425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:15.589425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:33:15.589425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:33:15.589425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:33:15.589425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:33:15.589425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:33:15.589425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:33:15.589425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:33:15.589425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:15.589425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 615/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:33:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:33:15.594311 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb5a8e-b2fc-4b9c-9fec-7d0ce92451ac None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:15.707740 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb5a8e-b2fc-4b9c-9fec-7d0ce92451ac None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:15.742587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464fe01-c626-4fa2-bd7d-a678ccb965a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:15.743261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464fe01-c626-4fa2-bd7d-a678ccb965a3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:15.743547 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464fe01-c626-4fa2-bd7d-a678ccb965a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:15.743823 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464fe01-c626-4fa2-bd7d-a678ccb965a3 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:15.744657 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464fe01-c626-4fa2-bd7d-a678ccb965a3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:15.744967 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464fe01-c626-4fa2-bd7d-a678ccb965a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:15.746455 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464fe01-c626-4fa2-bd7d-a678ccb965a3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:15.765987 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 598/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 26 16:33:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:15.772084 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b86228-0f7a-4ef4-9a6c-9ec0b7df1584 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:15.890441 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b86228-0f7a-4ef4-9a6c-9ec0b7df1584 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:15.928183 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960b9d9-8047-46e9-93f4-da50cb719006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:15.928856 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960b9d9-8047-46e9-93f4-da50cb719006 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:15.929686 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960b9d9-8047-46e9-93f4-da50cb719006 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:15.929949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960b9d9-8047-46e9-93f4-da50cb719006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:15.965578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:16.007839 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960b9d9-8047-46e9-93f4-da50cb719006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:16.008522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960b9d9-8047-46e9-93f4-da50cb719006 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:16.116239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 616/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:33:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:33:16.122899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464fe01-c626-4fa2-bd7d-a678ccb965a3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:16.144967 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:16.233548 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464fe01-c626-4fa2-bd7d-a678ccb965a3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:16.270734 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b91ec-3761-4b26-9690-409d89277f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:16.271694 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b91ec-3761-4b26-9690-409d89277f15 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:16.272099 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b91ec-3761-4b26-9690-409d89277f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:16.272469 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b91ec-3761-4b26-9690-409d89277f15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:16.283983 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b91ec-3761-4b26-9690-409d89277f15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:16.285598 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b91ec-3761-4b26-9690-409d89277f15 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:16.303815 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-809b91ec-3761-4b26-9690-409d89277f15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:16.303815 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:16.303815 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:16.303815 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:16.303815 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:16.303815 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:16.303815 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:16.303815 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:16.303815 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:16.303815 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:16.303815 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:16.303815 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:16.303815 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:16.303815 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:16.303815 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:16.307069 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:16.307069 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:16.307069 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:16.307069 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:16.307069 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:16.307069 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:16.307069 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:16.307069 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:16.307069 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:33:16.307069 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:16.307069 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:16.307069 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:16.307069 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:16.307069 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:16.307069 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:16.307069 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:16.307069 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:16.308037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:16.308037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:16.308037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:16.308037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:33:16.308037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 599/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:16.311871 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960b9d9-8047-46e9-93f4-da50cb719006 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:16.385038 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:16.426351 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960b9d9-8047-46e9-93f4-da50cb719006 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:16.461023 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eca8b3-c12b-4b7f-b2ff-eb9bc4b70add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:16.461728 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eca8b3-c12b-4b7f-b2ff-eb9bc4b70add None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:16.462013 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eca8b3-c12b-4b7f-b2ff-eb9bc4b70add None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:16.462289 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eca8b3-c12b-4b7f-b2ff-eb9bc4b70add None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:16.463157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eca8b3-c12b-4b7f-b2ff-eb9bc4b70add None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:16.463463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eca8b3-c12b-4b7f-b2ff-eb9bc4b70add None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:16.464872 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eca8b3-c12b-4b7f-b2ff-eb9bc4b70add None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:16.477212 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 617/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:33:16.483698 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b91ec-3761-4b26-9690-409d89277f15 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:16.584469 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b91ec-3761-4b26-9690-409d89277f15 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:16.604191 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:16.620880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ffbac-4bcf-4b21-85de-17cef2dc60b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:16.621712 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ffbac-4bcf-4b21-85de-17cef2dc60b7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:16.621993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ffbac-4bcf-4b21-85de-17cef2dc60b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:16.622266 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ffbac-4bcf-4b21-85de-17cef2dc60b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:16.629234 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ffbac-4bcf-4b21-85de-17cef2dc60b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:16.630784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ffbac-4bcf-4b21-85de-17cef2dc60b7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:16.645185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-993ffbac-4bcf-4b21-85de-17cef2dc60b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:33:16.645185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:16.645185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:16.645185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:16.645185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:16.645185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:16.645185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:16.645185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:16.645185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:16.645185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:16.645185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:16.645185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:16.645185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:33:16.645185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:33:16.645185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:33:16.648205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:33:16.648205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:16.648205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:16.648205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:16.648205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:16.648205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:16.648205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:16.648205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:16.648205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:33:16.648205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:16.648205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:16.648205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:16.648205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:16.648205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:16.648205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:16.648205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:16.648205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:16.649535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:33:16.649535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:33:16.649535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:33:16.649535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:33:16.649535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:33:16.649535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:33:16.649535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:33:16.649535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:33:16.649535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 600/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:33:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:16.652495 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eca8b3-c12b-4b7f-b2ff-eb9bc4b70add None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:16.763454 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eca8b3-c12b-4b7f-b2ff-eb9bc4b70add None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:16.787880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:16.801033 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427ba87-24f8-4f2f-ab31-809fb75527c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:16.801913 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427ba87-24f8-4f2f-ab31-809fb75527c6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:16.802293 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427ba87-24f8-4f2f-ab31-809fb75527c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:16.802678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427ba87-24f8-4f2f-ab31-809fb75527c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:16.803632 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427ba87-24f8-4f2f-ab31-809fb75527c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:16.804076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427ba87-24f8-4f2f-ab31-809fb75527c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:16.805713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427ba87-24f8-4f2f-ab31-809fb75527c6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:16.818351 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 618/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:33:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:16.824813 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ffbac-4bcf-4b21-85de-17cef2dc60b7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:16.936407 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ffbac-4bcf-4b21-85de-17cef2dc60b7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:16.967584 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:16.973880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37449d17-8588-4175-b545-4cf82b7ecb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:16.974547 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37449d17-8588-4175-b545-4cf82b7ecb33 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:16.974875 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37449d17-8588-4175-b545-4cf82b7ecb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:16.975151 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37449d17-8588-4175-b545-4cf82b7ecb33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:16.975996 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37449d17-8588-4175-b545-4cf82b7ecb33 None admin] RBAC: Adding query filter params (role.id=d39d16b5286d4e1db63841f4917e08f2, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=beeefb9b8d394407a5e7a32f5a00ffad) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:16.976300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37449d17-8588-4175-b545-4cf82b7ecb33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:16.977787 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37449d17-8588-4175-b545-4cf82b7ecb33 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:16.984033 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 601/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:33:16 2022] GET /identity/v3/role_assignments?user.id=beeefb9b8d394407a5e7a32f5a00ffad&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=d39d16b5286d4e1db63841f4917e08f2 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:19.209192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ef1c2-b119-4080-be5b-22aadce2bdfd None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:19.209782 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ef1c2-b119-4080-be5b-22aadce2bdfd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:19.209782 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ef1c2-b119-4080-be5b-22aadce2bdfd None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:19.211146 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 619/1220] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:33:19.217137 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d7992-0391-482a-9085-513184221e4d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:19.217644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d7992-0391-482a-9085-513184221e4d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:19.217744 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d7992-0391-482a-9085-513184221e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:19.235466 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-603d7992-0391-482a-9085-513184221e4d None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:19.236678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-603d7992-0391-482a-9085-513184221e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:19.311245 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 602/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:33:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:33:19.335669 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ef1c2-b119-4080-be5b-22aadce2bdfd None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:19.456066 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ef1c2-b119-4080-be5b-22aadce2bdfd None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:19.494830 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdf931-5333-4594-97f1-e760a1d7d662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:19.495666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdf931-5333-4594-97f1-e760a1d7d662 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:19.495947 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdf931-5333-4594-97f1-e760a1d7d662 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:19.496240 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdf931-5333-4594-97f1-e760a1d7d662 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:19.506853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdf931-5333-4594-97f1-e760a1d7d662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:19.515268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-c0bdf931-5333-4594-97f1-e760a1d7d662 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:33:19.515268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:19.515268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:19.515268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:19.515268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:19.515268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:19.515268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:19.515268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:19.515268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:19.515268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:19.515268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:19.515268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:19.515268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:19.515268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:19.515268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:19.515268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:19.517040 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:19.517040 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:19.517040 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:19.517040 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:19.517040 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:19.517040 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:19.517040 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:19.517040 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:19.517040 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:19.517040 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:19.517040 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:19.517040 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:33:19.517040 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:19.517040 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:19.517040 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:19.517040 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:19.518096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:19.518096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:19.518096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:19.518096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:19.518096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:19.518096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:19.518096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:19.518096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:19.518096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:19.518096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:19.518096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:33:19.518096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:19.518096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 620/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:33:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:19.523016 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d7992-0391-482a-9085-513184221e4d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:19.638712 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d7992-0391-482a-9085-513184221e4d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:19.664233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:19.675825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf387bc-3200-47f4-85f5-e385a025edd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:19.676560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf387bc-3200-47f4-85f5-e385a025edd2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:19.676893 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf387bc-3200-47f4-85f5-e385a025edd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:19.677172 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf387bc-3200-47f4-85f5-e385a025edd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:19.677947 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf387bc-3200-47f4-85f5-e385a025edd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:19.678256 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf387bc-3200-47f4-85f5-e385a025edd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:19.680284 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf387bc-3200-47f4-85f5-e385a025edd2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:19.688723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 603/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 16:33:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:19.695076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdf931-5333-4594-97f1-e760a1d7d662 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:19.741145 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:19.798305 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdf931-5333-4594-97f1-e760a1d7d662 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:19.831336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f55e4b-549e-4d83-a2fb-ebe6024c1a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:19.832130 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f55e4b-549e-4d83-a2fb-ebe6024c1a8c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:19.832410 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f55e4b-549e-4d83-a2fb-ebe6024c1a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:19.832679 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f55e4b-549e-4d83-a2fb-ebe6024c1a8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:19.845030 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f55e4b-549e-4d83-a2fb-ebe6024c1a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:19.846573 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f55e4b-549e-4d83-a2fb-ebe6024c1a8c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:19.864773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d4f55e4b-549e-4d83-a2fb-ebe6024c1a8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:19.864773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:19.864773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:19.864773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:19.864773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:19.864773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:19.864773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:19.864773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:19.864773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:19.864773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:19.864773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:19.864773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:19.864773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:19.864773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:19.864773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:19.866017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:19.866017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:19.866017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:19.866017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:19.866017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:19.866017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:19.866017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:19.866017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:19.866017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:33:19.866017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:19.866017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:19.866017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:19.866017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:19.866017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:19.866017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:19.866017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:19.866017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:19.867178 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:19.867178 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:19.867178 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:19.867178 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:19.867178 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 621/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:19.873668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf387bc-3200-47f4-85f5-e385a025edd2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:19.988358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf387bc-3200-47f4-85f5-e385a025edd2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:20.025089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec9f4f-3b54-4b0a-ba3e-42d7033c1b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:20.025869 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec9f4f-3b54-4b0a-ba3e-42d7033c1b19 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:20.026149 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec9f4f-3b54-4b0a-ba3e-42d7033c1b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:20.026425 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec9f4f-3b54-4b0a-ba3e-42d7033c1b19 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:20.027215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec9f4f-3b54-4b0a-ba3e-42d7033c1b19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:20.027537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec9f4f-3b54-4b0a-ba3e-42d7033c1b19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:20.028925 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec9f4f-3b54-4b0a-ba3e-42d7033c1b19 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:20.041490 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 604/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:20.047404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f55e4b-549e-4d83-a2fb-ebe6024c1a8c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:20.148664 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:20.155209 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f55e4b-549e-4d83-a2fb-ebe6024c1a8c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:20.192112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e1a57-4f7a-49b6-ab93-592e0f66f96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:20.193032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e1a57-4f7a-49b6-ab93-592e0f66f96e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:20.193386 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e1a57-4f7a-49b6-ab93-592e0f66f96e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:20.193650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e1a57-4f7a-49b6-ab93-592e0f66f96e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:20.203107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e1a57-4f7a-49b6-ab93-592e0f66f96e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:20.204575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e1a57-4f7a-49b6-ab93-592e0f66f96e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:20.220574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-236e1a57-4f7a-49b6-ab93-592e0f66f96e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:33:20.220574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:20.220574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:20.220574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:20.220574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:20.220574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:20.220574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:20.220574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:20.220574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:20.220574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:20.220574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:20.220574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:20.220574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:33:20.220574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:33:20.220574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:33:20.220574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:33:20.222234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:20.222234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:20.222234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:33:20.222234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:33:20.222234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:33:20.222234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:33:20.222234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:20.222234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:20.222234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:20.222234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:20.222234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:20.222234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:33:20.222234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:20.222234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:20.222234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:20.222234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:20.222234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:20.222234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:20.223272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:20.223272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:20.223272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:33:20.223272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:33:20.223272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:33:20.223272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:33:20.223272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:33:20.223272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:33:20.223272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:33:20.223272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:20.223272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 622/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:33:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:33:20.228570 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec9f4f-3b54-4b0a-ba3e-42d7033c1b19 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:20.280219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:20.346965 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec9f4f-3b54-4b0a-ba3e-42d7033c1b19 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:20.385309 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d699201-c635-49c9-9ce5-51ec7899cf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:20.386010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d699201-c635-49c9-9ce5-51ec7899cf93 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:20.386290 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d699201-c635-49c9-9ce5-51ec7899cf93 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:20.386561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d699201-c635-49c9-9ce5-51ec7899cf93 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:20.387409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d699201-c635-49c9-9ce5-51ec7899cf93 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:20.387720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d699201-c635-49c9-9ce5-51ec7899cf93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:20.389225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d699201-c635-49c9-9ce5-51ec7899cf93 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:20.410863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 605/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 26 16:33:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:20.417463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e1a57-4f7a-49b6-ab93-592e0f66f96e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:20.550994 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e1a57-4f7a-49b6-ab93-592e0f66f96e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:20.587807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd92bf-4fe9-40ad-a937-93f1a9b64296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:20.588594 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd92bf-4fe9-40ad-a937-93f1a9b64296 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:20.588872 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd92bf-4fe9-40ad-a937-93f1a9b64296 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:20.589139 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd92bf-4fe9-40ad-a937-93f1a9b64296 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:20.608815 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd92bf-4fe9-40ad-a937-93f1a9b64296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:20.610402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd92bf-4fe9-40ad-a937-93f1a9b64296 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:20.628239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-72cd92bf-4fe9-40ad-a937-93f1a9b64296 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:20.628239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:20.628239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:20.628239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:20.628239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:20.628239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:20.628239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:20.628239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:20.628239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:20.628239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:20.628239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:20.628239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:20.628239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:20.628239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:20.628239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:20.629406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:20.629406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:20.629406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:20.629406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:20.629406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:20.629406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:20.629406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:20.629406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:20.629406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:33:20.629406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:20.629406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:20.629406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:20.629406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:20.629406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:20.629406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:20.629406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:20.629406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:20.630393 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:20.630393 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:20.630393 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:20.630393 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:20.630393 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 623/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:20.635414 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d699201-c635-49c9-9ce5-51ec7899cf93 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:20.745593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d699201-c635-49c9-9ce5-51ec7899cf93 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:20.748119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:20.783344 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35324c75-bc9d-4f95-a236-86d670fcf5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:20.784040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35324c75-bc9d-4f95-a236-86d670fcf5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:20.784325 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35324c75-bc9d-4f95-a236-86d670fcf5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:20.784610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35324c75-bc9d-4f95-a236-86d670fcf5e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:20.785421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35324c75-bc9d-4f95-a236-86d670fcf5e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:20.785731 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35324c75-bc9d-4f95-a236-86d670fcf5e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:20.787113 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35324c75-bc9d-4f95-a236-86d670fcf5e1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:20.804726 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 606/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:20.806862 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd92bf-4fe9-40ad-a937-93f1a9b64296 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:20.816376 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:20.909033 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd92bf-4fe9-40ad-a937-93f1a9b64296 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:20.944601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd88e0-8728-4985-bf1f-29f103a06f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:20.945470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd88e0-8728-4985-bf1f-29f103a06f79 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:20.945758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd88e0-8728-4985-bf1f-29f103a06f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:20.946030 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd88e0-8728-4985-bf1f-29f103a06f79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:20.954976 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd88e0-8728-4985-bf1f-29f103a06f79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:20.956596 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd88e0-8728-4985-bf1f-29f103a06f79 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:20.971831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-b7fd88e0-8728-4985-bf1f-29f103a06f79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:33:20.971831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:20.971831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:20.971831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:20.971831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:20.971831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:20.971831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:20.971831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:20.971831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:20.971831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:20.971831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:20.971831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:20.971831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:33:20.971831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:33:20.971831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:33:20.972988 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:33:20.972988 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:20.972988 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:20.972988 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:20.972988 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:20.972988 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:20.972988 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:20.972988 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:20.972988 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:33:20.972988 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:20.972988 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:20.972988 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:20.972988 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:20.972988 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:20.972988 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:20.972988 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:20.972988 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:20.974192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:33:20.974192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:33:20.974192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:33:20.974192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:33:20.974192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:33:20.974192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:33:20.974192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:33:20.974192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:20.974192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 624/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:33:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:20.980724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35324c75-bc9d-4f95-a236-86d670fcf5e1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:21.098637 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35324c75-bc9d-4f95-a236-86d670fcf5e1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:21.145470 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4449b-847e-496b-9f3b-9c0d97e86cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:21.146218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4449b-847e-496b-9f3b-9c0d97e86cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:21.146543 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4449b-847e-496b-9f3b-9c0d97e86cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:21.146885 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4449b-847e-496b-9f3b-9c0d97e86cd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:21.148316 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4449b-847e-496b-9f3b-9c0d97e86cd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:21.148627 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4449b-847e-496b-9f3b-9c0d97e86cd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:21.150106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4449b-847e-496b-9f3b-9c0d97e86cd5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:21.163143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 607/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:33:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:21.170258 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd88e0-8728-4985-bf1f-29f103a06f79 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:21.245400 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:21.286919 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd88e0-8728-4985-bf1f-29f103a06f79 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:21.326301 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e9869-9537-411f-85a7-e928bf7665ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:21.327230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e9869-9537-411f-85a7-e928bf7665ea None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:21.327516 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e9869-9537-411f-85a7-e928bf7665ea None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:21.327791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e9869-9537-411f-85a7-e928bf7665ea None admin] PATH_INFO: `/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/beeefb9b8d394407a5e7a32f5a00ffad/roles/d39d16b5286d4e1db63841f4917e08f2` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:21.343797 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e9869-9537-411f-85a7-e928bf7665ea None admin] RBAC: Authorizing `identity:create_grant(project_id=a3379cdd914747758e71b3b05c5921b1, user_id=beeefb9b8d394407a5e7a32f5a00ffad, role_id=d39d16b5286d4e1db63841f4917e08f2)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:21.345734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e9869-9537-411f-85a7-e928bf7665ea None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:21.443761 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 625/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:33:21 2022] PUT /identity/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/beeefb9b8d394407a5e7a32f5a00ffad/roles/d39d16b5286d4e1db63841f4917e08f2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:33:23.680811 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028decae-eac4-468e-a746-15fed6c2aedc None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:23.681372 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028decae-eac4-468e-a746-15fed6c2aedc None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:23.681469 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028decae-eac4-468e-a746-15fed6c2aedc None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:23.683065 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 608/1233] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:33:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:33:23.688994 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc432b-1abe-4236-b4b2-ba4d9a9bc7a7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:23.689525 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc432b-1abe-4236-b4b2-ba4d9a9bc7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:23.689618 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc432b-1abe-4236-b4b2-ba4d9a9bc7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:23.706114 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7bbc432b-1abe-4236-b4b2-ba4d9a9bc7a7 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:23.707418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7bbc432b-1abe-4236-b4b2-ba4d9a9bc7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:23.777768 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 626/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:33:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:33:23.802286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028decae-eac4-468e-a746-15fed6c2aedc None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:23.829673 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:23.914789 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028decae-eac4-468e-a746-15fed6c2aedc None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:23.950754 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd38b8f-4c18-458a-b68b-c225082b6d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:23.951512 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd38b8f-4c18-458a-b68b-c225082b6d0c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:23.951798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd38b8f-4c18-458a-b68b-c225082b6d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:23.952078 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd38b8f-4c18-458a-b68b-c225082b6d0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:23.963322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd38b8f-4c18-458a-b68b-c225082b6d0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:23.971438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-cdd38b8f-4c18-458a-b68b-c225082b6d0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:33:23.971438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:23.971438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:23.971438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:23.971438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:23.971438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:23.971438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:23.971438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:23.971438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:23.971438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:23.971438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:23.971438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:23.971438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:23.971438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:23.971438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:23.971438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:23.973215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:23.973215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:23.973215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:23.973215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:23.973215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:23.973215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:23.973215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:23.973215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:23.973215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:23.973215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:23.973215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:23.973215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:33:23.973215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:23.973215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:23.973215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:23.973215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:23.975170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:23.975170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:23.975170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:23.975170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:23.975170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:23.975170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:23.975170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:23.975170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:23.975170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:23.975170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:23.975170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:33:23.975170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:33:23.975170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 609/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 16:33:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:23.980357 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc432b-1abe-4236-b4b2-ba4d9a9bc7a7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:24.030615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:24.086203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc432b-1abe-4236-b4b2-ba4d9a9bc7a7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:24.132690 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc092d5-5f46-47a1-bd94-922222f2fa8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:24.133392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc092d5-5f46-47a1-bd94-922222f2fa8f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:24.133676 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc092d5-5f46-47a1-bd94-922222f2fa8f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:24.133949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc092d5-5f46-47a1-bd94-922222f2fa8f None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:24.134703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc092d5-5f46-47a1-bd94-922222f2fa8f None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:24.135062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc092d5-5f46-47a1-bd94-922222f2fa8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:24.136401 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc092d5-5f46-47a1-bd94-922222f2fa8f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:24.148965 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 627/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 16:33:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:24.159011 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd38b8f-4c18-458a-b68b-c225082b6d0c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:24.256757 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:24.276621 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd38b8f-4c18-458a-b68b-c225082b6d0c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:24.312273 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398f3ba-6dee-4196-9ae8-5f7938485668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:24.313090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398f3ba-6dee-4196-9ae8-5f7938485668 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:24.313411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398f3ba-6dee-4196-9ae8-5f7938485668 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:24.313693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398f3ba-6dee-4196-9ae8-5f7938485668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:24.324538 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398f3ba-6dee-4196-9ae8-5f7938485668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:24.326055 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398f3ba-6dee-4196-9ae8-5f7938485668 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:24.345080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-8398f3ba-6dee-4196-9ae8-5f7938485668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:24.345080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:24.345080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:24.345080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:24.345080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:24.345080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:24.345080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:24.345080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:24.345080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:24.345080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:24.345080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:24.345080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:24.345080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:24.345080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:24.345080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:24.346534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:24.346534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:24.346534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:24.346534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:24.346534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:24.346534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:24.346534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:24.346534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:24.346534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:33:24.346534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:24.346534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:24.346534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:24.346534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:24.346534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:24.346534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:24.346534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:24.346534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:24.348971 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:24.348971 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:24.348971 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:24.348971 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:33:24.348971 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 610/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:24.352845 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc092d5-5f46-47a1-bd94-922222f2fa8f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:24.455322 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc092d5-5f46-47a1-bd94-922222f2fa8f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:24.465651 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:24.495181 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318944ae-81a8-4177-9d5a-86f4d3d8f868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:24.495858 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318944ae-81a8-4177-9d5a-86f4d3d8f868 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:24.496141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318944ae-81a8-4177-9d5a-86f4d3d8f868 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:24.496540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318944ae-81a8-4177-9d5a-86f4d3d8f868 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:24.497285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318944ae-81a8-4177-9d5a-86f4d3d8f868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:24.497603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318944ae-81a8-4177-9d5a-86f4d3d8f868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:24.499043 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318944ae-81a8-4177-9d5a-86f4d3d8f868 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:24.511991 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 628/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:24.517975 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398f3ba-6dee-4196-9ae8-5f7938485668 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:24.629073 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398f3ba-6dee-4196-9ae8-5f7938485668 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:24.669773 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1173ef7-eac1-43ca-9c92-bc09bcf1ce11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:24.670608 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1173ef7-eac1-43ca-9c92-bc09bcf1ce11 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:24.674537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1173ef7-eac1-43ca-9c92-bc09bcf1ce11 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:24.674537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1173ef7-eac1-43ca-9c92-bc09bcf1ce11 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:24.674537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:24.680209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1173ef7-eac1-43ca-9c92-bc09bcf1ce11 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:24.681773 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1173ef7-eac1-43ca-9c92-bc09bcf1ce11 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:24.698243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-a1173ef7-eac1-43ca-9c92-bc09bcf1ce11 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:33:24.698243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:24.698243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:24.698243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:24.698243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:24.698243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:24.698243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:24.698243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:24.698243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:24.698243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:24.698243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:24.698243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:24.698243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:33:24.698243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:33:24.698243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:33:24.698243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:33:24.699556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:24.699556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:24.699556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:33:24.699556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:33:24.699556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:33:24.699556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:33:24.699556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:24.699556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:24.699556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:24.699556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:24.699556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:24.699556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:33:24.699556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:24.699556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:24.699556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:24.699556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:24.699556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:24.699556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:24.700818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:24.700818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:24.700818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:33:24.700818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:33:24.700818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:33:24.700818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:33:24.700818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:33:24.700818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:33:24.700818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:33:24.700818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:33:24.700818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 611/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:33:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:24.705830 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318944ae-81a8-4177-9d5a-86f4d3d8f868 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:24.831241 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318944ae-81a8-4177-9d5a-86f4d3d8f868 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:24.866981 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc59e29-b48d-40a8-9b92-198a8888633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:24.867702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc59e29-b48d-40a8-9b92-198a8888633e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:24.867988 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc59e29-b48d-40a8-9b92-198a8888633e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:24.868265 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc59e29-b48d-40a8-9b92-198a8888633e None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:24.869319 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc59e29-b48d-40a8-9b92-198a8888633e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:24.869817 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc59e29-b48d-40a8-9b92-198a8888633e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:24.871303 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc59e29-b48d-40a8-9b92-198a8888633e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:24.890277 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 629/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 26 16:33:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:24.896389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1173ef7-eac1-43ca-9c92-bc09bcf1ce11 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:25.013722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1173ef7-eac1-43ca-9c92-bc09bcf1ce11 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:25.056064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcf5af-fa2e-4936-87e5-3da42bc3f243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:25.056729 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcf5af-fa2e-4936-87e5-3da42bc3f243 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:25.057009 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcf5af-fa2e-4936-87e5-3da42bc3f243 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:25.057300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcf5af-fa2e-4936-87e5-3da42bc3f243 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:25.123222 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:25.129937 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcf5af-fa2e-4936-87e5-3da42bc3f243 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:25.131442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcf5af-fa2e-4936-87e5-3da42bc3f243 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:25.236556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 612/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:33:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:33:25.242745 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc59e29-b48d-40a8-9b92-198a8888633e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:25.277217 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:25.352092 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc59e29-b48d-40a8-9b92-198a8888633e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:25.390662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6bbc4-f1cb-4849-881f-4fb85d2499b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:25.390662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6bbc4-f1cb-4849-881f-4fb85d2499b3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:25.390662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6bbc4-f1cb-4849-881f-4fb85d2499b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:25.390662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6bbc4-f1cb-4849-881f-4fb85d2499b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:25.401155 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6bbc4-f1cb-4849-881f-4fb85d2499b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:25.403875 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6bbc4-f1cb-4849-881f-4fb85d2499b3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:25.421102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e2f6bbc4-f1cb-4849-881f-4fb85d2499b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:25.421102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:25.421102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:25.421102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:25.421102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:25.421102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:25.421102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:25.421102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:25.421102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:25.421102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:25.421102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:25.421102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:25.421102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:25.421102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:25.421102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:25.423200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:25.423200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:25.423200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:25.423200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:25.423200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:25.423200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:25.423200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:25.423200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:25.423200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:33:25.423200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:25.423200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:25.423200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:25.423200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:25.423200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:25.423200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:25.423200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:25.423200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:25.424579 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:25.424579 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:25.424579 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:25.424579 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:25.424579 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 630/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:25.428066 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcf5af-fa2e-4936-87e5-3da42bc3f243 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:25.532496 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:25.538267 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcf5af-fa2e-4936-87e5-3da42bc3f243 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:25.574979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf18a7-86ee-4eae-9081-cbd5c0149f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:25.575646 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf18a7-86ee-4eae-9081-cbd5c0149f4d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:25.575930 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf18a7-86ee-4eae-9081-cbd5c0149f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:25.576207 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf18a7-86ee-4eae-9081-cbd5c0149f4d None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:25.576917 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf18a7-86ee-4eae-9081-cbd5c0149f4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:25.577222 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf18a7-86ee-4eae-9081-cbd5c0149f4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:25.578631 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf18a7-86ee-4eae-9081-cbd5c0149f4d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:25.599842 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 613/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:25.607476 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6bbc4-f1cb-4849-881f-4fb85d2499b3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:25.697424 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:25.719933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6bbc4-f1cb-4849-881f-4fb85d2499b3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:25.756387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120b232-dd1b-464e-9109-336242334fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:25.758891 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120b232-dd1b-464e-9109-336242334fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:25.758891 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120b232-dd1b-464e-9109-336242334fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:25.758891 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120b232-dd1b-464e-9109-336242334fc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:25.766017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120b232-dd1b-464e-9109-336242334fc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:25.767489 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120b232-dd1b-464e-9109-336242334fc9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:25.781668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a120b232-dd1b-464e-9109-336242334fc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:33:25.781668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:25.781668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:25.781668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:25.781668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:25.781668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:25.781668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:25.781668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:25.781668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:25.781668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:25.781668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:25.781668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:25.781668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:33:25.781668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:33:25.781668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:33:25.782842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:33:25.782842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:25.782842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:25.782842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:25.782842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:25.782842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:25.782842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:25.782842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:25.782842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:33:25.782842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:25.782842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:25.782842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:25.782842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:25.782842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:25.782842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:25.782842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:25.782842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:25.783863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:33:25.783863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:33:25.783863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:33:25.783863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:33:25.783863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:33:25.783863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:33:25.783863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:33:25.783863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:25.783863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 631/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:33:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:25.789673 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf18a7-86ee-4eae-9081-cbd5c0149f4d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:25.894651 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf18a7-86ee-4eae-9081-cbd5c0149f4d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:25.929140 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534bb2b-feef-4875-86af-4fd4edfe9c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:25.929839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534bb2b-feef-4875-86af-4fd4edfe9c96 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:25.930122 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534bb2b-feef-4875-86af-4fd4edfe9c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:25.930399 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534bb2b-feef-4875-86af-4fd4edfe9c96 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:25.931176 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534bb2b-feef-4875-86af-4fd4edfe9c96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:25.931484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534bb2b-feef-4875-86af-4fd4edfe9c96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:25.932906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534bb2b-feef-4875-86af-4fd4edfe9c96 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:25.946451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 614/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:33:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:25.953731 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120b232-dd1b-464e-9109-336242334fc9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:26.055652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120b232-dd1b-464e-9109-336242334fc9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:26.091551 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a55ecb-c17f-412f-a732-d8adf0ca74da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:26.092288 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a55ecb-c17f-412f-a732-d8adf0ca74da None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:26.092681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a55ecb-c17f-412f-a732-d8adf0ca74da None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:26.092941 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a55ecb-c17f-412f-a732-d8adf0ca74da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:26.093895 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a55ecb-c17f-412f-a732-d8adf0ca74da None admin] RBAC: Adding query filter params (role.id=d39d16b5286d4e1db63841f4917e08f2, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=beeefb9b8d394407a5e7a32f5a00ffad) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:26.094208 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a55ecb-c17f-412f-a732-d8adf0ca74da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:26.095904 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a55ecb-c17f-412f-a732-d8adf0ca74da None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:26.102867 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 632/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:33:25 2022] GET /identity/v3/role_assignments?user.id=beeefb9b8d394407a5e7a32f5a00ffad&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=d39d16b5286d4e1db63841f4917e08f2 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:28.424015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad188e73-ec3e-4111-ab7e-15d42d2c4e0a None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:28.424547 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad188e73-ec3e-4111-ab7e-15d42d2c4e0a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:28.424547 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad188e73-ec3e-4111-ab7e-15d42d2c4e0a None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:28.425973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 615/1247] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:33:28.432113 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70409e-4d94-4261-beab-43d67c34141b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:28.432557 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70409e-4d94-4261-beab-43d67c34141b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:28.432665 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70409e-4d94-4261-beab-43d67c34141b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:28.438187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:28.451151 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1a70409e-4d94-4261-beab-43d67c34141b None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:28.452735 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1a70409e-4d94-4261-beab-43d67c34141b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:28.527143 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 633/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:33:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:33:28.552075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad188e73-ec3e-4111-ab7e-15d42d2c4e0a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:28.571315 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:28.677168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad188e73-ec3e-4111-ab7e-15d42d2c4e0a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:28.714519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa58bf-1b20-4b49-945b-09edae3ac87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:28.715321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa58bf-1b20-4b49-945b-09edae3ac87b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:28.715607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa58bf-1b20-4b49-945b-09edae3ac87b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:28.716063 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa58bf-1b20-4b49-945b-09edae3ac87b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:28.727380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa58bf-1b20-4b49-945b-09edae3ac87b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:28.735252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-64fa58bf-1b20-4b49-945b-09edae3ac87b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:33:28.735252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:28.735252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:28.735252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:28.735252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:28.735252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:28.735252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:28.735252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:28.735252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:28.735252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:28.735252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:28.735252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:28.735252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:28.735252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:28.735252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:28.735252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:28.737064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:28.737064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:28.737064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:28.737064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:28.737064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:28.737064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:28.737064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:28.737064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:28.737064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:28.737064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:28.737064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:28.737064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:33:28.737064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:28.737064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:28.737064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:28.737064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:28.739040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:28.739040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:28.739040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:28.739040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:28.739040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:28.739040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:28.739040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:28.739040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:28.739040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:28.739040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:28.739040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:33:28.739040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:33:28.739040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 616/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:33:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:28.744387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70409e-4d94-4261-beab-43d67c34141b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:28.877476 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70409e-4d94-4261-beab-43d67c34141b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:28.910075 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:28.915569 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368b911-6046-4f74-8160-afa609c606ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:28.916240 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368b911-6046-4f74-8160-afa609c606ae None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:28.916566 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368b911-6046-4f74-8160-afa609c606ae None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:28.916784 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368b911-6046-4f74-8160-afa609c606ae None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:28.917556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368b911-6046-4f74-8160-afa609c606ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:28.917858 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368b911-6046-4f74-8160-afa609c606ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:28.919225 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368b911-6046-4f74-8160-afa609c606ae None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:28.927813 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 634/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:33:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:28.933611 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa58bf-1b20-4b49-945b-09edae3ac87b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:29.016412 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:29.046108 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa58bf-1b20-4b49-945b-09edae3ac87b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:29.086975 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb62c7-bfa9-4651-acf1-6040f2fb2776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:29.087778 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb62c7-bfa9-4651-acf1-6040f2fb2776 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:29.088057 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb62c7-bfa9-4651-acf1-6040f2fb2776 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:29.088340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb62c7-bfa9-4651-acf1-6040f2fb2776 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:29.100072 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb62c7-bfa9-4651-acf1-6040f2fb2776 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:29.101626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb62c7-bfa9-4651-acf1-6040f2fb2776 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:29.119257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-7adb62c7-bfa9-4651-acf1-6040f2fb2776 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:29.119257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:29.119257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:29.119257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:29.119257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:29.119257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:29.119257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:29.119257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:29.119257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:29.119257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:29.119257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:29.119257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:29.119257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:29.119257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:29.119257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:29.121916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:29.121916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:29.121916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:29.121916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:29.121916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:29.121916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:29.121916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:29.121916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:29.121916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:33:29.121916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:29.121916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:29.121916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:29.121916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:29.121916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:29.121916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:29.121916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:29.121916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:29.123037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:29.123037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:29.123037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:29.123037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:33:29.123037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 617/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:29.126741 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368b911-6046-4f74-8160-afa609c606ae None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:29.231540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368b911-6046-4f74-8160-afa609c606ae None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:29.268689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a5b20-8069-40fb-b391-54cb9e9614b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:29.269576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a5b20-8069-40fb-b391-54cb9e9614b8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:29.269875 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a5b20-8069-40fb-b391-54cb9e9614b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:29.270152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a5b20-8069-40fb-b391-54cb9e9614b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:29.270875 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a5b20-8069-40fb-b391-54cb9e9614b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:29.271180 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a5b20-8069-40fb-b391-54cb9e9614b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:29.273180 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a5b20-8069-40fb-b391-54cb9e9614b8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:29.285922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 635/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:29.291645 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb62c7-bfa9-4651-acf1-6040f2fb2776 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:29.398085 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb62c7-bfa9-4651-acf1-6040f2fb2776 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:29.426279 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:29.435024 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc3f09-2c7b-4700-886e-5fa6c420b4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:29.435835 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc3f09-2c7b-4700-886e-5fa6c420b4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:29.436119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc3f09-2c7b-4700-886e-5fa6c420b4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:29.436389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc3f09-2c7b-4700-886e-5fa6c420b4b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:29.445600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc3f09-2c7b-4700-886e-5fa6c420b4b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:29.447058 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc3f09-2c7b-4700-886e-5fa6c420b4b8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:29.462020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-9dfc3f09-2c7b-4700-886e-5fa6c420b4b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:33:29.462020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:29.462020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:29.462020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:29.462020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:29.462020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:29.462020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:29.462020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:29.462020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:29.462020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:29.462020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:29.462020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:29.462020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:33:29.462020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:33:29.462020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:33:29.462020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:33:29.465293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:29.465293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:29.465293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:33:29.465293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:33:29.465293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:33:29.465293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:33:29.465293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:29.465293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:29.465293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:29.465293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:29.465293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:29.465293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:33:29.465293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:29.465293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:29.465293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:29.465293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:29.465293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:29.465293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:29.466277 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:29.466277 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:29.466277 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:33:29.466277 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:33:29.466277 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:33:29.466277 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:33:29.466277 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:33:29.466277 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:33:29.466277 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:33:29.466277 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:33:29.466277 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 618/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:33:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:29.469156 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a5b20-8069-40fb-b391-54cb9e9614b8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:29.527113 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:29.576063 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a5b20-8069-40fb-b391-54cb9e9614b8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:29.614505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac9459-31e0-4a4a-aa96-136efcb042a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:29.615224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac9459-31e0-4a4a-aa96-136efcb042a6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:29.615522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac9459-31e0-4a4a-aa96-136efcb042a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:29.616473 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac9459-31e0-4a4a-aa96-136efcb042a6 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:29.617190 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac9459-31e0-4a4a-aa96-136efcb042a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:29.617190 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac9459-31e0-4a4a-aa96-136efcb042a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:29.618880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac9459-31e0-4a4a-aa96-136efcb042a6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:29.637030 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 636/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 26 16:33:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:29.643123 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc3f09-2c7b-4700-886e-5fa6c420b4b8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:29.745435 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc3f09-2c7b-4700-886e-5fa6c420b4b8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:29.780496 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108dac4-4580-40c3-a830-dc6e0495781b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:29.781052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108dac4-4580-40c3-a830-dc6e0495781b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:29.781366 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108dac4-4580-40c3-a830-dc6e0495781b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:29.781643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108dac4-4580-40c3-a830-dc6e0495781b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:29.838211 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:29.851314 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108dac4-4580-40c3-a830-dc6e0495781b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:29.852842 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108dac4-4580-40c3-a830-dc6e0495781b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:29.953491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 619/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:33:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:33:29.960406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac9459-31e0-4a4a-aa96-136efcb042a6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:30.062711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac9459-31e0-4a4a-aa96-136efcb042a6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:30.079328 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:30.102789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accef6b-3610-4ab0-a3b6-06b2c435a4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:30.103592 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accef6b-3610-4ab0-a3b6-06b2c435a4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.103937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accef6b-3610-4ab0-a3b6-06b2c435a4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.104222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accef6b-3610-4ab0-a3b6-06b2c435a4c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.115044 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accef6b-3610-4ab0-a3b6-06b2c435a4c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:30.117150 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accef6b-3610-4ab0-a3b6-06b2c435a4c1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:30.135539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-9accef6b-3610-4ab0-a3b6-06b2c435a4c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:30.135539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:30.135539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:30.135539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:30.135539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:30.135539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:30.135539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:30.135539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:30.135539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:30.135539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:30.135539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:30.135539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:30.135539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:30.135539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:30.135539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:30.136778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:30.136778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:30.136778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:30.136778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:30.136778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:30.136778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:30.136778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:30.136778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:30.136778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:33:30.136778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:30.136778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:30.136778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:30.136778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:30.136778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:30.136778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:30.136778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:30.136778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:30.138340 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:30.138340 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:30.138340 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:30.138340 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:30.138340 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 637/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:30.142641 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108dac4-4580-40c3-a830-dc6e0495781b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:30.238768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:30.251573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108dac4-4580-40c3-a830-dc6e0495781b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:30.286726 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a6a9b-32fa-4dfb-9824-63ae3e18d5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:30.287509 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a6a9b-32fa-4dfb-9824-63ae3e18d5be None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.287847 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a6a9b-32fa-4dfb-9824-63ae3e18d5be None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.288641 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a6a9b-32fa-4dfb-9824-63ae3e18d5be None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.289398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a6a9b-32fa-4dfb-9824-63ae3e18d5be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:30.289708 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a6a9b-32fa-4dfb-9824-63ae3e18d5be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:30.291144 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a6a9b-32fa-4dfb-9824-63ae3e18d5be None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:30.303722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 620/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:30.309819 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accef6b-3610-4ab0-a3b6-06b2c435a4c1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:30.420901 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accef6b-3610-4ab0-a3b6-06b2c435a4c1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:30.457229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f33871-c600-4837-843a-0c36a28b1a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:30.458054 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f33871-c600-4837-843a-0c36a28b1a4f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.458524 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f33871-c600-4837-843a-0c36a28b1a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.458804 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f33871-c600-4837-843a-0c36a28b1a4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.466551 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f33871-c600-4837-843a-0c36a28b1a4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:30.467984 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f33871-c600-4837-843a-0c36a28b1a4f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:30.482269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-67f33871-c600-4837-843a-0c36a28b1a4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:33:30.482269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:30.482269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:30.482269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:30.482269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:30.482269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:30.482269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:30.482269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:30.482269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:30.482269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:30.482269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:30.482269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:30.482269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:33:30.482269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:33:30.482269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:33:30.488480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:33:30.488480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:30.488480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:30.488480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:30.488480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:30.488480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:30.488480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:30.488480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:30.488480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:33:30.488480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:30.488480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:30.488480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:30.488480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:30.488480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:30.488480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:30.488480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:30.488480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:30.490177 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:33:30.490177 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:33:30.490177 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:33:30.490177 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:33:30.490177 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:33:30.490177 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:33:30.490177 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:33:30.490177 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:30.490177 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 638/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:33:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:30.491623 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a6a9b-32fa-4dfb-9824-63ae3e18d5be None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:30.598928 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a6a9b-32fa-4dfb-9824-63ae3e18d5be None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:30.640573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f0e1f-3840-4dd9-976e-49e29a227bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:30.640573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f0e1f-3840-4dd9-976e-49e29a227bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.640573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f0e1f-3840-4dd9-976e-49e29a227bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.640573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f0e1f-3840-4dd9-976e-49e29a227bf8 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.641369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f0e1f-3840-4dd9-976e-49e29a227bf8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:30.641677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f0e1f-3840-4dd9-976e-49e29a227bf8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:30.643122 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f0e1f-3840-4dd9-976e-49e29a227bf8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:30.656549 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 621/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:33:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:30.663040 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f33871-c600-4837-843a-0c36a28b1a4f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:30.688895 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:30.768807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f33871-c600-4837-843a-0c36a28b1a4f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:30.802528 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0158f4a-d032-4e7c-8adf-6c574449e914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:30.803185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0158f4a-d032-4e7c-8adf-6c574449e914 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.803541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0158f4a-d032-4e7c-8adf-6c574449e914 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.803736 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0158f4a-d032-4e7c-8adf-6c574449e914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.804558 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0158f4a-d032-4e7c-8adf-6c574449e914 None admin] RBAC: Adding query filter params (role.id=796e313fa8794ac885ccf6300d09332a, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=beeefb9b8d394407a5e7a32f5a00ffad) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:30.804866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0158f4a-d032-4e7c-8adf-6c574449e914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:30.806330 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0158f4a-d032-4e7c-8adf-6c574449e914 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:30.812153 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 639/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:33:30 2022] GET /identity/v3/role_assignments?user.id=beeefb9b8d394407a5e7a32f5a00ffad&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=796e313fa8794ac885ccf6300d09332a => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:33.054426 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cfb48-4215-46c2-ac93-d7ddf35528dd None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:33.054957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cfb48-4215-46c2-ac93-d7ddf35528dd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:33.054957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cfb48-4215-46c2-ac93-d7ddf35528dd None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:33.056406 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 622/1261] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:33:33.061860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d219a74-a903-46b8-a690-c324096f1f3a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:33.062313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d219a74-a903-46b8-a690-c324096f1f3a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:33.062407 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d219a74-a903-46b8-a690-c324096f1f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:33.080235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3d219a74-a903-46b8-a690-c324096f1f3a None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:33.081470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3d219a74-a903-46b8-a690-c324096f1f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:33.151171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 640/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:33:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:33:33.173601 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cfb48-4215-46c2-ac93-d7ddf35528dd None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:33.185328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:33.278579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cfb48-4215-46c2-ac93-d7ddf35528dd None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:33.315584 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dde57a-6284-4785-845b-b4d980ddc4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:33.316315 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dde57a-6284-4785-845b-b4d980ddc4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:33.316599 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dde57a-6284-4785-845b-b4d980ddc4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:33.316872 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dde57a-6284-4785-845b-b4d980ddc4a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:33.330457 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dde57a-6284-4785-845b-b4d980ddc4a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:33.338152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-37dde57a-6284-4785-845b-b4d980ddc4a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:33:33.338152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:33.338152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:33.338152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:33.338152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:33.338152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:33.338152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:33.338152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:33.338152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:33.338152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:33.338152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:33.338152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:33.338152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:33.338152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:33.338152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:33.338152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:33.339302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:33.339302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:33.339302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:33.339302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:33.339302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:33.339302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:33.339302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:33.339302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:33.339302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:33.339302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:33.339302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:33.339302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:33:33.339302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:33.339302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:33.339302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:33.339302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:33.341566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:33.341566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:33.341566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:33.341566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:33.341566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:33.341566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:33.341566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:33.341566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:33.341566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:33.341566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:33.341566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:33:33.341566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:33:33.341566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 623/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:33:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:33.345944 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d219a74-a903-46b8-a690-c324096f1f3a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:33.365392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:33.448630 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d219a74-a903-46b8-a690-c324096f1f3a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:33.488952 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26453891-47d8-4236-b04b-f669f34c3848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:33.489696 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26453891-47d8-4236-b04b-f669f34c3848 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:33.489984 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26453891-47d8-4236-b04b-f669f34c3848 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:33.490277 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26453891-47d8-4236-b04b-f669f34c3848 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:33.491547 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26453891-47d8-4236-b04b-f669f34c3848 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:33.491861 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26453891-47d8-4236-b04b-f669f34c3848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:33.493285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26453891-47d8-4236-b04b-f669f34c3848 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:33.502727 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 641/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:33:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:33.511723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dde57a-6284-4785-845b-b4d980ddc4a7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:33.595610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:33.636537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dde57a-6284-4785-845b-b4d980ddc4a7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:33.671650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba8930-d2ad-4488-b483-181192a42cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:33.672373 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba8930-d2ad-4488-b483-181192a42cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:33.672664 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba8930-d2ad-4488-b483-181192a42cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:33.672936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba8930-d2ad-4488-b483-181192a42cf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:33.684579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba8930-d2ad-4488-b483-181192a42cf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:33.686100 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba8930-d2ad-4488-b483-181192a42cf7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:33.704458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-82ba8930-d2ad-4488-b483-181192a42cf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:33.704458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:33.704458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:33.704458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:33.704458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:33.704458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:33.704458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:33.704458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:33.704458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:33.704458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:33.704458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:33.704458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:33.704458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:33.704458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:33.704458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:33.705628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:33.705628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:33.705628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:33.705628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:33.705628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:33.705628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:33.705628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:33.705628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:33.705628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:33:33.705628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:33.705628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:33.705628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:33.705628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:33.705628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:33.705628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:33.705628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:33.705628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:33.706554 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:33.706554 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:33.706554 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:33.706554 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:33:33.706554 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 624/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:33.712358 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26453891-47d8-4236-b04b-f669f34c3848 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:33.800677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:33.822687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26453891-47d8-4236-b04b-f669f34c3848 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:33.857615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b3e15-1991-41dd-9198-8d3c4cc80f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:33.858194 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b3e15-1991-41dd-9198-8d3c4cc80f3c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:33.858478 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b3e15-1991-41dd-9198-8d3c4cc80f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:33.858746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b3e15-1991-41dd-9198-8d3c4cc80f3c None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:33.859463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b3e15-1991-41dd-9198-8d3c4cc80f3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:33.859765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b3e15-1991-41dd-9198-8d3c4cc80f3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:33.861182 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b3e15-1991-41dd-9198-8d3c4cc80f3c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:33.874286 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 642/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:33.880053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba8930-d2ad-4488-b483-181192a42cf7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:33.986199 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba8930-d2ad-4488-b483-181192a42cf7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:34.008065 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:34.024295 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bb815-4f4a-489d-99c2-7849c8cf0e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:34.025329 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bb815-4f4a-489d-99c2-7849c8cf0e68 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:34.025625 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bb815-4f4a-489d-99c2-7849c8cf0e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:34.025932 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bb815-4f4a-489d-99c2-7849c8cf0e68 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:34.036582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bb815-4f4a-489d-99c2-7849c8cf0e68 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:34.038098 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bb815-4f4a-489d-99c2-7849c8cf0e68 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:34.054083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-813bb815-4f4a-489d-99c2-7849c8cf0e68 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:33:34.054083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:34.054083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:34.054083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:34.054083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:34.054083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:34.054083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:34.054083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:34.054083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:34.054083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:34.054083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:34.054083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:34.054083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:33:34.054083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:33:34.054083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:33:34.054083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:33:34.056339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:34.056339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:34.056339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:33:34.056339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:33:34.056339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:33:34.056339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:33:34.056339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:34.056339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:34.056339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:34.056339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:34.056339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:34.056339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:33:34.056339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:34.056339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:34.056339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:34.056339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:34.056339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:34.056339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:34.058292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:34.058292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:34.058292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:33:34.058292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:33:34.058292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:33:34.058292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:33:34.058292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:33:34.058292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:33:34.058292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:33:34.058292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:33:34.058292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 625/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:33:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:34.062109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b3e15-1991-41dd-9198-8d3c4cc80f3c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:34.187641 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b3e15-1991-41dd-9198-8d3c4cc80f3c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:34.224989 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36f148-5d49-445c-a53b-55e1dadd5f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:34.225706 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36f148-5d49-445c-a53b-55e1dadd5f5b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:34.225990 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36f148-5d49-445c-a53b-55e1dadd5f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:34.226270 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36f148-5d49-445c-a53b-55e1dadd5f5b None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:34.227116 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36f148-5d49-445c-a53b-55e1dadd5f5b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:34.227424 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36f148-5d49-445c-a53b-55e1dadd5f5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:34.228960 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36f148-5d49-445c-a53b-55e1dadd5f5b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:34.239229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:34.249013 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 643/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 26 16:33:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:34.256032 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bb815-4f4a-489d-99c2-7849c8cf0e68 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:34.365522 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bb815-4f4a-489d-99c2-7849c8cf0e68 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:34.403841 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fac1e-ad28-49cd-bbd9-c426f9b3e80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:34.404644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fac1e-ad28-49cd-bbd9-c426f9b3e80f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:34.404926 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fac1e-ad28-49cd-bbd9-c426f9b3e80f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:34.405199 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fac1e-ad28-49cd-bbd9-c426f9b3e80f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:34.419183 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fac1e-ad28-49cd-bbd9-c426f9b3e80f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:34.426326 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fac1e-ad28-49cd-bbd9-c426f9b3e80f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:34.439376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-274fac1e-ad28-49cd-bbd9-c426f9b3e80f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:34.439376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:34.439376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:34.439376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:34.439376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:34.439376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:34.439376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:34.439376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:34.439376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:34.439376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:34.439376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:34.439376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:34.439376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:34.439376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:34.439376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:34.440526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:34.440526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:34.440526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:34.440526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:34.440526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:34.440526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:34.440526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:34.440526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:34.440526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:33:34.440526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:34.440526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:34.440526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:34.440526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:34.440526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:34.440526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:34.440526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:34.440526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:34.441903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:34.441903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:34.441903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:34.441903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:33:34.441903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 626/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:34.446564 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36f148-5d49-445c-a53b-55e1dadd5f5b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:34.551900 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36f148-5d49-445c-a53b-55e1dadd5f5b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:34.586179 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3f796-48e3-43ad-86f3-03ef9b081665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:34.586838 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3f796-48e3-43ad-86f3-03ef9b081665 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:34.587121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3f796-48e3-43ad-86f3-03ef9b081665 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:34.587403 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3f796-48e3-43ad-86f3-03ef9b081665 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:34.588109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3f796-48e3-43ad-86f3-03ef9b081665 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:34.588407 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3f796-48e3-43ad-86f3-03ef9b081665 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:34.589802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3f796-48e3-43ad-86f3-03ef9b081665 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:34.604239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 644/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:34.610500 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fac1e-ad28-49cd-bbd9-c426f9b3e80f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:34.643589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:34.711894 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fac1e-ad28-49cd-bbd9-c426f9b3e80f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:34.747957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1d679-c862-4bbc-9d8e-acd994f85890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:34.748751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1d679-c862-4bbc-9d8e-acd994f85890 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:34.749029 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1d679-c862-4bbc-9d8e-acd994f85890 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:34.749324 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1d679-c862-4bbc-9d8e-acd994f85890 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:34.756317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1d679-c862-4bbc-9d8e-acd994f85890 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:34.757592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1d679-c862-4bbc-9d8e-acd994f85890 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:34.771720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-a8d1d679-c862-4bbc-9d8e-acd994f85890 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:33:34.771720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:34.771720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:34.771720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:34.771720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:34.771720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:34.771720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:34.771720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:34.771720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:34.771720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:34.771720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:34.771720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:34.771720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:33:34.771720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:33:34.771720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:33:34.773525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:33:34.773525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:34.773525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:34.773525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:34.773525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:34.773525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:34.773525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:34.773525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:34.773525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:33:34.773525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:34.773525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:34.773525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:34.773525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:34.773525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:34.773525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:34.773525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:34.773525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:34.774805 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:33:34.774805 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:33:34.774805 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:33:34.774805 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:33:34.774805 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:33:34.774805 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:33:34.774805 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:33:34.774805 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:33:34.774805 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 627/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:33:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:34.779542 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3f796-48e3-43ad-86f3-03ef9b081665 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:34.838970 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:34.880089 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3f796-48e3-43ad-86f3-03ef9b081665 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:34.920162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc203b-cb6c-4eff-9942-dafcd001da4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:34.920817 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc203b-cb6c-4eff-9942-dafcd001da4b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:34.921098 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc203b-cb6c-4eff-9942-dafcd001da4b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:34.921423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc203b-cb6c-4eff-9942-dafcd001da4b None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:34.929188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc203b-cb6c-4eff-9942-dafcd001da4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:34.929188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc203b-cb6c-4eff-9942-dafcd001da4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:34.929188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc203b-cb6c-4eff-9942-dafcd001da4b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:34.936574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 645/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:33:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:34.942672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1d679-c862-4bbc-9d8e-acd994f85890 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:35.043226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:35.052426 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1d679-c862-4bbc-9d8e-acd994f85890 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:35.088590 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b44670-b590-4da0-a60e-5c94a4154e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:35.089500 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b44670-b590-4da0-a60e-5c94a4154e8a None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:35.089811 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b44670-b590-4da0-a60e-5c94a4154e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:35.090047 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b44670-b590-4da0-a60e-5c94a4154e8a None admin] PATH_INFO: `/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/beeefb9b8d394407a5e7a32f5a00ffad/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:35.092014 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b44670-b590-4da0-a60e-5c94a4154e8a None admin] RBAC: Authorizing `identity:create_grant(project_id=a3379cdd914747758e71b3b05c5921b1, user_id=beeefb9b8d394407a5e7a32f5a00ffad, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:35.093482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b44670-b590-4da0-a60e-5c94a4154e8a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:35.267051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 628/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 16:33:34 2022] PUT /identity/v3/projects/a3379cdd914747758e71b3b05c5921b1/users/beeefb9b8d394407a5e7a32f5a00ffad/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:33:37.498254 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3f0a5-63bd-4b37-9b58-13b8dd53ecb6 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:37.500598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3f0a5-63bd-4b37-9b58-13b8dd53ecb6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:37.500598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3f0a5-63bd-4b37-9b58-13b8dd53ecb6 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:37.501398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 646/1274] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:33:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:33:37.506954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80e346-4f14-42ce-9ebb-64ffb3b25e3e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:37.507454 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80e346-4f14-42ce-9ebb-64ffb3b25e3e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:37.507549 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80e346-4f14-42ce-9ebb-64ffb3b25e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:37.524780 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ff80e346-4f14-42ce-9ebb-64ffb3b25e3e None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:37.526106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ff80e346-4f14-42ce-9ebb-64ffb3b25e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:37.593617 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 629/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:33:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:33:37.618904 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3f0a5-63bd-4b37-9b58-13b8dd53ecb6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:37.782633 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3f0a5-63bd-4b37-9b58-13b8dd53ecb6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:37.806301 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:37.824448 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1ef19-7c60-410d-a124-128aa871c36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:37.825365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1ef19-7c60-410d-a124-128aa871c36f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:37.825696 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1ef19-7c60-410d-a124-128aa871c36f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:37.828606 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1ef19-7c60-410d-a124-128aa871c36f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:37.837870 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd1ef19-7c60-410d-a124-128aa871c36f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:33:37.846365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-7bd1ef19-7c60-410d-a124-128aa871c36f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:33:37.846365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:37.846365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:37.846365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:37.846365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:37.846365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:37.846365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:37.846365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:37.846365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:37.846365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:37.846365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:37.846365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:37.846365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:33:37.846365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:33:37.846365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:33:37.846365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:33:37.848472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:33:37.848472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:33:37.848472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:33:37.848472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:33:37.848472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:37.848472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:37.848472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:37.848472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:37.848472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:37.848472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:37.848472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:37.848472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:33:37.848472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:37.848472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:37.848472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:37.848472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:37.860820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:37.860820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:37.860820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:37.860820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:37.860820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:33:37.860820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:33:37.860820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:33:37.860820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:33:37.860820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:33:37.860820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:33:37.860820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:33:37.860820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:37.860820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 647/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 16:33:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:37.861826 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80e346-4f14-42ce-9ebb-64ffb3b25e3e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:37.949419 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:37.968899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80e346-4f14-42ce-9ebb-64ffb3b25e3e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:38.004508 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc479e05-146a-4dca-a74f-4ed6137be0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:38.005191 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc479e05-146a-4dca-a74f-4ed6137be0fe None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:38.005506 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc479e05-146a-4dca-a74f-4ed6137be0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:38.005784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc479e05-146a-4dca-a74f-4ed6137be0fe None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:38.006527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc479e05-146a-4dca-a74f-4ed6137be0fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:38.006839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc479e05-146a-4dca-a74f-4ed6137be0fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:38.008222 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc479e05-146a-4dca-a74f-4ed6137be0fe None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:38.017227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 630/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 16:33:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:38.023881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1ef19-7c60-410d-a124-128aa871c36f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:38.136231 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1ef19-7c60-410d-a124-128aa871c36f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:38.172141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fb9e4-ec3d-4c71-9232-0f9a877bae23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:38.173069 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fb9e4-ec3d-4c71-9232-0f9a877bae23 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:38.173311 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fb9e4-ec3d-4c71-9232-0f9a877bae23 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:38.173588 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fb9e4-ec3d-4c71-9232-0f9a877bae23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:38.188975 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091fb9e4-ec3d-4c71-9232-0f9a877bae23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:38.196445 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091fb9e4-ec3d-4c71-9232-0f9a877bae23 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:38.210860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-091fb9e4-ec3d-4c71-9232-0f9a877bae23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:38.210860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:38.210860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:38.210860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:38.210860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:38.210860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:38.210860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:38.210860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:38.210860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:38.210860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:38.210860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:38.210860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:38.210860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:38.210860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:38.210860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:38.213032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:38.213032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:38.213032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:38.213032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:38.213032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:38.213032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:38.213032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:38.213032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:38.213032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:33:38.213032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:38.213032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:38.213032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:38.213032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:38.213032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:38.213032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:38.213032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:38.213032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:38.214577 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:38.214577 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:38.214577 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:38.214577 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:38.214577 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 648/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:38.218237 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc479e05-146a-4dca-a74f-4ed6137be0fe None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:38.328473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc479e05-146a-4dca-a74f-4ed6137be0fe None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:38.363651 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3287735-d5e2-40e2-b9b3-e3ca4baf253c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:38.364404 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3287735-d5e2-40e2-b9b3-e3ca4baf253c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:38.364689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3287735-d5e2-40e2-b9b3-e3ca4baf253c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:38.364965 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3287735-d5e2-40e2-b9b3-e3ca4baf253c None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:38.366318 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3287735-d5e2-40e2-b9b3-e3ca4baf253c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:38.366629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3287735-d5e2-40e2-b9b3-e3ca4baf253c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:38.368076 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3287735-d5e2-40e2-b9b3-e3ca4baf253c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:38.381224 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 631/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:38.387345 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fb9e4-ec3d-4c71-9232-0f9a877bae23 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:38.420970 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:38.508224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fb9e4-ec3d-4c71-9232-0f9a877bae23 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:38.553034 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e45b1e-c477-4958-ba44-5b05b26b9a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:38.553870 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e45b1e-c477-4958-ba44-5b05b26b9a44 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:38.554156 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e45b1e-c477-4958-ba44-5b05b26b9a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:38.554433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e45b1e-c477-4958-ba44-5b05b26b9a44 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:38.562572 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e45b1e-c477-4958-ba44-5b05b26b9a44 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:38.564038 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e45b1e-c477-4958-ba44-5b05b26b9a44 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:38.579162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-33e45b1e-c477-4958-ba44-5b05b26b9a44 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:33:38.579162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:38.579162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:38.579162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:38.579162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:38.579162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:38.579162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:38.579162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:38.579162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:38.579162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:38.579162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:38.579162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:38.579162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:33:38.579162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:33:38.579162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:33:38.579162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:33:38.580310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:38.580310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:38.580310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:33:38.580310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:33:38.580310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:33:38.580310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:33:38.580310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:38.580310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:38.580310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:38.580310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:38.580310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:38.580310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:33:38.580310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:38.580310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:38.580310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:38.580310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:38.580310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:38.580310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:38.581469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:38.581469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:38.581469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:33:38.581469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:33:38.581469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:33:38.581469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:33:38.581469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:33:38.581469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:33:38.581469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:33:38.581469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:38.581469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 649/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:33:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:38.587208 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3287735-d5e2-40e2-b9b3-e3ca4baf253c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:38.591130 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:38.695611 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3287735-d5e2-40e2-b9b3-e3ca4baf253c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:38.729351 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ab4a2-5fc6-49b4-a089-be457f3edff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:38.730026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ab4a2-5fc6-49b4-a089-be457f3edff4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:38.730311 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ab4a2-5fc6-49b4-a089-be457f3edff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:38.730589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ab4a2-5fc6-49b4-a089-be457f3edff4 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:38.731418 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ab4a2-5fc6-49b4-a089-be457f3edff4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:38.731728 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ab4a2-5fc6-49b4-a089-be457f3edff4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:38.733242 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ab4a2-5fc6-49b4-a089-be457f3edff4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:38.752227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 632/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 26 16:33:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:38.759040 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e45b1e-c477-4958-ba44-5b05b26b9a44 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:38.855593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:38.867552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e45b1e-c477-4958-ba44-5b05b26b9a44 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:38.906545 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e590c93-5769-4f12-a4b4-56c9937808e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:38.907217 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e590c93-5769-4f12-a4b4-56c9937808e5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:38.907503 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e590c93-5769-4f12-a4b4-56c9937808e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:38.907780 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e590c93-5769-4f12-a4b4-56c9937808e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:38.987202 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e590c93-5769-4f12-a4b4-56c9937808e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:38.988665 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e590c93-5769-4f12-a4b4-56c9937808e5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:39.082293 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:39.093014 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 650/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 16:33:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:33:39.101394 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ab4a2-5fc6-49b4-a089-be457f3edff4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:39.169542 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:39.208836 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ab4a2-5fc6-49b4-a089-be457f3edff4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:39.243579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485bee6e-abe4-4c30-99b8-a0c85a04d7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:39.245693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bee6e-abe4-4c30-99b8-a0c85a04d7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:39.245693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bee6e-abe4-4c30-99b8-a0c85a04d7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:39.245693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bee6e-abe4-4c30-99b8-a0c85a04d7a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:39.255976 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485bee6e-abe4-4c30-99b8-a0c85a04d7a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:39.257650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485bee6e-abe4-4c30-99b8-a0c85a04d7a6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:39.275579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-485bee6e-abe4-4c30-99b8-a0c85a04d7a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:39.275579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:39.275579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:39.275579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:39.275579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:39.275579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:39.275579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:39.275579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:39.275579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:39.275579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:39.275579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:39.275579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:39.275579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:33:39.275579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:33:39.275579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:33:39.276795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:33:39.276795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:39.276795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:39.276795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:39.276795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:39.276795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:39.276795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:39.276795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:39.276795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:33:39.276795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:39.276795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:39.276795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:39.276795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:39.276795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:39.276795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:39.276795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:39.276795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:39.278153 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:33:39.278153 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:33:39.278153 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:33:39.278153 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:33:39.278153 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 633/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:39.282514 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e590c93-5769-4f12-a4b4-56c9937808e5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:39.385922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e590c93-5769-4f12-a4b4-56c9937808e5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:39.422994 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01970820-366b-447b-af7f-359a66c4805c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:39.423667 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01970820-366b-447b-af7f-359a66c4805c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:39.423953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01970820-366b-447b-af7f-359a66c4805c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:39.424227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01970820-366b-447b-af7f-359a66c4805c None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:39.424955 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01970820-366b-447b-af7f-359a66c4805c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:39.425290 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01970820-366b-447b-af7f-359a66c4805c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:39.426686 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01970820-366b-447b-af7f-359a66c4805c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:39.438852 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 651/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 16:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:39.444695 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485bee6e-abe4-4c30-99b8-a0c85a04d7a6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:39.563941 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485bee6e-abe4-4c30-99b8-a0c85a04d7a6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:39.585571 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:39.609267 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707807b-332d-4dc6-a954-940fa4b65878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:39.610103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707807b-332d-4dc6-a954-940fa4b65878 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:39.610388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707807b-332d-4dc6-a954-940fa4b65878 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:39.610665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707807b-332d-4dc6-a954-940fa4b65878 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:39.618856 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707807b-332d-4dc6-a954-940fa4b65878 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:39.620334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707807b-332d-4dc6-a954-940fa4b65878 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:39.635903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d707807b-332d-4dc6-a954-940fa4b65878 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:33:39.635903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:39.635903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:39.635903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:39.635903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:39.635903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:39.635903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:39.635903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:39.635903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:39.635903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:39.635903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:39.635903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:39.635903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:33:39.635903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:33:39.635903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:33:39.637070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:33:39.637070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:39.637070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:39.637070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:39.637070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:39.637070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:39.637070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:39.637070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:39.637070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( May 26 16:33:39.637070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:39.637070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:39.637070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:39.637070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:39.637070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:39.637070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:39.637070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:39.637070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:39.638825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:33:39.638825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:33:39.638825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:33:39.638825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:33:39.638825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:33:39.638825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:33:39.638825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:33:39.638825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application May 26 16:33:39.641476 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 634/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 16:33:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:39.643363 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01970820-366b-447b-af7f-359a66c4805c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:39.696905 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:39.747723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01970820-366b-447b-af7f-359a66c4805c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:39.786679 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb181aa-aa59-458d-8c23-92ee433da9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:39.787831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb181aa-aa59-458d-8c23-92ee433da9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:39.788110 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb181aa-aa59-458d-8c23-92ee433da9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:39.788378 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb181aa-aa59-458d-8c23-92ee433da9a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:39.789150 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb181aa-aa59-458d-8c23-92ee433da9a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:39.789477 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb181aa-aa59-458d-8c23-92ee433da9a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:39.790907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb181aa-aa59-458d-8c23-92ee433da9a3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:39.802840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 652/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 16:33:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:39.810005 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707807b-332d-4dc6-a954-940fa4b65878 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:39.922408 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707807b-332d-4dc6-a954-940fa4b65878 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:39.958274 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1611874-aeb1-4dc7-8250-b9d1fd07444f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:39.958891 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1611874-aeb1-4dc7-8250-b9d1fd07444f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:39.959710 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1611874-aeb1-4dc7-8250-b9d1fd07444f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:39.959986 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1611874-aeb1-4dc7-8250-b9d1fd07444f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:39.960819 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1611874-aeb1-4dc7-8250-b9d1fd07444f None admin] RBAC: Adding query filter params (role.id=796e313fa8794ac885ccf6300d09332a, scope.project.id=a3379cdd914747758e71b3b05c5921b1, user.id=beeefb9b8d394407a5e7a32f5a00ffad) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:39.961130 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1611874-aeb1-4dc7-8250-b9d1fd07444f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:39.962616 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1611874-aeb1-4dc7-8250-b9d1fd07444f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:39.969414 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 635/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 16:33:39 2022] GET /identity/v3/role_assignments?user.id=beeefb9b8d394407a5e7a32f5a00ffad&scope.project.id=a3379cdd914747758e71b3b05c5921b1&role.id=796e313fa8794ac885ccf6300d09332a => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:42.271913 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a4f04-0965-47f7-a7e2-c14bd5449b83 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:42.272547 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a4f04-0965-47f7-a7e2-c14bd5449b83 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:42.272547 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a4f04-0965-47f7-a7e2-c14bd5449b83 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:42.273852 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 653/1288] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:33:42.279275 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c782b30-0093-441f-ad2a-7f815c700223 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:42.279755 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c782b30-0093-441f-ad2a-7f815c700223 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:42.279873 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c782b30-0093-441f-ad2a-7f815c700223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:42.296921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8c782b30-0093-441f-ad2a-7f815c700223 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:42.298212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8c782b30-0093-441f-ad2a-7f815c700223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:42.332178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:42.371477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 636/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:33:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:33:42.394929 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a4f04-0965-47f7-a7e2-c14bd5449b83 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:42.508767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a4f04-0965-47f7-a7e2-c14bd5449b83 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:42.520516 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:42.543584 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b009f8-6ffb-499e-b5ca-23a13bf07bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:42.544384 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b009f8-6ffb-499e-b5ca-23a13bf07bfb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:42.544662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b009f8-6ffb-499e-b5ca-23a13bf07bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:42.544931 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b009f8-6ffb-499e-b5ca-23a13bf07bfb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:42.545606 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b009f8-6ffb-499e-b5ca-23a13bf07bfb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:42.547011 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b009f8-6ffb-499e-b5ca-23a13bf07bfb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:42.559222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-c1b009f8-6ffb-499e-b5ca-23a13bf07bfb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:33:42.559222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:42.559222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:33:42.559222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:33:42.559222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:33:42.559222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:33:42.559222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:33:42.559222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:33:42.559222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:33:42.559222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:42.559222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:33:42.559222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:42.559222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:42.559222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:42.559222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:42.559222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:42.559222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:42.560509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:42.560509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:42.560509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:42.560509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:42.560509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:42.560509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:42.560509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:33:42.560509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:33:42.560509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:33:42.560509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:33:42.560509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:42.560509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:42.560509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:42.560509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:42.560509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:42.560509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:42.561623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:42.561623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:33:42.561623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:42.561623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:42.561623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:42.561623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:42.561623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:42.561623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:42.561623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:42.561623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:42.561623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:33:42.561623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:33:42.561623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:33:42.561623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:42.561623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 654/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 26 16:33:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:42.566647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c782b30-0093-441f-ad2a-7f815c700223 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:42.665771 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c782b30-0093-441f-ad2a-7f815c700223 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:42.701555 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffab3a-79b3-4db4-9bb5-d8aea4002301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:42.702230 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffab3a-79b3-4db4-9bb5-d8aea4002301 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:42.702510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffab3a-79b3-4db4-9bb5-d8aea4002301 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:42.702787 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffab3a-79b3-4db4-9bb5-d8aea4002301 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:42.703494 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffab3a-79b3-4db4-9bb5-d8aea4002301 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:42.703801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffab3a-79b3-4db4-9bb5-d8aea4002301 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:42.705197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffab3a-79b3-4db4-9bb5-d8aea4002301 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:42.710590 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 637/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Thu May 26 16:33:42 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:42.716704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b009f8-6ffb-499e-b5ca-23a13bf07bfb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:42.828040 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b009f8-6ffb-499e-b5ca-23a13bf07bfb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:42.869319 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12924dc2-bf62-4893-a859-ed99ffa7fe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:42.870010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12924dc2-bf62-4893-a859-ed99ffa7fe1c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:42.870294 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12924dc2-bf62-4893-a859-ed99ffa7fe1c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:42.870568 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12924dc2-bf62-4893-a859-ed99ffa7fe1c None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:42.871274 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12924dc2-bf62-4893-a859-ed99ffa7fe1c None admin] RBAC: Adding query filter params (type=placement) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:42.871577 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12924dc2-bf62-4893-a859-ed99ffa7fe1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:42.872945 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12924dc2-bf62-4893-a859-ed99ffa7fe1c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:42.877926 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 655/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Thu May 26 16:33:42 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:45.102232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ab708-3ee2-4b0d-af35-1391b9807834 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:45.102776 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ab708-3ee2-4b0d-af35-1391b9807834 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:45.102776 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ab708-3ee2-4b0d-af35-1391b9807834 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:45.104215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 638/1293] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:33:45.109773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e78df4-272d-4cd2-909f-edf616b26c7c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:45.110279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e78df4-272d-4cd2-909f-edf616b26c7c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:45.110410 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e78df4-272d-4cd2-909f-edf616b26c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:45.128192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c9e78df4-272d-4cd2-909f-edf616b26c7c None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:45.129507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c9e78df4-272d-4cd2-909f-edf616b26c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:45.163249 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:45.202601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 656/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:33:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:33:45.226205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ab708-3ee2-4b0d-af35-1391b9807834 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:45.259850 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:45.334348 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ab708-3ee2-4b0d-af35-1391b9807834 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:45.370875 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217f977-3b36-480f-8a4d-de1e03bc06eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:45.371526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217f977-3b36-480f-8a4d-de1e03bc06eb None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:45.371809 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217f977-3b36-480f-8a4d-de1e03bc06eb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:45.372082 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217f977-3b36-480f-8a4d-de1e03bc06eb None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:45.372826 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217f977-3b36-480f-8a4d-de1e03bc06eb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:45.374389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217f977-3b36-480f-8a4d-de1e03bc06eb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:45.730086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 639/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 16:33:45 2022] POST /identity/v3/services => generated 246 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:33:48.016127 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a6f40-72d0-4a6f-a47e-b0a9755a9d75 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:48.017179 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a6f40-72d0-4a6f-a47e-b0a9755a9d75 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:48.017179 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a6f40-72d0-4a6f-a47e-b0a9755a9d75 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:48.018197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 657/1296] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:33:48.025571 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550ce95-72b0-474a-b47a-34289f3710cf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:48.026164 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550ce95-72b0-474a-b47a-34289f3710cf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:48.026533 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550ce95-72b0-474a-b47a-34289f3710cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:48.055649 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c550ce95-72b0-474a-b47a-34289f3710cf None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:48.057447 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c550ce95-72b0-474a-b47a-34289f3710cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:48.160788 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 640/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:33:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:33:48.185817 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a6f40-72d0-4a6f-a47e-b0a9755a9d75 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:48.302269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a6f40-72d0-4a6f-a47e-b0a9755a9d75 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:48.342328 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920aab3-ee7b-4e45-bae1-99d8cb3bdfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:48.343142 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920aab3-ee7b-4e45-bae1-99d8cb3bdfc4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:48.343420 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920aab3-ee7b-4e45-bae1-99d8cb3bdfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:48.343688 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920aab3-ee7b-4e45-bae1-99d8cb3bdfc4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:48.344602 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920aab3-ee7b-4e45-bae1-99d8cb3bdfc4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:48.346031 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920aab3-ee7b-4e45-bae1-99d8cb3bdfc4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:48.359021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-4920aab3-ee7b-4e45-bae1-99d8cb3bdfc4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:33:48.359021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:48.359021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:33:48.359021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:33:48.359021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:33:48.359021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:33:48.359021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:33:48.359021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:33:48.359021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:33:48.359021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:48.359021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:33:48.359021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:48.359021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:48.359021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:48.359021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:48.359021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:48.359021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:48.360459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:48.360459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:48.360459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:48.360459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:48.360459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:48.360459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:48.360459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:33:48.360459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:33:48.360459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:33:48.360459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:33:48.360459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:48.360459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:48.360459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:48.360459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:48.360459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:48.360459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:48.361920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:48.361920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:33:48.361920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:48.361920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:48.361920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:48.361920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:48.361920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:48.361920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:48.361920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:48.361920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:48.361920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:33:48.361920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:33:48.361920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:33:48.361920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:48.361920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 658/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 26 16:33:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:48.367420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550ce95-72b0-474a-b47a-34289f3710cf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:48.389216 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:48.497340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550ce95-72b0-474a-b47a-34289f3710cf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:48.540804 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a2648-3e27-4781-9af7-06007f1c127f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:48.541727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a2648-3e27-4781-9af7-06007f1c127f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:48.542022 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a2648-3e27-4781-9af7-06007f1c127f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:48.542851 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a2648-3e27-4781-9af7-06007f1c127f None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:48.543480 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a2648-3e27-4781-9af7-06007f1c127f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:48.543787 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a2648-3e27-4781-9af7-06007f1c127f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:48.545431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a2648-3e27-4781-9af7-06007f1c127f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:48.551544 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 641/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Thu May 26 16:33:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:48.561059 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920aab3-ee7b-4e45-bae1-99d8cb3bdfc4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:48.607850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:48.701973 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920aab3-ee7b-4e45-bae1-99d8cb3bdfc4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:48.749901 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c79b79-8f66-4019-9ef5-af72691a0ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:48.750648 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c79b79-8f66-4019-9ef5-af72691a0ccc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:48.750934 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c79b79-8f66-4019-9ef5-af72691a0ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:48.751204 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c79b79-8f66-4019-9ef5-af72691a0ccc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:48.752109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c79b79-8f66-4019-9ef5-af72691a0ccc None admin] RBAC: Adding query filter params (interface=public, service_id=6ce156f44a3744248dd167efb11b08a4, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:48.752416 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c79b79-8f66-4019-9ef5-af72691a0ccc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:48.753846 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c79b79-8f66-4019-9ef5-af72691a0ccc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:48.760998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 659/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 26 16:33:48 2022] GET /identity/v3/endpoints?service_id=6ce156f44a3744248dd167efb11b08a4&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:48.767106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a2648-3e27-4781-9af7-06007f1c127f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:48.893202 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:48.915191 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a2648-3e27-4781-9af7-06007f1c127f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:48.959439 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ba83a-9bd9-4ff0-ae9a-10cc554d3f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:48.960263 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ba83a-9bd9-4ff0-ae9a-10cc554d3f78 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:48.960651 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ba83a-9bd9-4ff0-ae9a-10cc554d3f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:48.961034 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ba83a-9bd9-4ff0-ae9a-10cc554d3f78 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:48.961859 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ba83a-9bd9-4ff0-ae9a-10cc554d3f78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:48.963524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ba83a-9bd9-4ff0-ae9a-10cc554d3f78 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:48.971076 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 642/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 26 16:33:48 2022] GET /identity/v3/services => generated 2191 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:33:51.397151 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224f0ef-a062-4cfd-866f-07639bfec7bf None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:51.397703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224f0ef-a062-4cfd-866f-07639bfec7bf None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:51.397703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224f0ef-a062-4cfd-866f-07639bfec7bf None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:51.399047 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 660/1302] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:33:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:33:51.404865 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ea2be-42e7-44ff-bf98-41b2263dccd5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:51.405421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ea2be-42e7-44ff-bf98-41b2263dccd5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:51.405532 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ea2be-42e7-44ff-bf98-41b2263dccd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:51.425614 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ed7ea2be-42e7-44ff-bf98-41b2263dccd5 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:51.426840 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ed7ea2be-42e7-44ff-bf98-41b2263dccd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:51.507429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 643/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:33:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:33:51.532082 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224f0ef-a062-4cfd-866f-07639bfec7bf None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:51.637508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:51.644686 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224f0ef-a062-4cfd-866f-07639bfec7bf None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:51.695641 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c634931-0369-4fe5-9d65-01d36e17a41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:51.696377 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c634931-0369-4fe5-9d65-01d36e17a41b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:51.696655 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c634931-0369-4fe5-9d65-01d36e17a41b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:51.696926 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c634931-0369-4fe5-9d65-01d36e17a41b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:51.697609 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c634931-0369-4fe5-9d65-01d36e17a41b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:51.698995 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c634931-0369-4fe5-9d65-01d36e17a41b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:51.714586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-3c634931-0369-4fe5-9d65-01d36e17a41b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:33:51.714586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:51.714586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:33:51.714586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:33:51.714586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:33:51.714586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:33:51.714586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:33:51.714586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:33:51.714586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:33:51.714586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:51.714586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:33:51.714586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:51.714586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:33:51.714586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:33:51.714586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:33:51.714586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:33:51.714586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:33:51.715886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:33:51.715886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:33:51.715886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:33:51.715886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:33:51.715886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:33:51.715886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:33:51.715886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:33:51.715886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:33:51.715886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:33:51.715886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:33:51.715886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:33:51.715886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:33:51.715886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:33:51.715886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:33:51.715886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:33:51.715886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:33:51.716876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:33:51.716876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( May 26 16:33:51.716876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:33:51.716876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() May 26 16:33:51.716876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:33:51.716876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:33:51.716876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:33:51.716876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() May 26 16:33:51.716876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:33:51.716876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( May 26 16:33:51.716876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:33:51.716876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:33:51.716876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:33:51.716876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application May 26 16:33:51.716876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 661/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 26 16:33:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:33:51.722496 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ea2be-42e7-44ff-bf98-41b2263dccd5 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:51.804665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:51.831706 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ea2be-42e7-44ff-bf98-41b2263dccd5 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:51.885412 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1417ea8-08ce-4f83-94ca-75c12401f74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:51.886468 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1417ea8-08ce-4f83-94ca-75c12401f74c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:51.886904 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1417ea8-08ce-4f83-94ca-75c12401f74c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:51.887333 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1417ea8-08ce-4f83-94ca-75c12401f74c None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:51.888471 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1417ea8-08ce-4f83-94ca-75c12401f74c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:33:51.888954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1417ea8-08ce-4f83-94ca-75c12401f74c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:51.891263 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1417ea8-08ce-4f83-94ca-75c12401f74c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:51.900722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 644/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Thu May 26 16:33:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:33:51.907384 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c634931-0369-4fe5-9d65-01d36e17a41b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:52.020329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c634931-0369-4fe5-9d65-01d36e17a41b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:52.062606 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535bb960-dd37-442c-90f3-41ff807c52f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:52.063283 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bb960-dd37-442c-90f3-41ff807c52f6 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:52.063570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bb960-dd37-442c-90f3-41ff807c52f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:52.063845 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bb960-dd37-442c-90f3-41ff807c52f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:52.064595 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535bb960-dd37-442c-90f3-41ff807c52f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:52.066022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535bb960-dd37-442c-90f3-41ff807c52f6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:52.285290 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 662/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 26 16:33:51 2022] POST /identity/v3/endpoints => generated 331 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:34:01.945560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=30 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:02.279121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:50.413233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f8078-6b48-46f4-a4d6-eb813ff3da79 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:50.415968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f8078-6b48-46f4-a4d6-eb813ff3da79 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:50.416809 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f8078-6b48-46f4-a4d6-eb813ff3da79 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:50.420423 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 645/1307] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:43:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:50.427628 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfea579-245f-4347-8e20-6f39dad80934 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:50.429111 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfea579-245f-4347-8e20-6f39dad80934 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:50.430266 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfea579-245f-4347-8e20-6f39dad80934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:50.660546 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-abfea579-245f-4347-8e20-6f39dad80934 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:50.663152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-abfea579-245f-4347-8e20-6f39dad80934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:50.960718 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 663/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 535 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:51.032966 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685014d-97e6-4fbd-b9b4-8e1b29f3fe90 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:51.033568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685014d-97e6-4fbd-b9b4-8e1b29f3fe90 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:51.034326 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685014d-97e6-4fbd-b9b4-8e1b29f3fe90 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:51.037832 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 646/1309] 10.222.0.48 () {54 vars in 964 bytes} [Thu May 26 16:43:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:51.045396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26eacc-084a-40fc-8dd5-113363d0ee55 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:51.045698 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26eacc-084a-40fc-8dd5-113363d0ee55 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:51.045980 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26eacc-084a-40fc-8dd5-113363d0ee55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:51.200119 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9f26eacc-084a-40fc-8dd5-113363d0ee55 None None] MFA Rules not processed for user `d577b5295f9e4a4388bb6293d1c33d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:51.201390 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9f26eacc-084a-40fc-8dd5-113363d0ee55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:51.262382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:51.378572 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 664/1310] 10.222.0.48 () {58 vars in 1061 bytes} [Thu May 26 16:43:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:51.388624 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685014d-97e6-4fbd-b9b4-8e1b29f3fe90 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:51.390917 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7685014d-97e6-4fbd-b9b4-8e1b29f3fe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:51.567166 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685014d-97e6-4fbd-b9b4-8e1b29f3fe90 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:51.658400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f9c83-c9ac-4ff2-9cfc-763d36f4e6a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:51.659081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f9c83-c9ac-4ff2-9cfc-763d36f4e6a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:51.659360 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f9c83-c9ac-4ff2-9cfc-763d36f4e6a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:51.659633 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f9c83-c9ac-4ff2-9cfc-763d36f4e6a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:51.661576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-156f9c83-c9ac-4ff2-9cfc-763d36f4e6a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:51.731243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:51.795768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f9c83-c9ac-4ff2-9cfc-763d36f4e6a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:51.797478 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f9c83-c9ac-4ff2-9cfc-763d36f4e6a2 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:51.821736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 647/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:43:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:54.927360 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebafa47-1fc1-4231-b6bb-fe1d9bdbd6f0 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:54.927912 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebafa47-1fc1-4231-b6bb-fe1d9bdbd6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:54.928540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebafa47-1fc1-4231-b6bb-fe1d9bdbd6f0 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:54.931745 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 665/1312] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:43:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:54.940844 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb4f9f-8e54-43ba-982f-66299ad0cfe1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:54.941442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb4f9f-8e54-43ba-982f-66299ad0cfe1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:54.941945 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb4f9f-8e54-43ba-982f-66299ad0cfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:55.050183 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e8cb4f9f-8e54-43ba-982f-66299ad0cfe1 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:55.051412 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e8cb4f9f-8e54-43ba-982f-66299ad0cfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:55.187927 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 648/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:55.230735 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebafa47-1fc1-4231-b6bb-fe1d9bdbd6f0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:55.233623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0ebafa47-1fc1-4231-b6bb-fe1d9bdbd6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:55.398006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebafa47-1fc1-4231-b6bb-fe1d9bdbd6f0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:55.517412 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:55.520178 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b0fa3-72e5-49ba-b0d4-4a9066bdf2eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:55.520907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b0fa3-72e5-49ba-b0d4-4a9066bdf2eb service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:55.521195 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b0fa3-72e5-49ba-b0d4-4a9066bdf2eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:55.521503 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b0fa3-72e5-49ba-b0d4-4a9066bdf2eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:55.523205 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b74b0fa3-72e5-49ba-b0d4-4a9066bdf2eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:55.693907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b0fa3-72e5-49ba-b0d4-4a9066bdf2eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:55.695650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b0fa3-72e5-49ba-b0d4-4a9066bdf2eb service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:55.719783 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 666/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:43:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:59.217004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bfe39-290a-472f-9119-69aeb65b6a8b None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.217633 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bfe39-290a-472f-9119-69aeb65b6a8b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.217633 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bfe39-290a-472f-9119-69aeb65b6a8b None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.219056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 649/1315] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:43:59.224498 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f15f1-e297-46f2-b49e-42dc96499a6a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.224948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f15f1-e297-46f2-b49e-42dc96499a6a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.225068 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f15f1-e297-46f2-b49e-42dc96499a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.326872 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ab0f15f1-e297-46f2-b49e-42dc96499a6a None None] MFA Rules not processed for user `4e70b03ce9684918961bd5fcc34afa71`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:59.328447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ab0f15f1-e297-46f2-b49e-42dc96499a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:59.396754 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:59.463188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 667/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:43:59 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:59.504988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bfe39-290a-472f-9119-69aeb65b6a8b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:59.506592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-727bfe39-290a-472f-9119-69aeb65b6a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:59.522252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:59.639517 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bfe39-290a-472f-9119-69aeb65b6a8b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:59.725826 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2440d-f137-4628-942e-3edbb653f1af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:59.726641 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2440d-f137-4628-942e-3edbb653f1af service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.726988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2440d-f137-4628-942e-3edbb653f1af service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.727393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2440d-f137-4628-942e-3edbb653f1af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.729169 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b7f2440d-f137-4628-942e-3edbb653f1af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:59.799890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:59.851824 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2440d-f137-4628-942e-3edbb653f1af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:59.853977 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2440d-f137-4628-942e-3edbb653f1af service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:59.874149 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 650/1317] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:43:59 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:03.116980 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b28da-3891-432c-b57a-85200414bc65 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:03.118236 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b28da-3891-432c-b57a-85200414bc65 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:03.118588 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b28da-3891-432c-b57a-85200414bc65 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:03.121144 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 668/1318] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:44:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:03.126828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18508e43-ca22-4be5-a893-06ba696efa7d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:03.127330 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18508e43-ca22-4be5-a893-06ba696efa7d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:03.127438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18508e43-ca22-4be5-a893-06ba696efa7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:03.196017 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-18508e43-ca22-4be5-a893-06ba696efa7d None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:03.197222 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-18508e43-ca22-4be5-a893-06ba696efa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:03.299348 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 651/1319] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:44:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:03.339189 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b28da-3891-432c-b57a-85200414bc65 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:03.340725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ef0b28da-3891-432c-b57a-85200414bc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:03.457475 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b28da-3891-432c-b57a-85200414bc65 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:03.547458 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5684a-9ae3-42e2-baf0-f74875504f19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:03.548126 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5684a-9ae3-42e2-baf0-f74875504f19 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:03.548405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5684a-9ae3-42e2-baf0-f74875504f19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:03.548674 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5684a-9ae3-42e2-baf0-f74875504f19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:03.550452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8bc5684a-9ae3-42e2-baf0-f74875504f19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:03.558808 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:03.664775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5684a-9ae3-42e2-baf0-f74875504f19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:03.665979 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5684a-9ae3-42e2-baf0-f74875504f19 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:03.687897 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 669/1320] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:44:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:44:07.349647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d42020-b440-4e77-bb6b-2298b5fffe9d None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.350301 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d42020-b440-4e77-bb6b-2298b5fffe9d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.350301 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d42020-b440-4e77-bb6b-2298b5fffe9d None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.351745 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 652/1321] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:07.358249 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45841b88-328b-4b62-9bb8-92706c81381e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.359035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45841b88-328b-4b62-9bb8-92706c81381e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.359200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45841b88-328b-4b62-9bb8-92706c81381e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.437918 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-45841b88-328b-4b62-9bb8-92706c81381e None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:07.439166 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-45841b88-328b-4b62-9bb8-92706c81381e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:07.520596 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:07.565162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 670/1322] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:07.616552 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba4044-0d77-4cf5-bcc5-99dea9528a72 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.616874 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba4044-0d77-4cf5-bcc5-99dea9528a72 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.617343 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba4044-0d77-4cf5-bcc5-99dea9528a72 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.618857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 653/1323] 10.222.0.48 () {54 vars in 964 bytes} [Thu May 26 16:44:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:07.625506 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590af2c-5bf2-4e14-9bfb-0385b75a6eed None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.625799 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590af2c-5bf2-4e14-9bfb-0385b75a6eed None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.626109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590af2c-5bf2-4e14-9bfb-0385b75a6eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.737346 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9590af2c-5bf2-4e14-9bfb-0385b75a6eed None None] MFA Rules not processed for user `d577b5295f9e4a4388bb6293d1c33d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:07.739032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9590af2c-5bf2-4e14-9bfb-0385b75a6eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:07.842570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 671/1324] 10.222.0.48 () {58 vars in 1061 bytes} [Thu May 26 16:44:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:07.852451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba4044-0d77-4cf5-bcc5-99dea9528a72 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:07.856248 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f1ba4044-0d77-4cf5-bcc5-99dea9528a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:07.885467 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:07.985227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba4044-0d77-4cf5-bcc5-99dea9528a72 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:08.064726 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e53bdd-e49f-497b-8237-613474a40069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:08.065772 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e53bdd-e49f-497b-8237-613474a40069 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:08.066060 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e53bdd-e49f-497b-8237-613474a40069 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:08.066326 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e53bdd-e49f-497b-8237-613474a40069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.068021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-74e53bdd-e49f-497b-8237-613474a40069 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:08.158687 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:08.213939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e53bdd-e49f-497b-8237-613474a40069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:08.215529 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e53bdd-e49f-497b-8237-613474a40069 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:08.240144 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 654/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:10.858654 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5c8c4-ae55-47dd-96c1-1ecad6479d50 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:10.859332 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5c8c4-ae55-47dd-96c1-1ecad6479d50 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:10.859332 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5c8c4-ae55-47dd-96c1-1ecad6479d50 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:10.860579 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 672/1326] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:10.866505 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570510ce-761b-4445-8cbf-7b2ae25385a8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:10.867247 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570510ce-761b-4445-8cbf-7b2ae25385a8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:10.867601 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570510ce-761b-4445-8cbf-7b2ae25385a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:10.941139 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-570510ce-761b-4445-8cbf-7b2ae25385a8 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:10.942740 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-570510ce-761b-4445-8cbf-7b2ae25385a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:11.081733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 655/1327] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:11.119185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5c8c4-ae55-47dd-96c1-1ecad6479d50 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:11.120822 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c3b5c8c4-ae55-47dd-96c1-1ecad6479d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:11.212604 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:11.287163 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5c8c4-ae55-47dd-96c1-1ecad6479d50 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:11.370691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f16e9-9694-4f1d-b4b8-ca864872d8a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:11.371279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f16e9-9694-4f1d-b4b8-ca864872d8a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.371556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f16e9-9694-4f1d-b4b8-ca864872d8a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.371822 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f16e9-9694-4f1d-b4b8-ca864872d8a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.373520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-249f16e9-9694-4f1d-b4b8-ca864872d8a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:11.497138 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:11.499810 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f16e9-9694-4f1d-b4b8-ca864872d8a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:11.501368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f16e9-9694-4f1d-b4b8-ca864872d8a3 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:11.521788 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 673/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:44:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:13.934619 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4b414-efbe-4b27-9e69-20e1a3335e2c None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:13.935257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4b414-efbe-4b27-9e69-20e1a3335e2c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:13.935257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4b414-efbe-4b27-9e69-20e1a3335e2c None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:13.936564 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 656/1329] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:13.942439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3a704-8a9a-423f-b8d7-74ad2b4c699f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:13.943169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3a704-8a9a-423f-b8d7-74ad2b4c699f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:13.943169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3a704-8a9a-423f-b8d7-74ad2b4c699f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:14.015707 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-87e3a704-8a9a-423f-b8d7-74ad2b4c699f None None] MFA Rules not processed for user `4e70b03ce9684918961bd5fcc34afa71`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:14.016943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-87e3a704-8a9a-423f-b8d7-74ad2b4c699f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:14.123551 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 674/1330] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:44:13 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:14.162543 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4b414-efbe-4b27-9e69-20e1a3335e2c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:14.164930 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-11f4b414-efbe-4b27-9e69-20e1a3335e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:14.199810 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:14.284009 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4b414-efbe-4b27-9e69-20e1a3335e2c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:14.370517 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b6930-b025-4ee8-bd85-c0f01f28479e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:14.371179 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b6930-b025-4ee8-bd85-c0f01f28479e service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:14.371461 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b6930-b025-4ee8-bd85-c0f01f28479e service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:14.371735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b6930-b025-4ee8-bd85-c0f01f28479e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:14.373448 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fb5b6930-b025-4ee8-bd85-c0f01f28479e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:14.465203 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:14.509752 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b6930-b025-4ee8-bd85-c0f01f28479e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:14.512694 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b6930-b025-4ee8-bd85-c0f01f28479e service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:14.549626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 657/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:44:14 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:17.581911 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e326ac9-1a77-47bd-bca8-ce3df9a0f5df None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:17.582518 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e326ac9-1a77-47bd-bca8-ce3df9a0f5df None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:17.582848 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e326ac9-1a77-47bd-bca8-ce3df9a0f5df None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:17.584623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 675/1332] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:17.590875 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a025c2-ace0-47d9-b592-472377a041ab None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:17.591441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a025c2-ace0-47d9-b592-472377a041ab None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:17.591441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a025c2-ace0-47d9-b592-472377a041ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:17.665920 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-54a025c2-ace0-47d9-b592-472377a041ab None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:17.667229 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-54a025c2-ace0-47d9-b592-472377a041ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:17.788504 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 658/1333] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:17.826704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e326ac9-1a77-47bd-bca8-ce3df9a0f5df None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:17.828288 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8e326ac9-1a77-47bd-bca8-ce3df9a0f5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:17.910728 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:17.951053 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e326ac9-1a77-47bd-bca8-ce3df9a0f5df None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:18.040973 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0df7d-e97b-4b1e-b0d3-7d7268321292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:18.041998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0df7d-e97b-4b1e-b0d3-7d7268321292 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:18.042282 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0df7d-e97b-4b1e-b0d3-7d7268321292 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:18.042560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0df7d-e97b-4b1e-b0d3-7d7268321292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:18.044218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-56c0df7d-e97b-4b1e-b0d3-7d7268321292 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:18.190233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0df7d-e97b-4b1e-b0d3-7d7268321292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:18.191665 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0df7d-e97b-4b1e-b0d3-7d7268321292 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:18.202968 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:18.213964 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 676/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:44:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:44:20.556542 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d29c5-f3e1-42c2-8ead-a0a9b3e6b53f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:20.557081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d29c5-f3e1-42c2-8ead-a0a9b3e6b53f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:20.557081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d29c5-f3e1-42c2-8ead-a0a9b3e6b53f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:20.558500 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 659/1335] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:20.563852 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b349f5-9367-4b5d-9d76-84dad2dffb7f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:20.564275 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b349f5-9367-4b5d-9d76-84dad2dffb7f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:20.564404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b349f5-9367-4b5d-9d76-84dad2dffb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:20.637082 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c1b349f5-9367-4b5d-9d76-84dad2dffb7f None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:20.638317 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c1b349f5-9367-4b5d-9d76-84dad2dffb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:20.739575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 677/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:20.779677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d29c5-f3e1-42c2-8ead-a0a9b3e6b53f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:20.781230 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5e1d29c5-f3e1-42c2-8ead-a0a9b3e6b53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:20.822442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:20.889160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d29c5-f3e1-42c2-8ead-a0a9b3e6b53f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:20.961837 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aaadd9-8add-4aea-b9ce-3c615d09cba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:20.962489 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaadd9-8add-4aea-b9ce-3c615d09cba4 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:20.962907 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaadd9-8add-4aea-b9ce-3c615d09cba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:20.963439 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaadd9-8add-4aea-b9ce-3c615d09cba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:20.965111 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-06aaadd9-8add-4aea-b9ce-3c615d09cba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:21.048427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:21.075254 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aaadd9-8add-4aea-b9ce-3c615d09cba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:21.077910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aaadd9-8add-4aea-b9ce-3c615d09cba4 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:21.099105 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 660/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:24.503489 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155e3e4-6837-4d6f-bd86-39d079e9916a None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:24.504015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155e3e4-6837-4d6f-bd86-39d079e9916a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:24.504136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155e3e4-6837-4d6f-bd86-39d079e9916a None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:24.505461 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 678/1338] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:24.511869 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d07ce-cefe-4afb-90ac-4f59e2e0bcf3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:24.511869 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d07ce-cefe-4afb-90ac-4f59e2e0bcf3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:24.511869 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d07ce-cefe-4afb-90ac-4f59e2e0bcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:24.539781 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7c7d07ce-cefe-4afb-90ac-4f59e2e0bcf3 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:24.540972 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7c7d07ce-cefe-4afb-90ac-4f59e2e0bcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:24.618367 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 661/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:44:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:24.655159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155e3e4-6837-4d6f-bd86-39d079e9916a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:24.657107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9155e3e4-6837-4d6f-bd86-39d079e9916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:24.737306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:24.751789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155e3e4-6837-4d6f-bd86-39d079e9916a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:24.755347 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc9c1e-caaf-4ad7-888e-83bcb287a6fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:24.757719 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc9c1e-caaf-4ad7-888e-83bcb287a6fb service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:24.757719 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc9c1e-caaf-4ad7-888e-83bcb287a6fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:24.757719 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc9c1e-caaf-4ad7-888e-83bcb287a6fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:24.766433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc9c1e-caaf-4ad7-888e-83bcb287a6fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:24.767865 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc9c1e-caaf-4ad7-888e-83bcb287a6fb service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:24.778178 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 679/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:44:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:29.523551 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0691c-9ae1-43c2-85d4-132b8bd8cd5a None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:29.524036 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0691c-9ae1-43c2-85d4-132b8bd8cd5a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:29.524170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0691c-9ae1-43c2-85d4-132b8bd8cd5a None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:29.525576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 662/1341] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:44:29.531073 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04553f5b-136b-46f8-92f4-0a04d3929bd5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:29.531704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04553f5b-136b-46f8-92f4-0a04d3929bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:29.531704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04553f5b-136b-46f8-92f4-0a04d3929bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:29.552492 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-04553f5b-136b-46f8-92f4-0a04d3929bd5 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:29.553821 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-04553f5b-136b-46f8-92f4-0a04d3929bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:29.573026 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 680/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:29.614977 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0691c-9ae1-43c2-85d4-132b8bd8cd5a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:29.617346 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ffa0691c-9ae1-43c2-85d4-132b8bd8cd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:29.632912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0691c-9ae1-43c2-85d4-132b8bd8cd5a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:29.637577 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910ba1c-951d-4fa9-8da6-c1310e14148b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:29.638682 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910ba1c-951d-4fa9-8da6-c1310e14148b service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:29.638682 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910ba1c-951d-4fa9-8da6-c1310e14148b service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:29.638936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910ba1c-951d-4fa9-8da6-c1310e14148b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:29.652940 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910ba1c-951d-4fa9-8da6-c1310e14148b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:29.654406 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910ba1c-951d-4fa9-8da6-c1310e14148b service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:29.666800 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 663/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:33.124528 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6804c-d4d8-4947-8a5c-3fe33bd34bfa None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:33.125132 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6804c-d4d8-4947-8a5c-3fe33bd34bfa None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:33.125132 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6804c-d4d8-4947-8a5c-3fe33bd34bfa None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:33.126525 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 681/1344] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:33.132563 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf27859-cfd3-44ac-a302-4a85c879c6b7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:33.133044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf27859-cfd3-44ac-a302-4a85c879c6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:33.133144 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf27859-cfd3-44ac-a302-4a85c879c6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:33.151900 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bbf27859-cfd3-44ac-a302-4a85c879c6b7 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:33.153100 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bbf27859-cfd3-44ac-a302-4a85c879c6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:33.160910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 664/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:44:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:33.198261 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6804c-d4d8-4947-8a5c-3fe33bd34bfa None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:33.209290 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6804c-d4d8-4947-8a5c-3fe33bd34bfa None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:33.213776 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed802c21-be15-4e34-bcf2-b7b9f281d249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:33.214485 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed802c21-be15-4e34-bcf2-b7b9f281d249 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:33.214775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed802c21-be15-4e34-bcf2-b7b9f281d249 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:33.215050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed802c21-be15-4e34-bcf2-b7b9f281d249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:33.224908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed802c21-be15-4e34-bcf2-b7b9f281d249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:33.227102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed802c21-be15-4e34-bcf2-b7b9f281d249 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:33.237495 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 682/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:44:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:38.202297 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5afa9d-ae63-4c02-a794-0df702b3a5f5 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:38.202863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5afa9d-ae63-4c02-a794-0df702b3a5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:38.202863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5afa9d-ae63-4c02-a794-0df702b3a5f5 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:38.204227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 665/1347] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:38.210322 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceeae5f-6eae-41c9-a9c9-a9f0bb495871 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:38.210862 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceeae5f-6eae-41c9-a9c9-a9f0bb495871 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:38.211000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceeae5f-6eae-41c9-a9c9-a9f0bb495871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:38.230162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7ceeae5f-6eae-41c9-a9c9-a9f0bb495871 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:38.231369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7ceeae5f-6eae-41c9-a9c9-a9f0bb495871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:38.239316 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 683/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:38.279143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5afa9d-ae63-4c02-a794-0df702b3a5f5 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:38.290387 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5afa9d-ae63-4c02-a794-0df702b3a5f5 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:38.294042 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9bf70-d305-4f1c-b7ab-5adac08ddd87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:38.303250 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9bf70-d305-4f1c-b7ab-5adac08ddd87 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:38.303250 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9bf70-d305-4f1c-b7ab-5adac08ddd87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:38.303250 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9bf70-d305-4f1c-b7ab-5adac08ddd87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:38.305062 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9bf70-d305-4f1c-b7ab-5adac08ddd87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:38.306544 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9bf70-d305-4f1c-b7ab-5adac08ddd87 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:38.316700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 666/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:44:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:43.759978 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4630a69-a4ed-4a66-86e4-3b9774f1d3b2 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:43.760476 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4630a69-a4ed-4a66-86e4-3b9774f1d3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:43.760476 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4630a69-a4ed-4a66-86e4-3b9774f1d3b2 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:43.762252 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 684/1350] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 16:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:43.768460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ba4e6-afa7-4013-9b3e-e18e786f358a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:43.768460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ba4e6-afa7-4013-9b3e-e18e786f358a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:43.768460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ba4e6-afa7-4013-9b3e-e18e786f358a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:43.841871 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-173ba4e6-afa7-4013-9b3e-e18e786f358a None None] MFA Rules not processed for user `beeefb9b8d394407a5e7a32f5a00ffad`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:43.843043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-173ba4e6-afa7-4013-9b3e-e18e786f358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:43.868386 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:43.936180 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 667/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 16:44:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:48.224545 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=25 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:48.353839 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d6361-7c01-4208-809a-06eb68b80d58 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:48.354313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d6361-7c01-4208-809a-06eb68b80d58 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:48.354833 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d6361-7c01-4208-809a-06eb68b80d58 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:48.357347 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 685/1352] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 16:44:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:48.362943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f05fd-13aa-4845-bedc-e8e3284a28ff None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:48.363551 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f05fd-13aa-4845-bedc-e8e3284a28ff None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:48.363918 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f05fd-13aa-4845-bedc-e8e3284a28ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:48.383540 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fb8f05fd-13aa-4845-bedc-e8e3284a28ff None None] MFA Rules not processed for user `beeefb9b8d394407a5e7a32f5a00ffad`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:48.384855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fb8f05fd-13aa-4845-bedc-e8e3284a28ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:48.397232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 668/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 16:44:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:49.975231 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ef6e3-d580-4a3f-8eb2-c1c01f5011cc None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:49.975806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ef6e3-d580-4a3f-8eb2-c1c01f5011cc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:49.975806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ef6e3-d580-4a3f-8eb2-c1c01f5011cc None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:49.977396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 686/1354] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 16:44:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:49.982155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4bdee-ec2e-40f4-9d46-127f20d0cd51 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:49.982613 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4bdee-ec2e-40f4-9d46-127f20d0cd51 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:49.982749 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4bdee-ec2e-40f4-9d46-127f20d0cd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:50.001137 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-98b4bdee-ec2e-40f4-9d46-127f20d0cd51 None None] MFA Rules not processed for user `beeefb9b8d394407a5e7a32f5a00ffad`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:50.002470 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-98b4bdee-ec2e-40f4-9d46-127f20d0cd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:50.011692 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 669/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 16:44:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:53.933113 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afee83-c184-4ce9-ade5-5e1d3ad7d028 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:53.934407 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afee83-c184-4ce9-ade5-5e1d3ad7d028 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:53.934892 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afee83-c184-4ce9-ade5-5e1d3ad7d028 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:53.936871 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 687/1356] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:44:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:53.941845 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036aa0be-ad84-4d80-95eb-2a19b5263234 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:53.942250 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036aa0be-ad84-4d80-95eb-2a19b5263234 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:53.942406 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036aa0be-ad84-4d80-95eb-2a19b5263234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:53.961924 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-036aa0be-ad84-4d80-95eb-2a19b5263234 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:53.963380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-036aa0be-ad84-4d80-95eb-2a19b5263234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:53.971867 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 670/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:44:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:54.030318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203fc3f-9888-4484-bfda-1f36f5cc7fa2 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:54.030909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203fc3f-9888-4484-bfda-1f36f5cc7fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:54.031391 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203fc3f-9888-4484-bfda-1f36f5cc7fa2 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:54.035094 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 688/1358] 10.222.0.48 () {54 vars in 961 bytes} [Thu May 26 16:44:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:54.044701 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad1b15-a383-4950-b14c-ce1f97ff7a1a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:54.045481 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad1b15-a383-4950-b14c-ce1f97ff7a1a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:54.045957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad1b15-a383-4950-b14c-ce1f97ff7a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:54.101674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-adad1b15-a383-4950-b14c-ce1f97ff7a1a None None] MFA Rules not processed for user `35c9fa9c29494ff9b1f749974dca2719`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:54.103350 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-adad1b15-a383-4950-b14c-ce1f97ff7a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:54.201579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 671/1359] 10.222.0.48 () {58 vars in 1058 bytes} [Thu May 26 16:44:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:54.210817 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203fc3f-9888-4484-bfda-1f36f5cc7fa2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:54.238809 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203fc3f-9888-4484-bfda-1f36f5cc7fa2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:54.245597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b339efe-164b-44c8-97ed-5871fc731f32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:54.246473 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b339efe-164b-44c8-97ed-5871fc731f32 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:54.247052 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b339efe-164b-44c8-97ed-5871fc731f32 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:54.248192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b339efe-164b-44c8-97ed-5871fc731f32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:54.257388 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b339efe-164b-44c8-97ed-5871fc731f32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:54.259104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b339efe-164b-44c8-97ed-5871fc731f32 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:54.272001 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 689/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:44:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:56.761290 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80998a-34f3-4bde-a3ff-15586e4398bd None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:56.761811 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80998a-34f3-4bde-a3ff-15586e4398bd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:56.761811 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80998a-34f3-4bde-a3ff-15586e4398bd None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:56.763307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 672/1361] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:56.768620 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674de0-52be-4478-87b8-86569c0d2d9c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:56.769132 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674de0-52be-4478-87b8-86569c0d2d9c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:56.769410 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674de0-52be-4478-87b8-86569c0d2d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:56.788316 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d9674de0-52be-4478-87b8-86569c0d2d9c None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:56.789755 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d9674de0-52be-4478-87b8-86569c0d2d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:56.798244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 690/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:56.847053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80998a-34f3-4bde-a3ff-15586e4398bd None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:56.863904 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80998a-34f3-4bde-a3ff-15586e4398bd None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:56.871125 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b285fa-6cc0-496e-a7ff-a6ff95ada328 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:56.871991 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b285fa-6cc0-496e-a7ff-a6ff95ada328 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:56.872434 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b285fa-6cc0-496e-a7ff-a6ff95ada328 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:56.872859 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b285fa-6cc0-496e-a7ff-a6ff95ada328 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:56.882475 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b285fa-6cc0-496e-a7ff-a6ff95ada328 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:56.884270 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b285fa-6cc0-496e-a7ff-a6ff95ada328 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:56.894950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 673/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:44:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:59.848696 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991cf0f-d552-450e-885e-967016b4ac03 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:59.849233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991cf0f-d552-450e-885e-967016b4ac03 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:59.849363 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991cf0f-d552-450e-885e-967016b4ac03 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:59.850719 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 691/1364] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:59.855989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ac15c-3361-4989-bb51-ddaf93caee3a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:59.856422 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ac15c-3361-4989-bb51-ddaf93caee3a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:59.856535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ac15c-3361-4989-bb51-ddaf93caee3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:59.874954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1c5ac15c-3361-4989-bb51-ddaf93caee3a None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:59.876148 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1c5ac15c-3361-4989-bb51-ddaf93caee3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:59.884653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 674/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:59.930016 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ac721-69fa-4a82-8556-ecb43f2b83e6 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:59.930259 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ac721-69fa-4a82-8556-ecb43f2b83e6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:59.930569 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ac721-69fa-4a82-8556-ecb43f2b83e6 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:59.932063 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 692/1366] 10.222.0.48 () {54 vars in 961 bytes} [Thu May 26 16:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:44:59.937285 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd23949-fdaf-45d3-b7d8-e12592b8fe3c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:59.937579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd23949-fdaf-45d3-b7d8-e12592b8fe3c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:59.937882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd23949-fdaf-45d3-b7d8-e12592b8fe3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:59.959859 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4dd23949-fdaf-45d3-b7d8-e12592b8fe3c None None] MFA Rules not processed for user `35c9fa9c29494ff9b1f749974dca2719`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:59.961099 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4dd23949-fdaf-45d3-b7d8-e12592b8fe3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:59.970862 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 675/1367] 10.222.0.48 () {58 vars in 1058 bytes} [Thu May 26 16:44:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:59.978778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ac721-69fa-4a82-8556-ecb43f2b83e6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:59.993399 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ac721-69fa-4a82-8556-ecb43f2b83e6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:59.998992 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737bf97-6f4c-4bc1-9317-0a66f446f2d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:59.999630 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737bf97-6f4c-4bc1-9317-0a66f446f2d5 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:59.999929 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737bf97-6f4c-4bc1-9317-0a66f446f2d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:00.000219 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737bf97-6f4c-4bc1-9317-0a66f446f2d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:00.009363 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737bf97-6f4c-4bc1-9317-0a66f446f2d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:00.010980 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737bf97-6f4c-4bc1-9317-0a66f446f2d5 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:00.020640 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 693/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:02.401576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bf839-0a37-4ddc-a9fc-6a1b9442d168 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:02.402097 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bf839-0a37-4ddc-a9fc-6a1b9442d168 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:02.402097 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bf839-0a37-4ddc-a9fc-6a1b9442d168 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:02.403408 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 676/1369] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:02.409293 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7990b6-d91a-4205-bc19-86d9a2363343 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:02.409795 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7990b6-d91a-4205-bc19-86d9a2363343 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:02.410029 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7990b6-d91a-4205-bc19-86d9a2363343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:02.430511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2f7990b6-d91a-4205-bc19-86d9a2363343 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:02.431746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2f7990b6-d91a-4205-bc19-86d9a2363343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:02.440299 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 694/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:02.620732 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03b2b5-128d-49a9-8dd9-8b74db864105 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:02.621132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03b2b5-128d-49a9-8dd9-8b74db864105 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:02.621298 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03b2b5-128d-49a9-8dd9-8b74db864105 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:02.622974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 677/1371] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:02.628624 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7168c-464b-4329-a934-1015c8449725 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:02.628924 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7168c-464b-4329-a934-1015c8449725 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:02.629392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7168c-464b-4329-a934-1015c8449725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:02.649327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f7f7168c-464b-4329-a934-1015c8449725 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:02.650855 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f7f7168c-464b-4329-a934-1015c8449725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:02.661324 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 695/1372] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:02.705207 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03b2b5-128d-49a9-8dd9-8b74db864105 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:02.720987 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03b2b5-128d-49a9-8dd9-8b74db864105 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:02.727048 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b24c6-2601-46d8-9876-d9b7aefbc018 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:02.727720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b24c6-2601-46d8-9876-d9b7aefbc018 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:02.728082 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b24c6-2601-46d8-9876-d9b7aefbc018 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:02.728361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b24c6-2601-46d8-9876-d9b7aefbc018 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:02.740859 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b24c6-2601-46d8-9876-d9b7aefbc018 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:02.744327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b24c6-2601-46d8-9876-d9b7aefbc018 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:02.753821 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daee1eb-1f2f-490d-a849-8ea8a26db800 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:02.754231 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daee1eb-1f2f-490d-a849-8ea8a26db800 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:02.754585 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daee1eb-1f2f-490d-a849-8ea8a26db800 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:02.756563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 696/1374] 10.222.0.48 () {54 vars in 963 bytes} [Thu May 26 16:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:45:02.762932 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 678/1374] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:02.763829 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac147f8-3c86-4568-a541-663377af1b10 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:02.764126 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac147f8-3c86-4568-a541-663377af1b10 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:02.764406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac147f8-3c86-4568-a541-663377af1b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:02.813896 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3ac147f8-3c86-4568-a541-663377af1b10 None None] MFA Rules not processed for user `8be9c9fb92c049c18a54b25725a34a74`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:02.815342 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3ac147f8-3c86-4568-a541-663377af1b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:02.890512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 697/1375] 10.222.0.48 () {58 vars in 1060 bytes} [Thu May 26 16:45:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:45:02.899349 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b24c6-2601-46d8-9876-d9b7aefbc018 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:02.911208 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b24c6-2601-46d8-9876-d9b7aefbc018 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:02.915152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590cf7a-2c12-4b05-89b3-4d6491a5d47e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:02.915731 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590cf7a-2c12-4b05-89b3-4d6491a5d47e service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:02.916237 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590cf7a-2c12-4b05-89b3-4d6491a5d47e service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:02.916717 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590cf7a-2c12-4b05-89b3-4d6491a5d47e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:02.923231 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:02.927838 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590cf7a-2c12-4b05-89b3-4d6491a5d47e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:02.929332 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590cf7a-2c12-4b05-89b3-4d6491a5d47e service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:02.939117 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 679/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:05.358783 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55f533-abdc-4d8b-a562-55d8a4d7a1cf None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:05.359703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55f533-abdc-4d8b-a562-55d8a4d7a1cf None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:05.360234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55f533-abdc-4d8b-a562-55d8a4d7a1cf None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:05.363056 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 698/1377] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:45:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:05.368831 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c9a28-eb6f-4d8a-a8b9-6effbe507774 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:05.368831 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c9a28-eb6f-4d8a-a8b9-6effbe507774 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:05.369478 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c9a28-eb6f-4d8a-a8b9-6effbe507774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:05.388315 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-000c9a28-eb6f-4d8a-a8b9-6effbe507774 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:05.389449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-000c9a28-eb6f-4d8a-a8b9-6effbe507774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:05.400003 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 680/1378] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:05.445372 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55f533-abdc-4d8b-a562-55d8a4d7a1cf None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:05.463605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55f533-abdc-4d8b-a562-55d8a4d7a1cf None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:05.469748 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb73bec-1e01-4d6b-aa68-692c8aa6969d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:05.470413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb73bec-1e01-4d6b-aa68-692c8aa6969d service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:05.470695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb73bec-1e01-4d6b-aa68-692c8aa6969d service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:05.470967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb73bec-1e01-4d6b-aa68-692c8aa6969d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:05.480103 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb73bec-1e01-4d6b-aa68-692c8aa6969d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:05.482273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb73bec-1e01-4d6b-aa68-692c8aa6969d service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:05.495949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 699/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:45:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:07.919170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658ce53-0f5d-4463-b96e-ab07e97f6b7f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:07.919970 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658ce53-0f5d-4463-b96e-ab07e97f6b7f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:07.919970 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658ce53-0f5d-4463-b96e-ab07e97f6b7f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:07.921067 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 681/1380] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:07.927014 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ba3e9-757b-4305-9b6c-e7269dbe60c0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:07.927663 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ba3e9-757b-4305-9b6c-e7269dbe60c0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:07.927663 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ba3e9-757b-4305-9b6c-e7269dbe60c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:07.948110 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-599ba3e9-757b-4305-9b6c-e7269dbe60c0 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:07.949494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-599ba3e9-757b-4305-9b6c-e7269dbe60c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:07.958562 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 700/1381] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:08.003853 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658ce53-0f5d-4463-b96e-ab07e97f6b7f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:08.020049 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658ce53-0f5d-4463-b96e-ab07e97f6b7f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:08.026946 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8543d-b751-45ae-aa7e-149babcb3dd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:08.027727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8543d-b751-45ae-aa7e-149babcb3dd5 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:08.028014 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8543d-b751-45ae-aa7e-149babcb3dd5 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:08.028296 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8543d-b751-45ae-aa7e-149babcb3dd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:08.037962 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8543d-b751-45ae-aa7e-149babcb3dd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:08.039717 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8543d-b751-45ae-aa7e-149babcb3dd5 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:08.051389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 682/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:45:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:10.678343 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d52eab-80d6-4b73-86b2-a285b830f069 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:10.679187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d52eab-80d6-4b73-86b2-a285b830f069 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:10.679187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d52eab-80d6-4b73-86b2-a285b830f069 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:10.680408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 701/1383] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:45:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:10.686301 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646174b-bb32-4c5c-bc95-b18b3286ac01 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:10.686865 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646174b-bb32-4c5c-bc95-b18b3286ac01 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:10.686950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646174b-bb32-4c5c-bc95-b18b3286ac01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:10.706259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7646174b-bb32-4c5c-bc95-b18b3286ac01 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:10.707590 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7646174b-bb32-4c5c-bc95-b18b3286ac01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:10.715988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 683/1384] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:45:10.759269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d52eab-80d6-4b73-86b2-a285b830f069 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:10.774277 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d52eab-80d6-4b73-86b2-a285b830f069 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:10.779990 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50e1b7-01e3-490e-8925-14d5b70778bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:10.780648 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50e1b7-01e3-490e-8925-14d5b70778bd service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:10.780932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50e1b7-01e3-490e-8925-14d5b70778bd service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:10.781453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50e1b7-01e3-490e-8925-14d5b70778bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:10.791351 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50e1b7-01e3-490e-8925-14d5b70778bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:10.792993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50e1b7-01e3-490e-8925-14d5b70778bd service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:10.804605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 702/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:13.151110 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba840d18-8abd-413c-84d4-8af342caa110 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:13.151651 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba840d18-8abd-413c-84d4-8af342caa110 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:13.151877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba840d18-8abd-413c-84d4-8af342caa110 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:13.153734 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 684/1386] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:45:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:13.159324 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4122886-c9fb-4b8d-badf-2df43acee40b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:13.159938 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4122886-c9fb-4b8d-badf-2df43acee40b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:13.159938 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4122886-c9fb-4b8d-badf-2df43acee40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:13.178411 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e4122886-c9fb-4b8d-badf-2df43acee40b None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:13.179630 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e4122886-c9fb-4b8d-badf-2df43acee40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:13.187577 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 703/1387] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:13.241078 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba840d18-8abd-413c-84d4-8af342caa110 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:13.256158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba840d18-8abd-413c-84d4-8af342caa110 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:13.262498 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03426df8-8e52-425a-a309-9b99e2e738bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:13.263153 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03426df8-8e52-425a-a309-9b99e2e738bc service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:13.263435 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03426df8-8e52-425a-a309-9b99e2e738bc service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:13.263710 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03426df8-8e52-425a-a309-9b99e2e738bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:13.273886 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03426df8-8e52-425a-a309-9b99e2e738bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:13.275538 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03426df8-8e52-425a-a309-9b99e2e738bc service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:13.287794 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 685/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:45:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:15.978906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d32340-04c9-4171-9369-13d9faadfdbe None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:15.979419 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d32340-04c9-4171-9369-13d9faadfdbe None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:15.979515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d32340-04c9-4171-9369-13d9faadfdbe None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:15.980932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 704/1389] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:15.986400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b68567-2ce0-460c-916d-0202aaaa3c36 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:15.986888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b68567-2ce0-460c-916d-0202aaaa3c36 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:15.987008 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b68567-2ce0-460c-916d-0202aaaa3c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:16.005534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-69b68567-2ce0-460c-916d-0202aaaa3c36 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:16.006755 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-69b68567-2ce0-460c-916d-0202aaaa3c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:16.014969 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 686/1390] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:16.061075 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d32340-04c9-4171-9369-13d9faadfdbe None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:16.079054 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d32340-04c9-4171-9369-13d9faadfdbe None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:16.085091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779bdd7-2ac3-4827-892d-78ee542fb797 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:16.085847 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779bdd7-2ac3-4827-892d-78ee542fb797 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:16.101613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779bdd7-2ac3-4827-892d-78ee542fb797 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:16.101613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779bdd7-2ac3-4827-892d-78ee542fb797 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:16.101613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779bdd7-2ac3-4827-892d-78ee542fb797 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:16.101613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779bdd7-2ac3-4827-892d-78ee542fb797 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:16.110140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 705/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:45:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:18.643511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832c4b7-7fcb-4229-b6ad-de5b422c6215 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:18.644120 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832c4b7-7fcb-4229-b6ad-de5b422c6215 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:18.644120 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832c4b7-7fcb-4229-b6ad-de5b422c6215 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:18.646013 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 687/1392] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:45:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:18.651932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc943b3b-1c38-4b44-887d-c2486f09e748 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:18.652478 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc943b3b-1c38-4b44-887d-c2486f09e748 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:18.652898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc943b3b-1c38-4b44-887d-c2486f09e748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:18.659896 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=84 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:18.672549 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-dc943b3b-1c38-4b44-887d-c2486f09e748 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:18.673887 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dc943b3b-1c38-4b44-887d-c2486f09e748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:18.682261 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 706/1393] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:18.728996 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832c4b7-7fcb-4229-b6ad-de5b422c6215 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:18.744459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832c4b7-7fcb-4229-b6ad-de5b422c6215 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:18.751027 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd112b-821a-475d-bc81-023ad92daab3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:18.751704 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd112b-821a-475d-bc81-023ad92daab3 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:18.751991 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd112b-821a-475d-bc81-023ad92daab3 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:18.752421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd112b-821a-475d-bc81-023ad92daab3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:18.763207 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd112b-821a-475d-bc81-023ad92daab3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:18.764843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd112b-821a-475d-bc81-023ad92daab3 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:18.776716 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 688/1394] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:45:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:19.409953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075619b-6b05-4cfe-9058-0f0e8d73b2c4 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:19.410240 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075619b-6b05-4cfe-9058-0f0e8d73b2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:19.410546 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075619b-6b05-4cfe-9058-0f0e8d73b2c4 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:19.412528 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 707/1395] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:45:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:19.418130 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be422c-7f8c-4535-89ff-82be91ed5cd3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:19.418420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be422c-7f8c-4535-89ff-82be91ed5cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:19.418769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be422c-7f8c-4535-89ff-82be91ed5cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:19.438004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-14be422c-7f8c-4535-89ff-82be91ed5cd3 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:19.439211 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-14be422c-7f8c-4535-89ff-82be91ed5cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:19.448141 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 689/1396] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:19.508951 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebb11a-41a3-45f1-99bd-cea6d0e3aebb None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:19.509238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebb11a-41a3-45f1-99bd-cea6d0e3aebb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:19.510391 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebb11a-41a3-45f1-99bd-cea6d0e3aebb None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:19.511126 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 708/1397] 10.222.0.48 () {54 vars in 962 bytes} [Thu May 26 16:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:19.516918 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aff6d4-c29e-4290-ae73-ff829b5ff857 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:19.517438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aff6d4-c29e-4290-ae73-ff829b5ff857 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:19.517654 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aff6d4-c29e-4290-ae73-ff829b5ff857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:19.578039 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-78aff6d4-c29e-4290-ae73-ff829b5ff857 None None] MFA Rules not processed for user `7701907eb3b24c3681352c91ad6a3aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:19.579180 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-78aff6d4-c29e-4290-ae73-ff829b5ff857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:19.652981 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 690/1398] 10.222.0.48 () {58 vars in 1059 bytes} [Thu May 26 16:45:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:19.662142 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebb11a-41a3-45f1-99bd-cea6d0e3aebb None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:19.673998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebb11a-41a3-45f1-99bd-cea6d0e3aebb None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:19.678607 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc8a12-0f67-4cb3-9431-0668acc175df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7701907eb3b24c3681352c91ad6a3aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:19.679269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc8a12-0f67-4cb3-9431-0668acc175df service glance] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:19.679553 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc8a12-0f67-4cb3-9431-0668acc175df service glance] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:19.679829 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc8a12-0f67-4cb3-9431-0668acc175df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:19.690065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc8a12-0f67-4cb3-9431-0668acc175df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:19.691513 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc8a12-0f67-4cb3-9431-0668acc175df service glance] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:19.701817 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 709/1399] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:45:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:20.545668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7d306-6297-422f-941f-ffff549f4970 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:20.545962 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7d306-6297-422f-941f-ffff549f4970 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:20.546245 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7d306-6297-422f-941f-ffff549f4970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:20.598510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2bf7d306-6297-422f-941f-ffff549f4970 None None] MFA Rules not processed for user `4d2ab3eeb5b44979956dd223ac6b7c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:20.599766 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2bf7d306-6297-422f-941f-ffff549f4970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:20.639196 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:20.674499 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 691/1400] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 16:45:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:20.717122 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3bdc1-eaf1-443c-b259-e563b352189a None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:20.717719 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3bdc1-eaf1-443c-b259-e563b352189a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:20.717901 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3bdc1-eaf1-443c-b259-e563b352189a None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:20.719151 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 710/1401] 10.222.0.48 () {54 vars in 942 bytes} [Thu May 26 16:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:20.726529 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cf770-60f5-4595-8af0-f73e4adb226a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:20.726827 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cf770-60f5-4595-8af0-f73e4adb226a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:20.727106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cf770-60f5-4595-8af0-f73e4adb226a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:20.780831 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e74cf770-60f5-4595-8af0-f73e4adb226a None None] MFA Rules not processed for user `07cc455638fb4db4939af3657ab4203e`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:20.782100 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e74cf770-60f5-4595-8af0-f73e4adb226a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:20.856691 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 692/1402] 10.222.0.48 () {58 vars in 1039 bytes} [Thu May 26 16:45:20 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:20.866962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3bdc1-eaf1-443c-b259-e563b352189a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:20.880691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3bdc1-eaf1-443c-b259-e563b352189a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:20.885821 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b46c3b-c232-4bad-ae47-ef334f372ab1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cc455638fb4db4939af3657ab4203e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:20.886482 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b46c3b-c232-4bad-ae47-ef334f372ab1 service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:20.886768 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b46c3b-c232-4bad-ae47-ef334f372ab1 service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:20.887076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b46c3b-c232-4bad-ae47-ef334f372ab1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:20.895872 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b46c3b-c232-4bad-ae47-ef334f372ab1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:20.897518 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b46c3b-c232-4bad-ae47-ef334f372ab1 service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:20.906235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 711/1403] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 16:45:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:45:21.277707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f1851-ec05-43df-978f-01351a32ad22 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:21.278000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f1851-ec05-43df-978f-01351a32ad22 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:21.278282 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f1851-ec05-43df-978f-01351a32ad22 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:21.279681 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 693/1404] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:21.288994 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc3b47-eede-4c50-a9be-11aa3ceccb91 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:21.288994 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc3b47-eede-4c50-a9be-11aa3ceccb91 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:21.288994 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc3b47-eede-4c50-a9be-11aa3ceccb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:21.305206 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-51cc3b47-eede-4c50-a9be-11aa3ceccb91 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:21.306440 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-51cc3b47-eede-4c50-a9be-11aa3ceccb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:21.314373 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 712/1405] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:21.360663 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f1851-ec05-43df-978f-01351a32ad22 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:21.375060 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f1851-ec05-43df-978f-01351a32ad22 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:21.380689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bf055-0591-49b3-9e49-133296820818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:21.384810 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bf055-0591-49b3-9e49-133296820818 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:21.384810 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bf055-0591-49b3-9e49-133296820818 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:21.384810 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bf055-0591-49b3-9e49-133296820818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:21.392532 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bf055-0591-49b3-9e49-133296820818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:21.394219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bf055-0591-49b3-9e49-133296820818 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:21.406014 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 694/1406] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:45:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:23.904490 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6b596-1d68-4344-a3c7-218fd36d47c3 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:23.905050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6b596-1d68-4344-a3c7-218fd36d47c3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:23.905050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6b596-1d68-4344-a3c7-218fd36d47c3 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:23.906751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 713/1407] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:23.913235 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67289615-bedf-4a91-9586-06c43769ef3e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:23.913931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67289615-bedf-4a91-9586-06c43769ef3e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:23.913931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67289615-bedf-4a91-9586-06c43769ef3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:23.934770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-67289615-bedf-4a91-9586-06c43769ef3e None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:23.936159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-67289615-bedf-4a91-9586-06c43769ef3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:23.944602 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 695/1408] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:23.993409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6b596-1d68-4344-a3c7-218fd36d47c3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:24.014272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6b596-1d68-4344-a3c7-218fd36d47c3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:24.020160 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66815167-e4d7-4b30-9d91-6bee1efb81e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:24.021180 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66815167-e4d7-4b30-9d91-6bee1efb81e4 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:24.021707 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66815167-e4d7-4b30-9d91-6bee1efb81e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:24.021982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66815167-e4d7-4b30-9d91-6bee1efb81e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:24.031662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66815167-e4d7-4b30-9d91-6bee1efb81e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:24.033383 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66815167-e4d7-4b30-9d91-6bee1efb81e4 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:24.044441 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 714/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:45:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:33.934692 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=64 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:34.041795 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=23 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:46.954381 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95f264-6b4e-4dc3-ac1b-3f9aecd1dca3 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:46.955090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95f264-6b4e-4dc3-ac1b-3f9aecd1dca3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:46.955090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95f264-6b4e-4dc3-ac1b-3f9aecd1dca3 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:46.956861 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 696/1410] 10.222.0.48 () {54 vars in 918 bytes} [Thu May 26 16:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:46.962897 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e94d0e-58a0-45f2-883f-37093fc4d570 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:46.963395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e94d0e-58a0-45f2-883f-37093fc4d570 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:46.963513 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e94d0e-58a0-45f2-883f-37093fc4d570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:46.983699 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f1e94d0e-58a0-45f2-883f-37093fc4d570 None None] MFA Rules not processed for user `beeefb9b8d394407a5e7a32f5a00ffad`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:46.984957 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f1e94d0e-58a0-45f2-883f-37093fc4d570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:46.994093 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 715/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Thu May 26 16:45:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:47.009418 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d47109-936d-4a22-92af-68f8c556f050 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:47.009791 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d47109-936d-4a22-92af-68f8c556f050 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:47.010055 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d47109-936d-4a22-92af-68f8c556f050 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:47.011430 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 697/1412] 10.222.0.48 () {54 vars in 918 bytes} [Thu May 26 16:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:47.016259 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aa7fc-d664-428b-9c67-38bc620cea6f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:47.016546 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aa7fc-d664-428b-9c67-38bc620cea6f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:47.016881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aa7fc-d664-428b-9c67-38bc620cea6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:47.035413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7f8aa7fc-d664-428b-9c67-38bc620cea6f None None] MFA Rules not processed for user `35c9fa9c29494ff9b1f749974dca2719`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:47.036611 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7f8aa7fc-d664-428b-9c67-38bc620cea6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:47.045807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 716/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Thu May 26 16:45:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:49.778880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c9a55-2d2d-404d-bfa7-0cde3fbc6039 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:49.779425 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c9a55-2d2d-404d-bfa7-0cde3fbc6039 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:49.779425 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c9a55-2d2d-404d-bfa7-0cde3fbc6039 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:49.780802 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 698/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:45:49.786275 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935981f-a998-49ed-9d16-831b6eca6a30 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:49.786715 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935981f-a998-49ed-9d16-831b6eca6a30 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:49.786818 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935981f-a998-49ed-9d16-831b6eca6a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:49.805188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6935981f-a998-49ed-9d16-831b6eca6a30 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:49.806423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6935981f-a998-49ed-9d16-831b6eca6a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:49.814340 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 717/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:49.856448 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c9a55-2d2d-404d-bfa7-0cde3fbc6039 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:49.871884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c9a55-2d2d-404d-bfa7-0cde3fbc6039 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:49.877361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf161ca4-a9ba-480a-bd1c-55345de21663 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:49.878575 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf161ca4-a9ba-480a-bd1c-55345de21663 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:49.878872 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf161ca4-a9ba-480a-bd1c-55345de21663 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:49.879147 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf161ca4-a9ba-480a-bd1c-55345de21663 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:49.887495 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf161ca4-a9ba-480a-bd1c-55345de21663 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:49.889083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf161ca4-a9ba-480a-bd1c-55345de21663 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:49.898657 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 699/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:45:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:50.911973 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d084a-fa76-43ba-ba0b-94bc78c0a3ee None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:50.912557 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d084a-fa76-43ba-ba0b-94bc78c0a3ee None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:50.912557 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d084a-fa76-43ba-ba0b-94bc78c0a3ee None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:50.913940 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 718/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:50.919057 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04ee3c-e9db-4161-8074-7c8f96b4a70c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:50.919505 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04ee3c-e9db-4161-8074-7c8f96b4a70c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:50.919606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04ee3c-e9db-4161-8074-7c8f96b4a70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:50.938325 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6a04ee3c-e9db-4161-8074-7c8f96b4a70c None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:50.939581 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6a04ee3c-e9db-4161-8074-7c8f96b4a70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:50.948296 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 700/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:51.165749 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d084a-fa76-43ba-ba0b-94bc78c0a3ee None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:51.181675 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d084a-fa76-43ba-ba0b-94bc78c0a3ee None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:51.187189 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb1706-5ac7-4e80-807c-69b4f8d0bc00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:51.187839 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb1706-5ac7-4e80-807c-69b4f8d0bc00 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:51.188126 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb1706-5ac7-4e80-807c-69b4f8d0bc00 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:51.188401 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb1706-5ac7-4e80-807c-69b4f8d0bc00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:51.198360 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb1706-5ac7-4e80-807c-69b4f8d0bc00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:51.199974 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb1706-5ac7-4e80-807c-69b4f8d0bc00 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:51.210240 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 719/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:52.203683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7a4fd-1825-452e-8faf-0297f492710e None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:52.204277 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7a4fd-1825-452e-8faf-0297f492710e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:52.204277 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7a4fd-1825-452e-8faf-0297f492710e None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:52.205688 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 701/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:52.214265 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059ad8a-e12e-4afe-8b11-8fdb7a6ac251 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:52.214888 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059ad8a-e12e-4afe-8b11-8fdb7a6ac251 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:52.214888 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059ad8a-e12e-4afe-8b11-8fdb7a6ac251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:52.234060 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3059ad8a-e12e-4afe-8b11-8fdb7a6ac251 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:52.235283 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3059ad8a-e12e-4afe-8b11-8fdb7a6ac251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:52.245098 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 720/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:52.400339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7a4fd-1825-452e-8faf-0297f492710e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:52.414753 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7a4fd-1825-452e-8faf-0297f492710e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:52.420629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05dcc36-236c-46bb-bee2-59c437ef44ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:52.427591 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dcc36-236c-46bb-bee2-59c437ef44ef service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:52.427591 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dcc36-236c-46bb-bee2-59c437ef44ef service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:52.427591 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dcc36-236c-46bb-bee2-59c437ef44ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:52.432107 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05dcc36-236c-46bb-bee2-59c437ef44ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:52.433751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05dcc36-236c-46bb-bee2-59c437ef44ef service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:52.444248 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 702/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:53.393970 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f8ad0-a10e-43d7-8d92-bf598b16f882 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:53.394533 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f8ad0-a10e-43d7-8d92-bf598b16f882 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:53.394907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f8ad0-a10e-43d7-8d92-bf598b16f882 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:53.396712 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 721/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:45:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:53.402435 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f4a63-4069-49fa-a545-9f98269a3526 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:53.402435 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f4a63-4069-49fa-a545-9f98269a3526 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:53.414694 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f4a63-4069-49fa-a545-9f98269a3526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:53.422958 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bc8f4a63-4069-49fa-a545-9f98269a3526 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:53.424167 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bc8f4a63-4069-49fa-a545-9f98269a3526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:53.432540 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 703/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:45:53.600819 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f8ad0-a10e-43d7-8d92-bf598b16f882 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:53.615778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f8ad0-a10e-43d7-8d92-bf598b16f882 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:53.621202 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352a216-200c-4d57-bf0c-b3b6691b21d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:53.621812 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352a216-200c-4d57-bf0c-b3b6691b21d6 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:53.622096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352a216-200c-4d57-bf0c-b3b6691b21d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:53.622374 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352a216-200c-4d57-bf0c-b3b6691b21d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:53.631624 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352a216-200c-4d57-bf0c-b3b6691b21d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:53.633216 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352a216-200c-4d57-bf0c-b3b6691b21d6 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:53.644024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 722/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:54.584925 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbe8bc-26c2-4d97-a7fa-b9fe1198930a None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:54.585723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbe8bc-26c2-4d97-a7fa-b9fe1198930a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:54.585723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbe8bc-26c2-4d97-a7fa-b9fe1198930a None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:54.586938 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 704/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:54.593734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebcf47-cb9d-4080-90a6-e7a9ae067b23 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:54.594281 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebcf47-cb9d-4080-90a6-e7a9ae067b23 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:54.594281 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebcf47-cb9d-4080-90a6-e7a9ae067b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:54.613356 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-acebcf47-cb9d-4080-90a6-e7a9ae067b23 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:54.614578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-acebcf47-cb9d-4080-90a6-e7a9ae067b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:54.622673 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 723/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:54.777210 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbe8bc-26c2-4d97-a7fa-b9fe1198930a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:54.791933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbe8bc-26c2-4d97-a7fa-b9fe1198930a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:54.797383 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290deee-1af5-4824-8cb7-a6d318ef2ad9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:54.798018 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290deee-1af5-4824-8cb7-a6d318ef2ad9 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:54.798313 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290deee-1af5-4824-8cb7-a6d318ef2ad9 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:54.798570 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290deee-1af5-4824-8cb7-a6d318ef2ad9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:54.807323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290deee-1af5-4824-8cb7-a6d318ef2ad9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:54.808901 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290deee-1af5-4824-8cb7-a6d318ef2ad9 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:54.819142 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 705/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:55.786660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976156ce-6c41-4d3b-9960-ddc21a620fad None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:55.787230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976156ce-6c41-4d3b-9960-ddc21a620fad None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:55.787230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976156ce-6c41-4d3b-9960-ddc21a620fad None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:55.788643 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 724/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:45:55.793812 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255caae-5bde-400b-93e3-663470d831d6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:55.794206 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255caae-5bde-400b-93e3-663470d831d6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:55.794373 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255caae-5bde-400b-93e3-663470d831d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:55.813620 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6255caae-5bde-400b-93e3-663470d831d6 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:55.814916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6255caae-5bde-400b-93e3-663470d831d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:55.824204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 706/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:55.975257 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976156ce-6c41-4d3b-9960-ddc21a620fad None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:55.990348 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976156ce-6c41-4d3b-9960-ddc21a620fad None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:55.995612 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df578b6-edd8-41a4-8323-d010dfb45a07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:55.996262 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df578b6-edd8-41a4-8323-d010dfb45a07 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:55.996548 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df578b6-edd8-41a4-8323-d010dfb45a07 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:55.996826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df578b6-edd8-41a4-8323-d010dfb45a07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:56.005186 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df578b6-edd8-41a4-8323-d010dfb45a07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:56.007010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df578b6-edd8-41a4-8323-d010dfb45a07 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:56.016574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 725/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:45:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:56.951090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2816a-01d8-4564-be6d-d5bbbd2ab602 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:56.951694 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2816a-01d8-4564-be6d-d5bbbd2ab602 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:56.951694 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2816a-01d8-4564-be6d-d5bbbd2ab602 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:56.953141 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 707/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:56.958841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785018a-b49c-4f0c-a6c1-21fc25851444 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:56.959271 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785018a-b49c-4f0c-a6c1-21fc25851444 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:56.959446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785018a-b49c-4f0c-a6c1-21fc25851444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:56.977897 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7785018a-b49c-4f0c-a6c1-21fc25851444 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:56.979077 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7785018a-b49c-4f0c-a6c1-21fc25851444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:56.986733 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 726/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:45:57.142463 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2816a-01d8-4564-be6d-d5bbbd2ab602 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:57.157893 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2816a-01d8-4564-be6d-d5bbbd2ab602 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:57.164264 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89024461-7a85-4847-bf8c-55d0b7aa384c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:57.164926 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89024461-7a85-4847-bf8c-55d0b7aa384c service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:57.165206 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89024461-7a85-4847-bf8c-55d0b7aa384c service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:57.165589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89024461-7a85-4847-bf8c-55d0b7aa384c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:57.175042 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89024461-7a85-4847-bf8c-55d0b7aa384c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:57.176633 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89024461-7a85-4847-bf8c-55d0b7aa384c service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:57.186608 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 708/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:45:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:58.136193 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65980c8d-9c42-4b6f-ad8d-f282619c8527 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:58.137070 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65980c8d-9c42-4b6f-ad8d-f282619c8527 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:58.137070 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65980c8d-9c42-4b6f-ad8d-f282619c8527 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:58.138186 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 727/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:58.143621 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4211e90-5fd8-4c93-9900-5a373a9d262d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:58.144186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4211e90-5fd8-4c93-9900-5a373a9d262d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:58.144622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4211e90-5fd8-4c93-9900-5a373a9d262d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:58.163969 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b4211e90-5fd8-4c93-9900-5a373a9d262d None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:58.165515 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b4211e90-5fd8-4c93-9900-5a373a9d262d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:58.173362 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 709/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:58.327733 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65980c8d-9c42-4b6f-ad8d-f282619c8527 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:58.342472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65980c8d-9c42-4b6f-ad8d-f282619c8527 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:58.348359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391769cd-77b7-44c4-be9d-9770aebcba2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:58.349203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391769cd-77b7-44c4-be9d-9770aebcba2c service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:58.349536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391769cd-77b7-44c4-be9d-9770aebcba2c service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:58.349801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391769cd-77b7-44c4-be9d-9770aebcba2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:58.358247 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391769cd-77b7-44c4-be9d-9770aebcba2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:58.361058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391769cd-77b7-44c4-be9d-9770aebcba2c service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:58.369425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 728/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:59.313074 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364795a-6637-4e43-9547-7d072ae995c1 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:59.313572 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364795a-6637-4e43-9547-7d072ae995c1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:59.313667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364795a-6637-4e43-9547-7d072ae995c1 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:59.315054 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 710/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:45:59.320765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d8343-1925-46a6-bf82-64447a66e81d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:59.321287 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d8343-1925-46a6-bf82-64447a66e81d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:59.321549 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d8343-1925-46a6-bf82-64447a66e81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:59.340922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b06d8343-1925-46a6-bf82-64447a66e81d None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:59.341390 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b06d8343-1925-46a6-bf82-64447a66e81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:59.349098 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 729/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:59.500623 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364795a-6637-4e43-9547-7d072ae995c1 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:59.516264 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364795a-6637-4e43-9547-7d072ae995c1 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:59.522525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14645d-63ec-443d-b7c8-67d8360dea5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:59.523222 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14645d-63ec-443d-b7c8-67d8360dea5e service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:59.523507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14645d-63ec-443d-b7c8-67d8360dea5e service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:59.535604 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14645d-63ec-443d-b7c8-67d8360dea5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:59.535604 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14645d-63ec-443d-b7c8-67d8360dea5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:59.535604 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14645d-63ec-443d-b7c8-67d8360dea5e service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:59.545580 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 711/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:46:01.975559 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a4fd8-a20e-4a48-931d-5d8444c53718 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:01.977644 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a4fd8-a20e-4a48-931d-5d8444c53718 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:01.977644 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a4fd8-a20e-4a48-931d-5d8444c53718 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:01.977644 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 730/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:46:01.983493 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8541cee-167f-47bb-bed4-49b9d7f93a4c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:01.984007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8541cee-167f-47bb-bed4-49b9d7f93a4c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:01.984109 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8541cee-167f-47bb-bed4-49b9d7f93a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:02.007301 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d8541cee-167f-47bb-bed4-49b9d7f93a4c None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:02.008525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d8541cee-167f-47bb-bed4-49b9d7f93a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:02.018478 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 712/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:46:02.058586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a4fd8-a20e-4a48-931d-5d8444c53718 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:02.073903 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a4fd8-a20e-4a48-931d-5d8444c53718 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:02.077785 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd8d4b-1a99-4d3d-ad1b-63850c0c443a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:02.078436 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd8d4b-1a99-4d3d-ad1b-63850c0c443a service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:02.078721 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd8d4b-1a99-4d3d-ad1b-63850c0c443a service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:02.079099 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd8d4b-1a99-4d3d-ad1b-63850c0c443a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:02.091857 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd8d4b-1a99-4d3d-ad1b-63850c0c443a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:02.093353 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd8d4b-1a99-4d3d-ad1b-63850c0c443a service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:02.104843 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 731/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:46:04.732243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404f206-b739-47c8-bfb5-0df3ddb2243a None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:04.732847 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404f206-b739-47c8-bfb5-0df3ddb2243a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:04.732847 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404f206-b739-47c8-bfb5-0df3ddb2243a None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:04.734303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 713/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:46:04.740792 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efa055-9a34-47e9-88f9-45e7d2c70236 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:04.741407 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efa055-9a34-47e9-88f9-45e7d2c70236 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:04.741407 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efa055-9a34-47e9-88f9-45e7d2c70236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:04.760865 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-29efa055-9a34-47e9-88f9-45e7d2c70236 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:04.762110 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-29efa055-9a34-47e9-88f9-45e7d2c70236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:04.770251 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 732/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:46:04.808771 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404f206-b739-47c8-bfb5-0df3ddb2243a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:04.820448 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404f206-b739-47c8-bfb5-0df3ddb2243a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:04.823959 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4871c9b-2bce-469b-a6c5-58a7935811b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:04.824594 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4871c9b-2bce-469b-a6c5-58a7935811b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:04.824867 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4871c9b-2bce-469b-a6c5-58a7935811b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:04.825136 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4871c9b-2bce-469b-a6c5-58a7935811b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:04.835225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4871c9b-2bce-469b-a6c5-58a7935811b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:04.836745 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4871c9b-2bce-469b-a6c5-58a7935811b5 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:04.848150 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 714/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:46:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:46:08.048856 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1ad04-59bb-4519-922f-aa67b7e062a7 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:08.049706 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1ad04-59bb-4519-922f-aa67b7e062a7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:08.049942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1ad04-59bb-4519-922f-aa67b7e062a7 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:08.052641 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 733/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:46:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:46:08.058920 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70563c7-dadc-439e-b3eb-288e283df139 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:08.059501 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70563c7-dadc-439e-b3eb-288e283df139 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:08.059501 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70563c7-dadc-439e-b3eb-288e283df139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:08.080839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c70563c7-dadc-439e-b3eb-288e283df139 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:08.082637 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c70563c7-dadc-439e-b3eb-288e283df139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:08.090995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 715/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:46:08.130511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1ad04-59bb-4519-922f-aa67b7e062a7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:08.141387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1ad04-59bb-4519-922f-aa67b7e062a7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:08.145526 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc5ec8-e39e-459e-83fe-d1181479a797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:08.146162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc5ec8-e39e-459e-83fe-d1181479a797 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:08.146443 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc5ec8-e39e-459e-83fe-d1181479a797 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:08.146714 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc5ec8-e39e-459e-83fe-d1181479a797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:08.156134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc5ec8-e39e-459e-83fe-d1181479a797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:08.157688 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc5ec8-e39e-459e-83fe-d1181479a797 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:08.167843 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 734/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:46:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:46:11.349355 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f662799-709f-4c1f-aebc-97b4c3d732d3 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:11.350134 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f662799-709f-4c1f-aebc-97b4c3d732d3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:11.350287 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f662799-709f-4c1f-aebc-97b4c3d732d3 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:11.352902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 716/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:46:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:46:11.363282 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db3146-6384-4532-b875-06de0f33ab67 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:11.364128 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db3146-6384-4532-b875-06de0f33ab67 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:11.364301 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db3146-6384-4532-b875-06de0f33ab67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:11.392125 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-46db3146-6384-4532-b875-06de0f33ab67 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:11.394140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-46db3146-6384-4532-b875-06de0f33ab67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:11.407847 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 735/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:46:11.470236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f662799-709f-4c1f-aebc-97b4c3d732d3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:11.488501 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f662799-709f-4c1f-aebc-97b4c3d732d3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:11.494918 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6a0e2-1a3a-4826-9bc3-a44e89981e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:11.495912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6a0e2-1a3a-4826-9bc3-a44e89981e9c service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:11.496351 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6a0e2-1a3a-4826-9bc3-a44e89981e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:11.496818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6a0e2-1a3a-4826-9bc3-a44e89981e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:11.511982 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6a0e2-1a3a-4826-9bc3-a44e89981e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:11.513540 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6a0e2-1a3a-4826-9bc3-a44e89981e9c service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:11.525830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 717/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:46:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:46:14.200810 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973a557-1188-4e8b-bee4-1bc0bebd495a None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:14.201454 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973a557-1188-4e8b-bee4-1bc0bebd495a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:14.201454 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973a557-1188-4e8b-bee4-1bc0bebd495a None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:14.202832 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 736/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:46:14.208941 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6502efe-8baf-42e0-b8a7-e83010d10295 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:14.209609 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6502efe-8baf-42e0-b8a7-e83010d10295 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:14.209781 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6502efe-8baf-42e0-b8a7-e83010d10295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:14.217116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=61 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:14.229763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e6502efe-8baf-42e0-b8a7-e83010d10295 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:14.231139 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e6502efe-8baf-42e0-b8a7-e83010d10295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:14.239810 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 718/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:46:14.279364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973a557-1188-4e8b-bee4-1bc0bebd495a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:14.291382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973a557-1188-4e8b-bee4-1bc0bebd495a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:14.295755 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f87be-46e7-4cd1-b596-1c8afc40d864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:14.296506 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f87be-46e7-4cd1-b596-1c8afc40d864 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:14.296845 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f87be-46e7-4cd1-b596-1c8afc40d864 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:14.297159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f87be-46e7-4cd1-b596-1c8afc40d864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:14.309560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f87be-46e7-4cd1-b596-1c8afc40d864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:14.311990 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f87be-46e7-4cd1-b596-1c8afc40d864 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:14.327786 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 737/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:46:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:46:16.746866 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec960692-d66c-4cbb-af60-1823c3ed97bf None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:16.747461 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec960692-d66c-4cbb-af60-1823c3ed97bf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:16.747461 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec960692-d66c-4cbb-af60-1823c3ed97bf None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:16.748804 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 719/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:46:16.755276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c27db-8e76-426d-96c5-c9742f22e508 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:16.755831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c27db-8e76-426d-96c5-c9742f22e508 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:16.755831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c27db-8e76-426d-96c5-c9742f22e508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:16.762133 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=70 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:16.775454 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-489c27db-8e76-426d-96c5-c9742f22e508 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:16.776963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-489c27db-8e76-426d-96c5-c9742f22e508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:16.785099 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 738/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:46:16.823719 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec960692-d66c-4cbb-af60-1823c3ed97bf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:16.835788 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec960692-d66c-4cbb-af60-1823c3ed97bf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:16.839942 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d20c99-b02e-4a40-a354-112507647bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:16.843859 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d20c99-b02e-4a40-a354-112507647bcf service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:16.843859 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d20c99-b02e-4a40-a354-112507647bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:16.843859 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d20c99-b02e-4a40-a354-112507647bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:16.851477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d20c99-b02e-4a40-a354-112507647bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:16.852926 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d20c99-b02e-4a40-a354-112507647bcf service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:16.863234 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 720/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:46:19.167591 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2580fc6-f94e-4b1f-ba2d-4cfc4687a5ad None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:19.168183 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2580fc6-f94e-4b1f-ba2d-4cfc4687a5ad None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:19.168595 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2580fc6-f94e-4b1f-ba2d-4cfc4687a5ad None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:19.170125 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 739/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:46:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:46:19.176904 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd36e15-1924-49e8-9504-58b03fca3e09 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:19.177513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd36e15-1924-49e8-9504-58b03fca3e09 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:19.177513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd36e15-1924-49e8-9504-58b03fca3e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:19.196772 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8fd36e15-1924-49e8-9504-58b03fca3e09 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:19.198036 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8fd36e15-1924-49e8-9504-58b03fca3e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:19.206648 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 721/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:46:19.249183 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2580fc6-f94e-4b1f-ba2d-4cfc4687a5ad None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:19.265183 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2580fc6-f94e-4b1f-ba2d-4cfc4687a5ad None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:19.269014 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc41e85-2ae0-4344-b6f1-308eb8d5a317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:19.269704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc41e85-2ae0-4344-b6f1-308eb8d5a317 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:19.270093 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc41e85-2ae0-4344-b6f1-308eb8d5a317 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:19.270274 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc41e85-2ae0-4344-b6f1-308eb8d5a317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:19.280352 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc41e85-2ae0-4344-b6f1-308eb8d5a317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:19.281976 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc41e85-2ae0-4344-b6f1-308eb8d5a317 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:19.294865 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 740/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:46:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:46:21.623933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bf207-7213-47a8-87fb-a4544a735e96 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:21.624505 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bf207-7213-47a8-87fb-a4544a735e96 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:21.624505 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bf207-7213-47a8-87fb-a4544a735e96 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:21.625858 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 722/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:46:21.631894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ef8cf-5717-4a1f-ba7b-0a816c1345ba None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:21.632464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ef8cf-5717-4a1f-ba7b-0a816c1345ba None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:21.632464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ef8cf-5717-4a1f-ba7b-0a816c1345ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:21.651205 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-be6ef8cf-5717-4a1f-ba7b-0a816c1345ba None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:21.652435 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-be6ef8cf-5717-4a1f-ba7b-0a816c1345ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:21.661110 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 741/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:46:21.699089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bf207-7213-47a8-87fb-a4544a735e96 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:21.710427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bf207-7213-47a8-87fb-a4544a735e96 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:21.716585 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c58907-49ea-44f1-91e9-67c598e57fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:21.717251 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c58907-49ea-44f1-91e9-67c598e57fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:21.717561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c58907-49ea-44f1-91e9-67c598e57fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:21.717832 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c58907-49ea-44f1-91e9-67c598e57fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:21.728940 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c58907-49ea-44f1-91e9-67c598e57fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:21.730414 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c58907-49ea-44f1-91e9-67c598e57fd4 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:21.741484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 723/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:46:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:46:24.049480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0f035-809f-4054-a831-b1a2f721b86b None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:24.050036 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0f035-809f-4054-a831-b1a2f721b86b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:24.050036 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0f035-809f-4054-a831-b1a2f721b86b None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:24.051534 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 742/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:46:24.059270 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906669b-135d-415c-a142-5103a45b9309 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:24.060047 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906669b-135d-415c-a142-5103a45b9309 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:24.060047 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906669b-135d-415c-a142-5103a45b9309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:24.083382 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3906669b-135d-415c-a142-5103a45b9309 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:24.107448 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3906669b-135d-415c-a142-5103a45b9309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:24.107448 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 724/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:46:24.132447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0f035-809f-4054-a831-b1a2f721b86b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:24.144154 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0f035-809f-4054-a831-b1a2f721b86b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:24.148577 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8444e23-47da-4d45-8d83-cadadeb78ddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:24.149506 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8444e23-47da-4d45-8d83-cadadeb78ddf service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:24.149987 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8444e23-47da-4d45-8d83-cadadeb78ddf service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:24.150295 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8444e23-47da-4d45-8d83-cadadeb78ddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:24.161586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8444e23-47da-4d45-8d83-cadadeb78ddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:24.163535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8444e23-47da-4d45-8d83-cadadeb78ddf service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:24.177371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 743/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:46:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:46:26.456349 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646ceff-f71e-4fc3-8e90-e05a713f9898 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:26.456923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646ceff-f71e-4fc3-8e90-e05a713f9898 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:26.456923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646ceff-f71e-4fc3-8e90-e05a713f9898 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:26.458259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 725/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:46:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:46:26.463818 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b817071-837d-4b64-bdbb-bd70f5fc793a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:26.464226 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b817071-837d-4b64-bdbb-bd70f5fc793a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:26.464382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b817071-837d-4b64-bdbb-bd70f5fc793a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:26.482245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4b817071-837d-4b64-bdbb-bd70f5fc793a None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:26.483460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4b817071-837d-4b64-bdbb-bd70f5fc793a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:26.491440 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 744/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:46:26.528033 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646ceff-f71e-4fc3-8e90-e05a713f9898 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:26.538856 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646ceff-f71e-4fc3-8e90-e05a713f9898 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:26.542367 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646e6cd-241b-4465-8476-da9732d91bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:26.543021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646e6cd-241b-4465-8476-da9732d91bbe service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:26.543302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646e6cd-241b-4465-8476-da9732d91bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:26.543575 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646e6cd-241b-4465-8476-da9732d91bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:26.552475 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646e6cd-241b-4465-8476-da9732d91bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:26.553943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646e6cd-241b-4465-8476-da9732d91bbe service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:26.563282 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 726/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:46:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:46:36.477015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=20 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:36.559144 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=26 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:00.433098 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfd1cb-31fd-4d48-98b1-e5cb2b781295 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:00.433653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfd1cb-31fd-4d48-98b1-e5cb2b781295 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:00.433653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfd1cb-31fd-4d48-98b1-e5cb2b781295 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:00.434998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 745/1471] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:47:00.440633 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7e6d0-4aa4-41ac-bf63-53ccabbe382f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:00.441353 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7e6d0-4aa4-41ac-bf63-53ccabbe382f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:00.441353 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7e6d0-4aa4-41ac-bf63-53ccabbe382f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:00.461248 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f1e7e6d0-4aa4-41ac-bf63-53ccabbe382f None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:47:00.462881 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f1e7e6d0-4aa4-41ac-bf63-53ccabbe382f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:00.471760 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 727/1472] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:47:00.519839 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee566f11-c321-4fe6-b567-68bdd95b69a9 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:00.520178 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee566f11-c321-4fe6-b567-68bdd95b69a9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:00.520498 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee566f11-c321-4fe6-b567-68bdd95b69a9 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:00.522261 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 746/1473] 10.222.0.48 () {54 vars in 962 bytes} [Thu May 26 16:47:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:47:00.527735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73736001-db7e-42a9-a37a-43cf3b66b1ac None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:00.528063 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73736001-db7e-42a9-a37a-43cf3b66b1ac None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:00.528380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73736001-db7e-42a9-a37a-43cf3b66b1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:00.547676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-73736001-db7e-42a9-a37a-43cf3b66b1ac None None] MFA Rules not processed for user `7701907eb3b24c3681352c91ad6a3aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:47:00.548876 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-73736001-db7e-42a9-a37a-43cf3b66b1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:00.555668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 728/1474] 10.222.0.48 () {58 vars in 1059 bytes} [Thu May 26 16:47:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:47:00.563155 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee566f11-c321-4fe6-b567-68bdd95b69a9 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:00.574305 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee566f11-c321-4fe6-b567-68bdd95b69a9 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:00.577791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abbec6-3315-4224-bc6e-1c6b4788d6e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7701907eb3b24c3681352c91ad6a3aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:00.578437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abbec6-3315-4224-bc6e-1c6b4788d6e7 service glance] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:00.579215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abbec6-3315-4224-bc6e-1c6b4788d6e7 service glance] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:00.579484 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abbec6-3315-4224-bc6e-1c6b4788d6e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:00.590087 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abbec6-3315-4224-bc6e-1c6b4788d6e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:00.591543 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abbec6-3315-4224-bc6e-1c6b4788d6e7 service glance] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:00.604129 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 747/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:47:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:47:02.999774 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d8156-9e16-499c-ab40-f56855e631ab None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:03.000390 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d8156-9e16-499c-ab40-f56855e631ab None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:03.000390 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d8156-9e16-499c-ab40-f56855e631ab None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:03.002017 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 729/1476] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:47:03.007906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f5758-1f5b-4e5b-94c2-b4fa54bba028 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:03.008446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f5758-1f5b-4e5b-94c2-b4fa54bba028 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:03.008446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f5758-1f5b-4e5b-94c2-b4fa54bba028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:03.026999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a44f5758-1f5b-4e5b-94c2-b4fa54bba028 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:47:03.028230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a44f5758-1f5b-4e5b-94c2-b4fa54bba028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:03.036777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 748/1477] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:47:03.061775 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d8156-9e16-499c-ab40-f56855e631ab None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:03.081571 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d8156-9e16-499c-ab40-f56855e631ab None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:03.088736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b01c38-cd0e-45d9-8e41-9d44db9a3b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:03.089631 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b01c38-cd0e-45d9-8e41-9d44db9a3b28 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:03.090018 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b01c38-cd0e-45d9-8e41-9d44db9a3b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:03.090405 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b01c38-cd0e-45d9-8e41-9d44db9a3b28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:03.091148 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b01c38-cd0e-45d9-8e41-9d44db9a3b28 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:03.092971 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: WARNING py.warnings [None req-f3b01c38-cd0e-45d9-8e41-9d44db9a3b28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:47:03.092971 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: warnings.warn(msg) May 26 16:47:03.092971 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: May 26 16:47:03.094716 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b01c38-cd0e-45d9-8e41-9d44db9a3b28 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:03.116069 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 730/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 16:47:03 2022] GET /identity/v3/projects => generated 2553 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:47:05.439493 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab436efe-d041-45b8-a332-68d374e575a3 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:05.440062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab436efe-d041-45b8-a332-68d374e575a3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:05.440062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab436efe-d041-45b8-a332-68d374e575a3 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:05.441494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 749/1479] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:47:05.447792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0fc50-ee35-4566-8e7c-035c7a2e0e1d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:05.448832 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0fc50-ee35-4566-8e7c-035c7a2e0e1d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:05.448832 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0fc50-ee35-4566-8e7c-035c7a2e0e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:05.470006 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-50c0fc50-ee35-4566-8e7c-035c7a2e0e1d None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:47:05.471233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-50c0fc50-ee35-4566-8e7c-035c7a2e0e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:05.482292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 731/1480] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:47:05.524818 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab436efe-d041-45b8-a332-68d374e575a3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:05.540326 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab436efe-d041-45b8-a332-68d374e575a3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:05.546351 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306ab83-0a0a-461b-b1dd-2184924d5cca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:05.547009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306ab83-0a0a-461b-b1dd-2184924d5cca service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:05.547785 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306ab83-0a0a-461b-b1dd-2184924d5cca service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:05.548058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306ab83-0a0a-461b-b1dd-2184924d5cca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:05.557100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306ab83-0a0a-461b-b1dd-2184924d5cca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:05.558739 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306ab83-0a0a-461b-b1dd-2184924d5cca service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:05.569576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 750/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:47:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:47:08.091248 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8cf33-1dfa-4c4a-bd08-a3684ce8d865 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:08.091820 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8cf33-1dfa-4c4a-bd08-a3684ce8d865 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:08.091820 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8cf33-1dfa-4c4a-bd08-a3684ce8d865 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:08.093188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 732/1482] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:47:08.099244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f99cda-d869-41ab-8312-bc00fac53841 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:08.099716 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f99cda-d869-41ab-8312-bc00fac53841 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:08.099860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f99cda-d869-41ab-8312-bc00fac53841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:08.118482 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-65f99cda-d869-41ab-8312-bc00fac53841 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:47:08.119730 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-65f99cda-d869-41ab-8312-bc00fac53841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:08.128080 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 751/1483] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:47:08.163534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8cf33-1dfa-4c4a-bd08-a3684ce8d865 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:08.174419 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8cf33-1dfa-4c4a-bd08-a3684ce8d865 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:08.177965 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0166e92-c666-4c5d-ab3a-127e51656bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:08.178628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0166e92-c666-4c5d-ab3a-127e51656bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:08.178913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0166e92-c666-4c5d-ab3a-127e51656bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:08.179214 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0166e92-c666-4c5d-ab3a-127e51656bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:08.189185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0166e92-c666-4c5d-ab3a-127e51656bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:08.190678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0166e92-c666-4c5d-ab3a-127e51656bb3 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:08.200983 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 733/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:47:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:47:10.509115 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c90f4-b173-412c-84d2-6f0beb7bc406 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:10.509751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c90f4-b173-412c-84d2-6f0beb7bc406 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:10.509855 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c90f4-b173-412c-84d2-6f0beb7bc406 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:10.511284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 752/1485] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:47:10.517948 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e63e2e-88b0-45de-a7cf-6286fead2d42 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:10.518481 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e63e2e-88b0-45de-a7cf-6286fead2d42 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:10.518481 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e63e2e-88b0-45de-a7cf-6286fead2d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:10.540445 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-76e63e2e-88b0-45de-a7cf-6286fead2d42 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:47:10.541786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-76e63e2e-88b0-45de-a7cf-6286fead2d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:10.550245 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 734/1486] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:47:10.589163 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c90f4-b173-412c-84d2-6f0beb7bc406 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:10.603044 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c90f4-b173-412c-84d2-6f0beb7bc406 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:10.608760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5d360-98a5-4dde-98bf-f495747507a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:10.610064 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5d360-98a5-4dde-98bf-f495747507a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:10.610549 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5d360-98a5-4dde-98bf-f495747507a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:10.611013 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5d360-98a5-4dde-98bf-f495747507a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:10.626719 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5d360-98a5-4dde-98bf-f495747507a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:10.628189 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5d360-98a5-4dde-98bf-f495747507a3 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:10.639043 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 753/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:47:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:47:13.081105 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fa643-9934-4fa3-b671-1e4bd0dbd754 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:13.081689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fa643-9934-4fa3-b671-1e4bd0dbd754 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:13.081689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fa643-9934-4fa3-b671-1e4bd0dbd754 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:13.083063 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 735/1488] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:47:13.088663 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb09d5-90b0-42c6-950e-42783649a3e9 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:13.089212 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb09d5-90b0-42c6-950e-42783649a3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:13.089356 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb09d5-90b0-42c6-950e-42783649a3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:13.107554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-44eb09d5-90b0-42c6-950e-42783649a3e9 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:47:13.108739 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-44eb09d5-90b0-42c6-950e-42783649a3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:13.116598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 754/1489] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:47:13.155639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fa643-9934-4fa3-b671-1e4bd0dbd754 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:13.167065 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fa643-9934-4fa3-b671-1e4bd0dbd754 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:13.170664 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0ed1e-9b20-471d-9738-a24ddb3cbb6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:13.171302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0ed1e-9b20-471d-9738-a24ddb3cbb6d service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:13.171614 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0ed1e-9b20-471d-9738-a24ddb3cbb6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:13.172057 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0ed1e-9b20-471d-9738-a24ddb3cbb6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:13.181517 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0ed1e-9b20-471d-9738-a24ddb3cbb6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:13.182988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0ed1e-9b20-471d-9738-a24ddb3cbb6d service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:13.192649 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 736/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:47:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:47:15.919049 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e9e73-9eac-44ac-accc-245228d317d0 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:15.919631 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e9e73-9eac-44ac-accc-245228d317d0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:15.919631 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e9e73-9eac-44ac-accc-245228d317d0 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:15.921022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 755/1491] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 16:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:47:15.927962 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0d2a2-70e4-49d9-8a52-81fc56010082 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:15.928664 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0d2a2-70e4-49d9-8a52-81fc56010082 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:15.928857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0d2a2-70e4-49d9-8a52-81fc56010082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:15.948235 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c4b0d2a2-70e4-49d9-8a52-81fc56010082 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:47:15.949528 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c4b0d2a2-70e4-49d9-8a52-81fc56010082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:15.958163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 737/1492] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 16:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:47:15.998087 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e9e73-9eac-44ac-accc-245228d317d0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:16.011403 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e9e73-9eac-44ac-accc-245228d317d0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:16.016113 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf11f7-06cd-4f6a-84dd-e5a281ff5560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:16.016781 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf11f7-06cd-4f6a-84dd-e5a281ff5560 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:16.017133 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf11f7-06cd-4f6a-84dd-e5a281ff5560 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:16.017581 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf11f7-06cd-4f6a-84dd-e5a281ff5560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:16.027529 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf11f7-06cd-4f6a-84dd-e5a281ff5560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:16.029122 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf11f7-06cd-4f6a-84dd-e5a281ff5560 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:16.039562 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 756/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:47:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:47:25.942567 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=33 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:26.034765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=33 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:17.117112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e3a48-9c84-45dd-8570-a6ed00e93d30 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:17.118173 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e3a48-9c84-45dd-8570-a6ed00e93d30 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:17.118173 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e3a48-9c84-45dd-8570-a6ed00e93d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:17.138255 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-360e3a48-9c84-45dd-8570-a6ed00e93d30 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:17.139550 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-360e3a48-9c84-45dd-8570-a6ed00e93d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:17.147744 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 738/1494] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:17.158016 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0434c-2696-467c-8f66-b0200a6448c0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:17.158539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0434c-2696-467c-8f66-b0200a6448c0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:17.158646 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0434c-2696-467c-8f66-b0200a6448c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:17.176419 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a1e0434c-2696-467c-8f66-b0200a6448c0 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:17.177673 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a1e0434c-2696-467c-8f66-b0200a6448c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:17.185629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 757/1495] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:17.190770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e3a48-9c84-45dd-8570-a6ed00e93d30 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:17.201594 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e3a48-9c84-45dd-8570-a6ed00e93d30 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:17.206285 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3536b-c919-4f4c-9e3f-40f21492af56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:17.206980 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3536b-c919-4f4c-9e3f-40f21492af56 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:17.207276 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3536b-c919-4f4c-9e3f-40f21492af56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:17.207568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3536b-c919-4f4c-9e3f-40f21492af56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:17.208334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3536b-c919-4f4c-9e3f-40f21492af56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:49:17.208650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3536b-c919-4f4c-9e3f-40f21492af56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:17.209762 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: WARNING py.warnings [None req-dca3536b-c919-4f4c-9e3f-40f21492af56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:49:17.209762 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: warnings.warn(msg) May 26 16:49:17.209762 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: May 26 16:49:17.210698 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3536b-c919-4f4c-9e3f-40f21492af56 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:17.224194 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 739/1496] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:49:17.232730 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0434c-2696-467c-8f66-b0200a6448c0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:17.241922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0434c-2696-467c-8f66-b0200a6448c0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:17.246586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fc0d5-ff79-42d0-9c9e-669669d208f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:17.247238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fc0d5-ff79-42d0-9c9e-669669d208f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:17.247521 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fc0d5-ff79-42d0-9c9e-669669d208f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:17.247795 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fc0d5-ff79-42d0-9c9e-669669d208f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:17.248560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fc0d5-ff79-42d0-9c9e-669669d208f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:17.250485 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: WARNING py.warnings [None req-e56fc0d5-ff79-42d0-9c9e-669669d208f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:49:17.250485 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: warnings.warn(msg) May 26 16:49:17.250485 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: May 26 16:49:17.251713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fc0d5-ff79-42d0-9c9e-669669d208f9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:17.362850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 758/1497] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:49:17 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:17.367188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3536b-c919-4f4c-9e3f-40f21492af56 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:17.377438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3536b-c919-4f4c-9e3f-40f21492af56 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:17.434311 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd6380-daca-4aff-93a3-cf6718947791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:17.435159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd6380-daca-4aff-93a3-cf6718947791 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:17.435310 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd6380-daca-4aff-93a3-cf6718947791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:17.435586 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd6380-daca-4aff-93a3-cf6718947791 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:17.436282 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd6380-daca-4aff-93a3-cf6718947791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:17.437327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: WARNING py.warnings [None req-08fd6380-daca-4aff-93a3-cf6718947791 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:49:17.437327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: warnings.warn(msg) May 26 16:49:17.437327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: May 26 16:49:17.438557 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd6380-daca-4aff-93a3-cf6718947791 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:17.552645 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 740/1498] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:49:17 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:17.556842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fc0d5-ff79-42d0-9c9e-669669d208f9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:17.567790 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fc0d5-ff79-42d0-9c9e-669669d208f9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:17.572414 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b2f38-edca-44b3-9c6d-dfb9f95d5c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:17.573079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b2f38-edca-44b3-9c6d-dfb9f95d5c30 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:17.573402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b2f38-edca-44b3-9c6d-dfb9f95d5c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:17.573688 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b2f38-edca-44b3-9c6d-dfb9f95d5c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:17.574404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b2f38-edca-44b3-9c6d-dfb9f95d5c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:17.576041 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: WARNING py.warnings [None req-7c6b2f38-edca-44b3-9c6d-dfb9f95d5c30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:49:17.576041 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: warnings.warn(msg) May 26 16:49:17.576041 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: May 26 16:49:17.576968 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b2f38-edca-44b3-9c6d-dfb9f95d5c30 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:17.590076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 759/1499] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:17.594280 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd6380-daca-4aff-93a3-cf6718947791 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:17.604464 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd6380-daca-4aff-93a3-cf6718947791 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:17.609384 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bf391-79c3-4f66-8295-596e602a96b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:17.610077 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bf391-79c3-4f66-8295-596e602a96b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:17.610328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bf391-79c3-4f66-8295-596e602a96b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:17.610631 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bf391-79c3-4f66-8295-596e602a96b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:17.611380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bf391-79c3-4f66-8295-596e602a96b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:17.612389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: WARNING py.warnings [None req-586bf391-79c3-4f66-8295-596e602a96b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:49:17.612389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: warnings.warn(msg) May 26 16:49:17.612389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: May 26 16:49:17.613283 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bf391-79c3-4f66-8295-596e602a96b5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:17.627893 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 741/1500] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:17.632080 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b2f38-edca-44b3-9c6d-dfb9f95d5c30 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:17.642755 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b2f38-edca-44b3-9c6d-dfb9f95d5c30 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:17.647577 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a816f-2077-4875-b384-18e0257c3904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:17.648458 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a816f-2077-4875-b384-18e0257c3904 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:17.648744 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a816f-2077-4875-b384-18e0257c3904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:17.649016 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a816f-2077-4875-b384-18e0257c3904 admin admin] PATH_INFO: `/v3/projects/5db374f91db148e9ba1d1d1e3a9197b4/users/e33209d018d146518f2df8c1a234e085/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:17.663831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a816f-2077-4875-b384-18e0257c3904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db374f91db148e9ba1d1d1e3a9197b4, user_id=e33209d018d146518f2df8c1a234e085, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:17.667882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: WARNING py.warnings [None req-877a816f-2077-4875-b384-18e0257c3904 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:49:17.667882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: warnings.warn(msg) May 26 16:49:17.667882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: May 26 16:49:17.667882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a816f-2077-4875-b384-18e0257c3904 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:17.773034 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 760/1501] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:49:17 2022] PUT /identity/v3/projects/5db374f91db148e9ba1d1d1e3a9197b4/users/e33209d018d146518f2df8c1a234e085/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:17.784753 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5cde3-dae2-4767-a776-e28fe81c75b1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:17.785028 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5cde3-dae2-4767-a776-e28fe81c75b1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:17.785338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5cde3-dae2-4767-a776-e28fe81c75b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:17.812336 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ffc5cde3-dae2-4767-a776-e28fe81c75b1 None None] MFA Rules not processed for user `e33209d018d146518f2df8c1a234e085`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:17.813585 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ffc5cde3-dae2-4767-a776-e28fe81c75b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:17.878989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 742/1502] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:49:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:17.893539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba2320-0208-4b60-b506-7ca4e514a2d5 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:17.893846 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba2320-0208-4b60-b506-7ca4e514a2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:17.894121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba2320-0208-4b60-b506-7ca4e514a2d5 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:17.895501 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 761/1503] 10.222.0.48 () {54 vars in 963 bytes} [Thu May 26 16:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:49:17.900702 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba9063-6efd-479f-aa45-317a50500b9d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:17.901016 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba9063-6efd-479f-aa45-317a50500b9d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:17.901323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba9063-6efd-479f-aa45-317a50500b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:17.920497 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-88ba9063-6efd-479f-aa45-317a50500b9d None None] MFA Rules not processed for user `8be9c9fb92c049c18a54b25725a34a74`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:17.921775 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-88ba9063-6efd-479f-aa45-317a50500b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:17.968168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:17.976060 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 743/1504] 10.222.0.48 () {58 vars in 1060 bytes} [Thu May 26 16:49:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:17.984715 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba2320-0208-4b60-b506-7ca4e514a2d5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:18.000004 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba2320-0208-4b60-b506-7ca4e514a2d5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:18.004020 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29971456-3e18-40c1-b67e-0384b8d99cdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:18.004692 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29971456-3e18-40c1-b67e-0384b8d99cdb service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:18.004973 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29971456-3e18-40c1-b67e-0384b8d99cdb service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:18.005293 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29971456-3e18-40c1-b67e-0384b8d99cdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:18.014671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29971456-3e18-40c1-b67e-0384b8d99cdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:18.016136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29971456-3e18-40c1-b67e-0384b8d99cdb service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:18.026084 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 762/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:49:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:18.070463 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4f040-d7a0-4162-9bf9-42636b5ee936 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:18.070827 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4f040-d7a0-4162-9bf9-42636b5ee936 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:18.071115 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4f040-d7a0-4162-9bf9-42636b5ee936 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:18.072417 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 744/1506] 10.222.0.48 () {52 vars in 829 bytes} [Thu May 26 16:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:49:18.076392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29971456-3e18-40c1-b67e-0384b8d99cdb service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:18.139225 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29971456-3e18-40c1-b67e-0384b8d99cdb service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:18.143785 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c89c67-d898-46bb-b5c0-f92a32bb1962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:18.144723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c89c67-d898-46bb-b5c0-f92a32bb1962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:18.145008 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c89c67-d898-46bb-b5c0-f92a32bb1962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:18.145310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c89c67-d898-46bb-b5c0-f92a32bb1962 admin admin] PATH_INFO: `/v3/users/e33209d018d146518f2df8c1a234e085` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:18.146500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c89c67-d898-46bb-b5c0-f92a32bb1962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e33209d018d146518f2df8c1a234e085)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:18.147512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: WARNING py.warnings [None req-55c89c67-d898-46bb-b5c0-f92a32bb1962 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:49:18.147512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: warnings.warn(msg) May 26 16:49:18.147512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: May 26 16:49:18.148721 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c89c67-d898-46bb-b5c0-f92a32bb1962 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:18.392213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-55c89c67-d898-46bb-b5c0-f92a32bb1962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e33209d018d146518f2df8c1a234e085'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:18.392899 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-55c89c67-d898-46bb-b5c0-f92a32bb1962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e33209d018d146518f2df8c1a234e085'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:18.406256 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-55c89c67-d898-46bb-b5c0-f92a32bb1962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e33209d018d146518f2df8c1a234e085'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:18.481203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-55c89c67-d898-46bb-b5c0-f92a32bb1962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e33209d018d146518f2df8c1a234e085'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:18.482640 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-55c89c67-d898-46bb-b5c0-f92a32bb1962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e33209d018d146518f2df8c1a234e085'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:18.501126 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:18.509240 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 763/1507] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:49:18 2022] DELETE /identity/v3/users/e33209d018d146518f2df8c1a234e085 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:18.513947 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678cce6-9967-433f-baec-96f503e3ebe2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:18.519365 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678cce6-9967-433f-baec-96f503e3ebe2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:18.519365 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678cce6-9967-433f-baec-96f503e3ebe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:18.533109 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0678cce6-9967-433f-baec-96f503e3ebe2 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:18.534336 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0678cce6-9967-433f-baec-96f503e3ebe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:18.595581 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 745/1508] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:49:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:18.611874 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c89c67-d898-46bb-b5c0-f92a32bb1962 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:18.613528 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-55c89c67-d898-46bb-b5c0-f92a32bb1962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:18.676461 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c89c67-d898-46bb-b5c0-f92a32bb1962 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:18.680090 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3ba9f-dd27-4352-bdef-9ff472825f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:18.680750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3ba9f-dd27-4352-bdef-9ff472825f22 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:18.681032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3ba9f-dd27-4352-bdef-9ff472825f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:18.681337 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3ba9f-dd27-4352-bdef-9ff472825f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:18.691346 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3ba9f-dd27-4352-bdef-9ff472825f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:18.692799 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3ba9f-dd27-4352-bdef-9ff472825f22 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:18.702978 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 764/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:49:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:19.227819 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678cce6-9967-433f-baec-96f503e3ebe2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:19.233358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0678cce6-9967-433f-baec-96f503e3ebe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:19.241896 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678cce6-9967-433f-baec-96f503e3ebe2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:19.246975 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d682ab-41a5-49c1-9e65-dc766f494cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:19.247628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d682ab-41a5-49c1-9e65-dc766f494cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:19.247908 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d682ab-41a5-49c1-9e65-dc766f494cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:19.248184 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d682ab-41a5-49c1-9e65-dc766f494cad admin admin] PATH_INFO: `/v3/projects/5db374f91db148e9ba1d1d1e3a9197b4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:19.249433 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d682ab-41a5-49c1-9e65-dc766f494cad admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db374f91db148e9ba1d1d1e3a9197b4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:19.250466 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: WARNING py.warnings [None req-c3d682ab-41a5-49c1-9e65-dc766f494cad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:49:19.250466 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: warnings.warn(msg) May 26 16:49:19.250466 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: May 26 16:49:19.251684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d682ab-41a5-49c1-9e65-dc766f494cad admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:19.405561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c3d682ab-41a5-49c1-9e65-dc766f494cad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db374f91db148e9ba1d1d1e3a9197b4', 'request_id': 'req-c3d682ab-41a5-49c1-9e65-dc766f494cad'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:19.411838 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c3d682ab-41a5-49c1-9e65-dc766f494cad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db374f91db148e9ba1d1d1e3a9197b4', 'request_id': 'req-c3d682ab-41a5-49c1-9e65-dc766f494cad'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:19.426701 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c3d682ab-41a5-49c1-9e65-dc766f494cad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db374f91db148e9ba1d1d1e3a9197b4', 'request_id': 'req-c3d682ab-41a5-49c1-9e65-dc766f494cad'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:19.552001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c3d682ab-41a5-49c1-9e65-dc766f494cad admin admin] The token cache is being invalidate because project 5db374f91db148e9ba1d1d1e3a9197b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:19.552704 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c3d682ab-41a5-49c1-9e65-dc766f494cad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:19.553043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c3d682ab-41a5-49c1-9e65-dc766f494cad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:19.554655 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 746/1510] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:49:19 2022] DELETE /identity/v3/projects/5db374f91db148e9ba1d1d1e3a9197b4 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:28.733069 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:29.548580 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:09.564224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034bac4-f617-48d4-a8a1-16d60c40efc9 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:09.564939 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034bac4-f617-48d4-a8a1-16d60c40efc9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:09.564939 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034bac4-f617-48d4-a8a1-16d60c40efc9 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:09.566305 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 765/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:51:09.571576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafed9e-a16c-47ec-8eba-d5692815e389 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:09.572120 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafed9e-a16c-47ec-8eba-d5692815e389 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:09.572286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafed9e-a16c-47ec-8eba-d5692815e389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:09.591389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-abafed9e-a16c-47ec-8eba-d5692815e389 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:09.592600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-abafed9e-a16c-47ec-8eba-d5692815e389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:09.653552 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 747/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:09.828098 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034bac4-f617-48d4-a8a1-16d60c40efc9 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:09.829901 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d034bac4-f617-48d4-a8a1-16d60c40efc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:09.911728 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034bac4-f617-48d4-a8a1-16d60c40efc9 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:09.917212 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7976f-4858-4b04-9984-cb1830012983 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:09.917896 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7976f-4858-4b04-9984-cb1830012983 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:09.918179 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7976f-4858-4b04-9984-cb1830012983 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:09.918455 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7976f-4858-4b04-9984-cb1830012983 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:09.928310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7976f-4858-4b04-9984-cb1830012983 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:09.930091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7976f-4858-4b04-9984-cb1830012983 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:09.940719 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 766/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:51:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:10.838793 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d6d69-e431-40cd-b58b-799b55331457 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:10.839414 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d6d69-e431-40cd-b58b-799b55331457 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:10.839414 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d6d69-e431-40cd-b58b-799b55331457 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:10.841584 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 748/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:51:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:51:10.846874 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37872f55-31ec-4bf9-a550-743bee0e14db None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:10.847346 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37872f55-31ec-4bf9-a550-743bee0e14db None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:10.847448 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37872f55-31ec-4bf9-a550-743bee0e14db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:10.873667 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-37872f55-31ec-4bf9-a550-743bee0e14db None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:10.874884 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-37872f55-31ec-4bf9-a550-743bee0e14db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:10.883643 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 767/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:11.035178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d6d69-e431-40cd-b58b-799b55331457 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:11.057970 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d6d69-e431-40cd-b58b-799b55331457 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:11.064620 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ca3f4-1f06-41e8-ba22-4bd94a5b83df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:11.065285 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ca3f4-1f06-41e8-ba22-4bd94a5b83df service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:11.065591 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ca3f4-1f06-41e8-ba22-4bd94a5b83df service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:11.065870 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ca3f4-1f06-41e8-ba22-4bd94a5b83df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:11.076333 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ca3f4-1f06-41e8-ba22-4bd94a5b83df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:11.078006 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ca3f4-1f06-41e8-ba22-4bd94a5b83df service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:11.088274 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 749/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:51:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:11.531249 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb21b7-f3db-49f3-8688-316101283b07 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:11.531534 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb21b7-f3db-49f3-8688-316101283b07 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:11.531818 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb21b7-f3db-49f3-8688-316101283b07 None None] PATH_INFO: `/v3` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:11.533154 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 768/1517] 10.222.0.95 () {54 vars in 925 bytes} [Thu May 26 16:51:11 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:51:11.539883 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943c3af-98f9-4eaa-85f7-fa0498296966 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:11.540176 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943c3af-98f9-4eaa-85f7-fa0498296966 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:11.540491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943c3af-98f9-4eaa-85f7-fa0498296966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:11.560791 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6943c3af-98f9-4eaa-85f7-fa0498296966 None None] MFA Rules not processed for user `beeefb9b8d394407a5e7a32f5a00ffad`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:11.561295 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6943c3af-98f9-4eaa-85f7-fa0498296966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:11.634621 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 750/1518] 10.222.0.95 () {58 vars in 1015 bytes} [Thu May 26 16:51:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:20.867793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=37 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:21.549440 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2271dd-3a1a-4feb-97c5-ee57efa29d6d None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:21.549782 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2271dd-3a1a-4feb-97c5-ee57efa29d6d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:21.550057 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2271dd-3a1a-4feb-97c5-ee57efa29d6d None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:21.551504 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 769/1519] 10.222.0.48 () {54 vars in 960 bytes} [Thu May 26 16:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:51:21.556879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1683181-7c27-4bdd-bd08-e0e1d911c37c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:21.557436 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1683181-7c27-4bdd-bd08-e0e1d911c37c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:21.557436 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1683181-7c27-4bdd-bd08-e0e1d911c37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:21.576948 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e1683181-7c27-4bdd-bd08-e0e1d911c37c None None] MFA Rules not processed for user `beeefb9b8d394407a5e7a32f5a00ffad`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:21.578192 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e1683181-7c27-4bdd-bd08-e0e1d911c37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:21.586930 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 751/1520] 10.222.0.48 () {58 vars in 1057 bytes} [Thu May 26 16:51:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:21.594805 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2271dd-3a1a-4feb-97c5-ee57efa29d6d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:21.609039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2271dd-3a1a-4feb-97c5-ee57efa29d6d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:21.614032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493d734-cfdc-4e81-a49c-839fb8cbdbea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beeefb9b8d394407a5e7a32f5a00ffad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:21.614682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493d734-cfdc-4e81-a49c-839fb8cbdbea service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:21.614962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493d734-cfdc-4e81-a49c-839fb8cbdbea service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:21.615231 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493d734-cfdc-4e81-a49c-839fb8cbdbea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:21.625121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493d734-cfdc-4e81-a49c-839fb8cbdbea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:21.627876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493d734-cfdc-4e81-a49c-839fb8cbdbea service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:21.639834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 770/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:51:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:22.412484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d74732-811c-4069-ad5e-f13a7f1ca474 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:22.412717 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d74732-811c-4069-ad5e-f13a7f1ca474 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:22.412958 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d74732-811c-4069-ad5e-f13a7f1ca474 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:22.414687 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 752/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:51:22.420760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b2997-3eb7-44ea-8cc7-c93b99700926 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:22.421388 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b2997-3eb7-44ea-8cc7-c93b99700926 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:22.421388 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b2997-3eb7-44ea-8cc7-c93b99700926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:22.446873 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5d3b2997-3eb7-44ea-8cc7-c93b99700926 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:22.448118 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5d3b2997-3eb7-44ea-8cc7-c93b99700926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:22.459096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 771/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:22.617176 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d74732-811c-4069-ad5e-f13a7f1ca474 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:22.632708 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d74732-811c-4069-ad5e-f13a7f1ca474 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:22.639272 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699760d7-5b59-4f0a-8e67-f796d3048347 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:22.639946 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699760d7-5b59-4f0a-8e67-f796d3048347 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:22.640226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699760d7-5b59-4f0a-8e67-f796d3048347 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:22.640499 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699760d7-5b59-4f0a-8e67-f796d3048347 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:22.651058 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699760d7-5b59-4f0a-8e67-f796d3048347 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:22.655918 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699760d7-5b59-4f0a-8e67-f796d3048347 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:22.667531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 753/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:51:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:51:23.576728 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa24f4-4b4b-402a-8c1a-e76c4c1db3a2 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:23.577695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa24f4-4b4b-402a-8c1a-e76c4c1db3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:23.577923 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa24f4-4b4b-402a-8c1a-e76c4c1db3a2 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:23.579696 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 772/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:51:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:51:23.585416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba2bc0-f81c-42ec-a486-aac8d1fd8a16 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:23.586978 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba2bc0-f81c-42ec-a486-aac8d1fd8a16 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:23.586978 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba2bc0-f81c-42ec-a486-aac8d1fd8a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:23.605559 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2eba2bc0-f81c-42ec-a486-aac8d1fd8a16 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:23.606874 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2eba2bc0-f81c-42ec-a486-aac8d1fd8a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:23.621860 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 754/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:23.773036 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa24f4-4b4b-402a-8c1a-e76c4c1db3a2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:23.789529 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa24f4-4b4b-402a-8c1a-e76c4c1db3a2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:23.799195 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28d935-148a-4894-88cb-a7b76adb4daf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:23.799195 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28d935-148a-4894-88cb-a7b76adb4daf service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:23.799195 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28d935-148a-4894-88cb-a7b76adb4daf service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:23.799195 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28d935-148a-4894-88cb-a7b76adb4daf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:23.810358 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28d935-148a-4894-88cb-a7b76adb4daf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:23.811986 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28d935-148a-4894-88cb-a7b76adb4daf service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:23.821969 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 773/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:51:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:28.410787 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76532e9c-2cc2-44d4-8ce7-a38f1c121854 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:28.411462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76532e9c-2cc2-44d4-8ce7-a38f1c121854 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:28.411462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76532e9c-2cc2-44d4-8ce7-a38f1c121854 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:28.412744 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 755/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:51:28.418489 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea67e4-6835-44bf-89a6-da1316278a25 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:28.419064 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea67e4-6835-44bf-89a6-da1316278a25 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:28.419064 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea67e4-6835-44bf-89a6-da1316278a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:28.439772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-20ea67e4-6835-44bf-89a6-da1316278a25 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:28.441246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-20ea67e4-6835-44bf-89a6-da1316278a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:28.450545 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 774/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:28.488983 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76532e9c-2cc2-44d4-8ce7-a38f1c121854 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:28.491821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-76532e9c-2cc2-44d4-8ce7-a38f1c121854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:28.564785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76532e9c-2cc2-44d4-8ce7-a38f1c121854 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:28.569441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f193b1-2922-45d8-a895-771af0f10a24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:28.570166 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f193b1-2922-45d8-a895-771af0f10a24 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:28.570565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f193b1-2922-45d8-a895-771af0f10a24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:28.570890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f193b1-2922-45d8-a895-771af0f10a24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:28.581991 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f193b1-2922-45d8-a895-771af0f10a24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:28.583452 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f193b1-2922-45d8-a895-771af0f10a24 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:28.589219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:28.595959 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 756/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:30.972838 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9425010-81d7-4317-9a24-a3ddc1f250fb None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:30.973432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9425010-81d7-4317-9a24-a3ddc1f250fb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:30.973534 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9425010-81d7-4317-9a24-a3ddc1f250fb None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:30.974865 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 775/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:51:30.980377 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276549d6-e51f-42ed-a85a-d1c79b45c55c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:30.981596 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276549d6-e51f-42ed-a85a-d1c79b45c55c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:30.981770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276549d6-e51f-42ed-a85a-d1c79b45c55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:31.000831 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-276549d6-e51f-42ed-a85a-d1c79b45c55c None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:31.002121 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-276549d6-e51f-42ed-a85a-d1c79b45c55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:31.010147 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 757/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:31.049490 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9425010-81d7-4317-9a24-a3ddc1f250fb None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:31.061430 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9425010-81d7-4317-9a24-a3ddc1f250fb None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:31.066641 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfae1b-490d-4226-927e-59eee4f6dc06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:31.067312 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfae1b-490d-4226-927e-59eee4f6dc06 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:31.067602 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfae1b-490d-4226-927e-59eee4f6dc06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:31.067882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfae1b-490d-4226-927e-59eee4f6dc06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:31.081493 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfae1b-490d-4226-927e-59eee4f6dc06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:31.082949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfae1b-490d-4226-927e-59eee4f6dc06 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:31.094397 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 776/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:35.009660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8bfe0-d7d7-488f-841c-8e504bf67908 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:35.010272 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8bfe0-d7d7-488f-841c-8e504bf67908 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:35.010272 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8bfe0-d7d7-488f-841c-8e504bf67908 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:35.011633 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 758/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:51:35.017359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0d9b5-6f3a-4f19-a11a-f7f68c6d586c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:35.017834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0d9b5-6f3a-4f19-a11a-f7f68c6d586c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:35.017939 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0d9b5-6f3a-4f19-a11a-f7f68c6d586c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:35.036776 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2cf0d9b5-6f3a-4f19-a11a-f7f68c6d586c None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:35.038037 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2cf0d9b5-6f3a-4f19-a11a-f7f68c6d586c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:35.046523 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 777/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:51:35.324775 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8bfe0-d7d7-488f-841c-8e504bf67908 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:35.326554 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0ec8bfe0-d7d7-488f-841c-8e504bf67908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:35.387893 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8bfe0-d7d7-488f-841c-8e504bf67908 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:35.391475 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14bc8e-8cd5-464d-a85c-cdd826de2711 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:35.392149 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14bc8e-8cd5-464d-a85c-cdd826de2711 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:35.392431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14bc8e-8cd5-464d-a85c-cdd826de2711 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:35.392735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14bc8e-8cd5-464d-a85c-cdd826de2711 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:35.402404 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14bc8e-8cd5-464d-a85c-cdd826de2711 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:35.403888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14bc8e-8cd5-464d-a85c-cdd826de2711 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:35.414480 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 759/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:37.692136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facce29-aad3-4496-8edd-62cec982fecc None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:37.692706 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facce29-aad3-4496-8edd-62cec982fecc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:37.692706 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facce29-aad3-4496-8edd-62cec982fecc None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:37.694149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 778/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:51:37.699990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dd610-b850-4357-a9b5-87ab925c9a00 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:37.700413 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dd610-b850-4357-a9b5-87ab925c9a00 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:37.700554 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dd610-b850-4357-a9b5-87ab925c9a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:37.719798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fa8dd610-b850-4357-a9b5-87ab925c9a00 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:37.721030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fa8dd610-b850-4357-a9b5-87ab925c9a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:37.728958 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 760/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:38.004358 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facce29-aad3-4496-8edd-62cec982fecc None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:38.006115 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0facce29-aad3-4496-8edd-62cec982fecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:38.019705 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facce29-aad3-4496-8edd-62cec982fecc None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:38.023293 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a1f2b-4633-4344-93f3-9c37912bc9b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:38.023927 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a1f2b-4633-4344-93f3-9c37912bc9b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:38.024209 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a1f2b-4633-4344-93f3-9c37912bc9b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:38.024480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a1f2b-4633-4344-93f3-9c37912bc9b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:38.036235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a1f2b-4633-4344-93f3-9c37912bc9b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:38.037688 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a1f2b-4633-4344-93f3-9c37912bc9b4 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:38.047102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 779/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:47.713707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=32 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:48.042968 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=33 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:11.148474 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e588745-d54c-45e3-b8a6-aa4a361630f3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:11.149094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e588745-d54c-45e3-b8a6-aa4a361630f3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:11.149094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e588745-d54c-45e3-b8a6-aa4a361630f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:11.180874 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6e588745-d54c-45e3-b8a6-aa4a361630f3 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:11.187251 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6e588745-d54c-45e3-b8a6-aa4a361630f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:11.196602 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 761/1540] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:11.230927 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47b6e3-2193-4db2-8cfc-63f8b575cf4c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:11.232173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47b6e3-2193-4db2-8cfc-63f8b575cf4c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:11.232683 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47b6e3-2193-4db2-8cfc-63f8b575cf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:11.262373 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3d47b6e3-2193-4db2-8cfc-63f8b575cf4c None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:11.263993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3d47b6e3-2193-4db2-8cfc-63f8b575cf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:11.273411 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 780/1541] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:11.278999 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e588745-d54c-45e3-b8a6-aa4a361630f3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:11.296063 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e588745-d54c-45e3-b8a6-aa4a361630f3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:11.301409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f12da-befd-4bc5-b1bc-23da741a2add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:11.302472 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f12da-befd-4bc5-b1bc-23da741a2add admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:11.302996 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f12da-befd-4bc5-b1bc-23da741a2add admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:11.303605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f12da-befd-4bc5-b1bc-23da741a2add admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:11.304622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f12da-befd-4bc5-b1bc-23da741a2add admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:53:11.305155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f12da-befd-4bc5-b1bc-23da741a2add admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:11.307165 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f12da-befd-4bc5-b1bc-23da741a2add admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:11.327698 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 762/1542] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:53:11.336252 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47b6e3-2193-4db2-8cfc-63f8b575cf4c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:11.347540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47b6e3-2193-4db2-8cfc-63f8b575cf4c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:11.354543 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e572d1-8c42-44c8-8282-b43abbb17a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:11.355601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e572d1-8c42-44c8-8282-b43abbb17a94 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:11.356130 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e572d1-8c42-44c8-8282-b43abbb17a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:11.356631 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e572d1-8c42-44c8-8282-b43abbb17a94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:11.357624 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e572d1-8c42-44c8-8282-b43abbb17a94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:11.359839 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e572d1-8c42-44c8-8282-b43abbb17a94 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:11.462342 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde773cd-5708-40a7-b82b-8061ba05f351 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:11.462635 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde773cd-5708-40a7-b82b-8061ba05f351 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:11.463208 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde773cd-5708-40a7-b82b-8061ba05f351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:11.499282 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bde773cd-5708-40a7-b82b-8061ba05f351 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:11.501082 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bde773cd-5708-40a7-b82b-8061ba05f351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:11.515526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 763/1543] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:53:11.518908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 781/1544] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:53:11 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:11.523672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde773cd-5708-40a7-b82b-8061ba05f351 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:11.539927 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde773cd-5708-40a7-b82b-8061ba05f351 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:11.548337 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6b7de-8f29-4694-82fd-2711665445c2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:11.548714 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6b7de-8f29-4694-82fd-2711665445c2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:11.549069 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6b7de-8f29-4694-82fd-2711665445c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:11.595311 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-dfd6b7de-8f29-4694-82fd-2711665445c2 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:11.596563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dfd6b7de-8f29-4694-82fd-2711665445c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:11.639949 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a183909-6b0b-497f-80fb-de0742c980f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:11.640666 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a183909-6b0b-497f-80fb-de0742c980f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:11.641211 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a183909-6b0b-497f-80fb-de0742c980f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:11.641439 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a183909-6b0b-497f-80fb-de0742c980f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:11.642451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a183909-6b0b-497f-80fb-de0742c980f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:11.649158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a183909-6b0b-497f-80fb-de0742c980f7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:11.750124 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 782/1545] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:11.752031 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee9d9e-7783-48c8-a3db-58a081317fac None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:11.752556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee9d9e-7783-48c8-a3db-58a081317fac None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:11.753065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee9d9e-7783-48c8-a3db-58a081317fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:11.787468 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-faee9d9e-7783-48c8-a3db-58a081317fac None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:11.788696 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-faee9d9e-7783-48c8-a3db-58a081317fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:11.799089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 764/1546] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:53:11 2022] POST /identity/v3/users => generated 289 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:53:11.800772 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04824b-9be0-4617-9615-fe35a9461aab None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:11.801067 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04824b-9be0-4617-9615-fe35a9461aab None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:11.801373 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04824b-9be0-4617-9615-fe35a9461aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:11.803549 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 783/1547] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:11.806610 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a17625-edae-4447-bf13-1b9d711bf391 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:11.807640 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a17625-edae-4447-bf13-1b9d711bf391 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:11.808125 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a17625-edae-4447-bf13-1b9d711bf391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:11.830845 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0f04824b-9be0-4617-9615-fe35a9461aab None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:11.832100 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0f04824b-9be0-4617-9615-fe35a9461aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:11.842160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 765/1548] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:11.843356 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04824b-9be0-4617-9615-fe35a9461aab None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:11.844200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-01a17625-edae-4447-bf13-1b9d711bf391 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:11.846855 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-01a17625-edae-4447-bf13-1b9d711bf391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:11.856659 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04824b-9be0-4617-9615-fe35a9461aab None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:11.862249 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf301ae-effb-4b2e-94d8-938a54137492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:11.862949 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf301ae-effb-4b2e-94d8-938a54137492 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:11.863232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf301ae-effb-4b2e-94d8-938a54137492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:11.863512 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf301ae-effb-4b2e-94d8-938a54137492 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:11.864376 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 784/1549] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:11.864504 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf301ae-effb-4b2e-94d8-938a54137492 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:53:11.864837 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf301ae-effb-4b2e-94d8-938a54137492 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:11.866090 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a17625-edae-4447-bf13-1b9d711bf391 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:11.872902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf301ae-effb-4b2e-94d8-938a54137492 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:11.882945 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a17625-edae-4447-bf13-1b9d711bf391 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:11.889404 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 766/1550] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:53:11.889404 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a50d9-5b3b-42be-84ae-e1a0f1533b99 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:11.889404 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a50d9-5b3b-42be-84ae-e1a0f1533b99 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:11.889404 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a50d9-5b3b-42be-84ae-e1a0f1533b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:11.902828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa73c6-449c-4350-9af9-9d268272baaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:11.903533 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa73c6-449c-4350-9af9-9d268272baaf admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:11.903847 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa73c6-449c-4350-9af9-9d268272baaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:11.904126 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa73c6-449c-4350-9af9-9d268272baaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:11.904869 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa73c6-449c-4350-9af9-9d268272baaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:11.906798 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa73c6-449c-4350-9af9-9d268272baaf admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:11.916142 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-543a50d9-5b3b-42be-84ae-e1a0f1533b99 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:11.917991 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-543a50d9-5b3b-42be-84ae-e1a0f1533b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:11.918521 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 785/1551] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:11.920046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bda999-e7fb-4ec4-b006-06dafe0d1f52 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:11.920436 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bda999-e7fb-4ec4-b006-06dafe0d1f52 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:11.920725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bda999-e7fb-4ec4-b006-06dafe0d1f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:11.927640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 767/1552] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:11.928949 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67164df-850a-43bb-8706-0fe4b9b4a338 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:11.929234 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67164df-850a-43bb-8706-0fe4b9b4a338 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:11.929530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67164df-850a-43bb-8706-0fe4b9b4a338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:11.940977 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d8bda999-e7fb-4ec4-b006-06dafe0d1f52 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:11.942256 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d8bda999-e7fb-4ec4-b006-06dafe0d1f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:11.949750 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a67164df-850a-43bb-8706-0fe4b9b4a338 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:11.950373 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 786/1553] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:11.950948 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a67164df-850a-43bb-8706-0fe4b9b4a338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:11.951666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a8bba-050a-4972-b9db-21343f714d15 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:11.951957 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a8bba-050a-4972-b9db-21343f714d15 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:11.952236 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a8bba-050a-4972-b9db-21343f714d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:11.959156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 768/1554] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:11.960946 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08f1bb-e61b-4a6f-992f-7f3e3257ab79 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:11.961282 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08f1bb-e61b-4a6f-992f-7f3e3257ab79 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:11.961813 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08f1bb-e61b-4a6f-992f-7f3e3257ab79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:11.972122 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-710a8bba-050a-4972-b9db-21343f714d15 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:11.973372 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-710a8bba-050a-4972-b9db-21343f714d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:11.982075 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 787/1555] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:11.982639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5e08f1bb-e61b-4a6f-992f-7f3e3257ab79 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:11.982752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a8bba-050a-4972-b9db-21343f714d15 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:11.983886 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5e08f1bb-e61b-4a6f-992f-7f3e3257ab79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:11.993090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 769/1556] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:11.993398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a8bba-050a-4972-b9db-21343f714d15 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:11.994399 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4a480-ffb3-4096-a441-af202cb83fdb None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:11.995232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4a480-ffb3-4096-a441-af202cb83fdb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:11.995578 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4a480-ffb3-4096-a441-af202cb83fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:11.998992 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db0393-ca40-4b48-a649-9678f6ab7798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:11.999669 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db0393-ca40-4b48-a649-9678f6ab7798 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:11.999954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db0393-ca40-4b48-a649-9678f6ab7798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:12.000231 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db0393-ca40-4b48-a649-9678f6ab7798 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:12.000960 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db0393-ca40-4b48-a649-9678f6ab7798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:12.003019 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db0393-ca40-4b48-a649-9678f6ab7798 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:12.014021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-78f4a480-ffb3-4096-a441-af202cb83fdb None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:12.015337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-78f4a480-ffb3-4096-a441-af202cb83fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:12.023851 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 770/1557] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:12.024823 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4a480-ffb3-4096-a441-af202cb83fdb None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:12.034734 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4a480-ffb3-4096-a441-af202cb83fdb None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:12.039359 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc4e97-c626-47f4-b2d8-9be9e0c6f17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:12.040037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc4e97-c626-47f4-b2d8-9be9e0c6f17e admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:12.040413 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc4e97-c626-47f4-b2d8-9be9e0c6f17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:12.040692 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc4e97-c626-47f4-b2d8-9be9e0c6f17e admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:12.042137 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc4e97-c626-47f4-b2d8-9be9e0c6f17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:12.043784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc4e97-c626-47f4-b2d8-9be9e0c6f17e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:12.055351 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 771/1558] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:12.056790 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c4cd1-5b72-405a-a35c-3bad8c9222bd None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:12.057112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c4cd1-5b72-405a-a35c-3bad8c9222bd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:12.057962 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c4cd1-5b72-405a-a35c-3bad8c9222bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:12.076854 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c09c4cd1-5b72-405a-a35c-3bad8c9222bd None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:12.078133 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c09c4cd1-5b72-405a-a35c-3bad8c9222bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:12.086346 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 772/1559] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:12.087730 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c4cd1-5b72-405a-a35c-3bad8c9222bd None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:12.097987 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c4cd1-5b72-405a-a35c-3bad8c9222bd None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:12.102591 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07110e9-b755-4795-98f6-25c8f33ae9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:12.103256 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07110e9-b755-4795-98f6-25c8f33ae9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:12.103542 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07110e9-b755-4795-98f6-25c8f33ae9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:12.103819 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07110e9-b755-4795-98f6-25c8f33ae9c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:12.105077 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07110e9-b755-4795-98f6-25c8f33ae9c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:53:12.105418 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07110e9-b755-4795-98f6-25c8f33ae9c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:12.107169 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07110e9-b755-4795-98f6-25c8f33ae9c8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:12.119290 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 773/1560] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:53:12.121207 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07110e9-b755-4795-98f6-25c8f33ae9c8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:12.128074 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 788/1561] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:53:11 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:12.129534 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f745b-380d-4454-9d9f-c39a9fcfbe0b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:12.129856 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f745b-380d-4454-9d9f-c39a9fcfbe0b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:12.130115 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f745b-380d-4454-9d9f-c39a9fcfbe0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:12.132758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07110e9-b755-4795-98f6-25c8f33ae9c8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:12.149892 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-593f745b-380d-4454-9d9f-c39a9fcfbe0b None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:12.151143 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-593f745b-380d-4454-9d9f-c39a9fcfbe0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:12.179949 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:12.193643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445622e-8755-4599-b9fc-672d7c168b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:12.196716 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445622e-8755-4599-b9fc-672d7c168b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:12.196716 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445622e-8755-4599-b9fc-672d7c168b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:12.196716 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445622e-8755-4599-b9fc-672d7c168b6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:12.196716 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445622e-8755-4599-b9fc-672d7c168b6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:53:12.196716 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445622e-8755-4599-b9fc-672d7c168b6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:12.197724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445622e-8755-4599-b9fc-672d7c168b6e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:12.210471 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 774/1562] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:53:12.218222 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445622e-8755-4599-b9fc-672d7c168b6e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:12.223874 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 789/1563] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:12.225210 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445622e-8755-4599-b9fc-672d7c168b6e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:12.229664 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d6138-3673-45cf-901b-d3f3c497b265 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:12.229957 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d6138-3673-45cf-901b-d3f3c497b265 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:12.230240 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d6138-3673-45cf-901b-d3f3c497b265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:12.231562 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78374082-fde5-40db-977b-ec7c2054f115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:12.232328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78374082-fde5-40db-977b-ec7c2054f115 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:12.232674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78374082-fde5-40db-977b-ec7c2054f115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:12.233054 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78374082-fde5-40db-977b-ec7c2054f115 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:12.233962 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78374082-fde5-40db-977b-ec7c2054f115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:53:12.234381 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78374082-fde5-40db-977b-ec7c2054f115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:12.236815 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78374082-fde5-40db-977b-ec7c2054f115 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:12.249857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 775/1564] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:53:12.250700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78374082-fde5-40db-977b-ec7c2054f115 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:12.252843 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-007d6138-3673-45cf-901b-d3f3c497b265 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:12.254687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-007d6138-3673-45cf-901b-d3f3c497b265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:12.261313 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78374082-fde5-40db-977b-ec7c2054f115 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:12.265479 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 790/1565] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:12.266434 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d6138-3673-45cf-901b-d3f3c497b265 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:12.271857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d496d1-d8b4-44cb-9dd7-1b0b79c7e84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:12.273034 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d496d1-d8b4-44cb-9dd7-1b0b79c7e84e admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:12.273355 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d496d1-d8b4-44cb-9dd7-1b0b79c7e84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:12.273844 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d496d1-d8b4-44cb-9dd7-1b0b79c7e84e admin admin] PATH_INFO: `/v3/projects/187d77d887774bbc82b249a64f335d59/users/e17514d68a274a0dbe606bb8db60c747/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:12.279509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d6138-3673-45cf-901b-d3f3c497b265 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:12.286406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e819dd-b0e2-45f3-943b-d6a714385ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:12.287473 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e819dd-b0e2-45f3-943b-d6a714385ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:12.287941 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e819dd-b0e2-45f3-943b-d6a714385ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:12.288412 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e819dd-b0e2-45f3-943b-d6a714385ff2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:12.289773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e819dd-b0e2-45f3-943b-d6a714385ff2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:53:12.290324 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e819dd-b0e2-45f3-943b-d6a714385ff2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:12.292372 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d496d1-d8b4-44cb-9dd7-1b0b79c7e84e admin admin] RBAC: Authorizing `identity:create_grant(project_id=187d77d887774bbc82b249a64f335d59, user_id=e17514d68a274a0dbe606bb8db60c747, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:12.292722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: WARNING py.warnings [None req-60e819dd-b0e2-45f3-943b-d6a714385ff2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:53:12.292722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: warnings.warn(msg) May 26 16:53:12.292722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: May 26 16:53:12.293485 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: WARNING py.warnings [None req-e0d496d1-d8b4-44cb-9dd7-1b0b79c7e84e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:53:12.293485 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: warnings.warn(msg) May 26 16:53:12.293485 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: May 26 16:53:12.294416 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e819dd-b0e2-45f3-943b-d6a714385ff2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:12.295720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d496d1-d8b4-44cb-9dd7-1b0b79c7e84e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:12.297109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:12.309511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 791/1566] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:53:12.317171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e819dd-b0e2-45f3-943b-d6a714385ff2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:12.320933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e819dd-b0e2-45f3-943b-d6a714385ff2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:12.326669 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fc58a-6409-4bcb-aa4e-0d5690c721b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:12.327335 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fc58a-6409-4bcb-aa4e-0d5690c721b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:12.327619 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fc58a-6409-4bcb-aa4e-0d5690c721b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:12.327893 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fc58a-6409-4bcb-aa4e-0d5690c721b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:12.328591 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fc58a-6409-4bcb-aa4e-0d5690c721b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:12.330567 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fc58a-6409-4bcb-aa4e-0d5690c721b9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:12.389408 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 776/1567] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:12 2022] PUT /identity/v3/projects/187d77d887774bbc82b249a64f335d59/users/e17514d68a274a0dbe606bb8db60c747/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:12.390402 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d496d1-d8b4-44cb-9dd7-1b0b79c7e84e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:12.461195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d496d1-d8b4-44cb-9dd7-1b0b79c7e84e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:12.466062 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab133761-042c-4d34-826a-e61282a6b75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:12.466743 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab133761-042c-4d34-826a-e61282a6b75b admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:12.467025 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab133761-042c-4d34-826a-e61282a6b75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:12.467300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab133761-042c-4d34-826a-e61282a6b75b admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:12.467990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab133761-042c-4d34-826a-e61282a6b75b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:12.470229 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab133761-042c-4d34-826a-e61282a6b75b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:12.504453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 792/1568] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:53:12 2022] POST /identity/v3/projects => generated 375 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:12.505404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fc58a-6409-4bcb-aa4e-0d5690c721b9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:12.571253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fc58a-6409-4bcb-aa4e-0d5690c721b9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:12.576897 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26171eb-d2f4-4038-9809-d2b9ae6ad745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:12.577629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26171eb-d2f4-4038-9809-d2b9ae6ad745 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:12.577909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26171eb-d2f4-4038-9809-d2b9ae6ad745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:12.578186 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26171eb-d2f4-4038-9809-d2b9ae6ad745 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:12.578945 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26171eb-d2f4-4038-9809-d2b9ae6ad745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:12.580902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26171eb-d2f4-4038-9809-d2b9ae6ad745 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:12.589909 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 777/1569] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:53:12 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:12.589909 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab133761-042c-4d34-826a-e61282a6b75b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:12.597992 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab133761-042c-4d34-826a-e61282a6b75b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:12.602657 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de4e50-2039-4e6b-b0f6-7534064581ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:12.603322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de4e50-2039-4e6b-b0f6-7534064581ad admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:12.603610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de4e50-2039-4e6b-b0f6-7534064581ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:12.603883 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de4e50-2039-4e6b-b0f6-7534064581ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:12.604635 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de4e50-2039-4e6b-b0f6-7534064581ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:53:12.604934 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de4e50-2039-4e6b-b0f6-7534064581ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:12.606579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de4e50-2039-4e6b-b0f6-7534064581ad admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:12.618458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 778/1570] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:53:12.619253 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de4e50-2039-4e6b-b0f6-7534064581ad admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:12.629846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de4e50-2039-4e6b-b0f6-7534064581ad admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:12.634426 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c639c2f-4526-43c2-826e-7f36e4992340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:12.635085 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c639c2f-4526-43c2-826e-7f36e4992340 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:12.635928 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c639c2f-4526-43c2-826e-7f36e4992340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:12.636281 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c639c2f-4526-43c2-826e-7f36e4992340 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:12.637044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c639c2f-4526-43c2-826e-7f36e4992340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:12.638103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: WARNING py.warnings [None req-7c639c2f-4526-43c2-826e-7f36e4992340 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:53:12.638103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: warnings.warn(msg) May 26 16:53:12.638103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: May 26 16:53:12.639298 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c639c2f-4526-43c2-826e-7f36e4992340 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:12.752791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 793/1571] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:53:12 2022] POST /identity/v3/projects => generated 369 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:12.752791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26171eb-d2f4-4038-9809-d2b9ae6ad745 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:12.802749 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 779/1572] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:53:12 2022] POST /identity/v3/projects => generated 357 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:12.802749 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c639c2f-4526-43c2-826e-7f36e4992340 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:12.827979 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26171eb-d2f4-4038-9809-d2b9ae6ad745 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:12.882583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:12.886697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c639c2f-4526-43c2-826e-7f36e4992340 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:12.895990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf13e3-90c8-499b-975d-39128c7d140c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:12.896675 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf13e3-90c8-499b-975d-39128c7d140c admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:12.896954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf13e3-90c8-499b-975d-39128c7d140c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:12.897227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf13e3-90c8-499b-975d-39128c7d140c admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:12.897987 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf13e3-90c8-499b-975d-39128c7d140c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:12.900187 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf13e3-90c8-499b-975d-39128c7d140c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:12.920702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097f005-0f9c-4fb5-ab70-0554f56476b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:12.921922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097f005-0f9c-4fb5-ab70-0554f56476b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:12.922413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097f005-0f9c-4fb5-ab70-0554f56476b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:12.922872 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097f005-0f9c-4fb5-ab70-0554f56476b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:12.924021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097f005-0f9c-4fb5-ab70-0554f56476b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:53:12.924566 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097f005-0f9c-4fb5-ab70-0554f56476b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:12.927428 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097f005-0f9c-4fb5-ab70-0554f56476b1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:12.939290 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:12.945880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 794/1573] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:53:12.947207 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e3a43-8a08-4899-b03f-775e8b9c977a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:12.947492 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e3a43-8a08-4899-b03f-775e8b9c977a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:12.948913 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e3a43-8a08-4899-b03f-775e8b9c977a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:12.966529 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-844e3a43-8a08-4899-b03f-775e8b9c977a None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:12.967744 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-844e3a43-8a08-4899-b03f-775e8b9c977a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:12.975807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 795/1574] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:12.976566 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e3a43-8a08-4899-b03f-775e8b9c977a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:12.989709 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 780/1575] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:53:12 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:12.990915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf13e3-90c8-499b-975d-39128c7d140c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:12.991058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e3a43-8a08-4899-b03f-775e8b9c977a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:13.053952 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0bac8-b686-467c-ae8b-6930a91f1a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:13.054553 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0bac8-b686-467c-ae8b-6930a91f1a5b admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:13.054844 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0bac8-b686-467c-ae8b-6930a91f1a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:13.055126 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0bac8-b686-467c-ae8b-6930a91f1a5b admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:13.055822 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0bac8-b686-467c-ae8b-6930a91f1a5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:13.056841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: WARNING py.warnings [None req-c9e0bac8-b686-467c-ae8b-6930a91f1a5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:53:13.056841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: warnings.warn(msg) May 26 16:53:13.056841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: May 26 16:53:13.058438 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0bac8-b686-467c-ae8b-6930a91f1a5b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:13.058956 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf13e3-90c8-499b-975d-39128c7d140c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:13.064090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287dceb-acec-4f63-9b55-9eec2774c306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:13.064794 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287dceb-acec-4f63-9b55-9eec2774c306 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:13.065076 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287dceb-acec-4f63-9b55-9eec2774c306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:13.065388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287dceb-acec-4f63-9b55-9eec2774c306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:13.069643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287dceb-acec-4f63-9b55-9eec2774c306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:13.069643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287dceb-acec-4f63-9b55-9eec2774c306 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:13.078808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 781/1576] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:13.079613 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287dceb-acec-4f63-9b55-9eec2774c306 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:13.097567 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287dceb-acec-4f63-9b55-9eec2774c306 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:13.102925 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdea5e-c969-4b6e-bd19-14e0d0dbc222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:13.103588 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdea5e-c969-4b6e-bd19-14e0d0dbc222 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:13.103873 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdea5e-c969-4b6e-bd19-14e0d0dbc222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:13.104829 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdea5e-c969-4b6e-bd19-14e0d0dbc222 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:13.105613 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdea5e-c969-4b6e-bd19-14e0d0dbc222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:13.107613 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdea5e-c969-4b6e-bd19-14e0d0dbc222 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:13.169109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 796/1577] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:53:12 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:13.169109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0bac8-b686-467c-ae8b-6930a91f1a5b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:13.178829 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0bac8-b686-467c-ae8b-6930a91f1a5b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:13.185519 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d7562-57e5-4210-a9f9-792cfbd5f202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:13.186206 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d7562-57e5-4210-a9f9-792cfbd5f202 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:13.195166 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d7562-57e5-4210-a9f9-792cfbd5f202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:13.195166 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d7562-57e5-4210-a9f9-792cfbd5f202 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:13.195166 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d7562-57e5-4210-a9f9-792cfbd5f202 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:13.195166 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d7562-57e5-4210-a9f9-792cfbd5f202 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:13.262328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 782/1578] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:53:13 2022] POST /identity/v3/projects => generated 393 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:13.263192 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdea5e-c969-4b6e-bd19-14e0d0dbc222 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:13.296721 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 797/1579] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:53:13 2022] POST /identity/v3/users => generated 285 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:13.296721 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d7562-57e5-4210-a9f9-792cfbd5f202 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:13.311129 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d7562-57e5-4210-a9f9-792cfbd5f202 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:13.337351 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdea5e-c969-4b6e-bd19-14e0d0dbc222 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:13.342779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0457b0-244d-4a98-a71a-a72bf32074e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:13.343456 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0457b0-244d-4a98-a71a-a72bf32074e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:13.343994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0457b0-244d-4a98-a71a-a72bf32074e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:13.344268 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0457b0-244d-4a98-a71a-a72bf32074e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:13.344955 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0457b0-244d-4a98-a71a-a72bf32074e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:13.346982 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0457b0-244d-4a98-a71a-a72bf32074e1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:13.371903 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45f984-4584-4393-b593-18b2dbabb5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:13.372653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45f984-4584-4393-b593-18b2dbabb5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:13.372930 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45f984-4584-4393-b593-18b2dbabb5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:13.375814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45f984-4584-4393-b593-18b2dbabb5b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:13.375814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45f984-4584-4393-b593-18b2dbabb5b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:13.376009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45f984-4584-4393-b593-18b2dbabb5b6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:13.468913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 783/1580] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:53:13 2022] POST /identity/v3/users => generated 279 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:13.469780 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0457b0-244d-4a98-a71a-a72bf32074e1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:13.481648 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 798/1581] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:53:13 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:13.484748 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45f984-4584-4393-b593-18b2dbabb5b6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:13.524556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:13.531299 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0457b0-244d-4a98-a71a-a72bf32074e1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:13.546254 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:13.562135 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45f984-4584-4393-b593-18b2dbabb5b6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:13.568012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ff69c-5c59-402b-8d85-7b0da5ce27cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:13.568857 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ff69c-5c59-402b-8d85-7b0da5ce27cf admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:13.569146 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ff69c-5c59-402b-8d85-7b0da5ce27cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:13.569445 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ff69c-5c59-402b-8d85-7b0da5ce27cf admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:13.570159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ff69c-5c59-402b-8d85-7b0da5ce27cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:13.572071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ff69c-5c59-402b-8d85-7b0da5ce27cf admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:13.582004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb20bea-3e6d-4f34-bde6-ba12bacc1ee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:13.582707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb20bea-3e6d-4f34-bde6-ba12bacc1ee4 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:13.582990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb20bea-3e6d-4f34-bde6-ba12bacc1ee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:13.583270 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb20bea-3e6d-4f34-bde6-ba12bacc1ee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:13.595309 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb20bea-3e6d-4f34-bde6-ba12bacc1ee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:13.597209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb20bea-3e6d-4f34-bde6-ba12bacc1ee4 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:13.607276 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 784/1582] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:13.608078 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb20bea-3e6d-4f34-bde6-ba12bacc1ee4 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:13.617957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb20bea-3e6d-4f34-bde6-ba12bacc1ee4 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:13.623309 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972d935-d3b4-4d9a-b16d-495e4a7a1730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:13.624592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972d935-d3b4-4d9a-b16d-495e4a7a1730 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:13.624878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972d935-d3b4-4d9a-b16d-495e4a7a1730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:13.625156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972d935-d3b4-4d9a-b16d-495e4a7a1730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:13.626321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972d935-d3b4-4d9a-b16d-495e4a7a1730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:13.627636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972d935-d3b4-4d9a-b16d-495e4a7a1730 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:13.638603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 785/1583] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:13.639555 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972d935-d3b4-4d9a-b16d-495e4a7a1730 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:13.650417 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972d935-d3b4-4d9a-b16d-495e4a7a1730 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:13.656543 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371a1ee-ce59-4606-9da2-7109ce46989f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:13.657227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371a1ee-ce59-4606-9da2-7109ce46989f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:13.657562 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371a1ee-ce59-4606-9da2-7109ce46989f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:13.657836 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371a1ee-ce59-4606-9da2-7109ce46989f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:13.658578 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371a1ee-ce59-4606-9da2-7109ce46989f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:13.660193 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371a1ee-ce59-4606-9da2-7109ce46989f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:13.670491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 786/1584] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:13.671396 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371a1ee-ce59-4606-9da2-7109ce46989f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:13.681003 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371a1ee-ce59-4606-9da2-7109ce46989f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:13.687117 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51048b-5470-4996-b0ef-863b057a5d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:13.687117 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51048b-5470-4996-b0ef-863b057a5d88 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:13.690753 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51048b-5470-4996-b0ef-863b057a5d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:13.690753 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51048b-5470-4996-b0ef-863b057a5d88 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:13.690753 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51048b-5470-4996-b0ef-863b057a5d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:13.690753 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51048b-5470-4996-b0ef-863b057a5d88 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:13.695690 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 799/1585] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:53:13 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:13.696523 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ff69c-5c59-402b-8d85-7b0da5ce27cf admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:13.708053 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ff69c-5c59-402b-8d85-7b0da5ce27cf admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:13.712927 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450f803-9512-4533-b8a0-b2d14f8e7802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:13.714217 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450f803-9512-4533-b8a0-b2d14f8e7802 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:13.714505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450f803-9512-4533-b8a0-b2d14f8e7802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:13.714781 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450f803-9512-4533-b8a0-b2d14f8e7802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:13.715512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450f803-9512-4533-b8a0-b2d14f8e7802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:13.717117 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450f803-9512-4533-b8a0-b2d14f8e7802 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:13.731037 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 800/1586] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:13.731037 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450f803-9512-4533-b8a0-b2d14f8e7802 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:13.742137 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450f803-9512-4533-b8a0-b2d14f8e7802 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:13.748055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c0255-4a06-488c-9600-dca6ce40689d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:13.748879 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c0255-4a06-488c-9600-dca6ce40689d admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:13.749218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c0255-4a06-488c-9600-dca6ce40689d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:13.749610 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c0255-4a06-488c-9600-dca6ce40689d admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:13.750643 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c0255-4a06-488c-9600-dca6ce40689d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:13.753551 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c0255-4a06-488c-9600-dca6ce40689d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:13.773884 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 801/1587] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:13.775068 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c0255-4a06-488c-9600-dca6ce40689d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:13.790840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c0255-4a06-488c-9600-dca6ce40689d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:13.796935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 787/1588] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:53:13 2022] POST /identity/v3/users => generated 297 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:13.796935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51048b-5470-4996-b0ef-863b057a5d88 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:13.802285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf622f-c39f-462e-af9e-890172e7462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:13.803416 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf622f-c39f-462e-af9e-890172e7462f admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:13.804123 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf622f-c39f-462e-af9e-890172e7462f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:13.804589 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf622f-c39f-462e-af9e-890172e7462f admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:13.805999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf622f-c39f-462e-af9e-890172e7462f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:13.810025 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf622f-c39f-462e-af9e-890172e7462f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:13.814746 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51048b-5470-4996-b0ef-863b057a5d88 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:13.823487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c5048-e0ed-4680-8102-607852e00141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:13.824870 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c5048-e0ed-4680-8102-607852e00141 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:13.825413 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c5048-e0ed-4680-8102-607852e00141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:13.825950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c5048-e0ed-4680-8102-607852e00141 admin admin] PATH_INFO: `/v3/projects/0d8ff4576b9d46809257874fbc9dae6c/users/9e7a86972a01482caf212f57ce540321/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:13.841840 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c5048-e0ed-4680-8102-607852e00141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8ff4576b9d46809257874fbc9dae6c, user_id=9e7a86972a01482caf212f57ce540321, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:13.844892 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c5048-e0ed-4680-8102-607852e00141 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:13.913439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 802/1589] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:53:13 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:13.914300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf622f-c39f-462e-af9e-890172e7462f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:13.924529 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf622f-c39f-462e-af9e-890172e7462f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:13.929213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74fde3-1e47-45c5-8f3e-582d94e71468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:13.929935 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74fde3-1e47-45c5-8f3e-582d94e71468 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:13.930231 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74fde3-1e47-45c5-8f3e-582d94e71468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:13.930505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74fde3-1e47-45c5-8f3e-582d94e71468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:13.931290 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74fde3-1e47-45c5-8f3e-582d94e71468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:13.933494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74fde3-1e47-45c5-8f3e-582d94e71468 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:13.944100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 803/1590] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:13.948457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74fde3-1e47-45c5-8f3e-582d94e71468 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:13.960014 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74fde3-1e47-45c5-8f3e-582d94e71468 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:13.968551 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 788/1591] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:13 2022] PUT /identity/v3/projects/0d8ff4576b9d46809257874fbc9dae6c/users/9e7a86972a01482caf212f57ce540321/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:13.969456 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c5048-e0ed-4680-8102-607852e00141 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:14.065488 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c5048-e0ed-4680-8102-607852e00141 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:14.066242 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6389ca-456c-4a06-a1bd-768071a2798c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:14.067012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6389ca-456c-4a06-a1bd-768071a2798c admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:14.067365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6389ca-456c-4a06-a1bd-768071a2798c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:14.067737 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6389ca-456c-4a06-a1bd-768071a2798c admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:14.068600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6389ca-456c-4a06-a1bd-768071a2798c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:14.070307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6389ca-456c-4a06-a1bd-768071a2798c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:14.076554 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94913f31-17a9-4e8c-84f1-00b6bf8f72e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:14.077454 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913f31-17a9-4e8c-84f1-00b6bf8f72e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:14.077851 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913f31-17a9-4e8c-84f1-00b6bf8f72e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:14.078199 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913f31-17a9-4e8c-84f1-00b6bf8f72e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:14.079007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94913f31-17a9-4e8c-84f1-00b6bf8f72e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:14.080780 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94913f31-17a9-4e8c-84f1-00b6bf8f72e7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:14.082242 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 804/1592] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:14.086119 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6389ca-456c-4a06-a1bd-768071a2798c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:14.092809 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 789/1593] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:14.093950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94913f31-17a9-4e8c-84f1-00b6bf8f72e7 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:14.098030 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6389ca-456c-4a06-a1bd-768071a2798c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:14.102875 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fecaf-617b-413d-9df0-27802013fe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:14.103538 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fecaf-617b-413d-9df0-27802013fe5a admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:14.103824 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fecaf-617b-413d-9df0-27802013fe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:14.104119 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fecaf-617b-413d-9df0-27802013fe5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:14.104283 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94913f31-17a9-4e8c-84f1-00b6bf8f72e7 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:14.104849 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fecaf-617b-413d-9df0-27802013fe5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:14.106673 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fecaf-617b-413d-9df0-27802013fe5a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:14.114116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b454514-736a-40da-bf60-ced4b18c24bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:14.115061 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b454514-736a-40da-bf60-ced4b18c24bb admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:14.115478 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b454514-736a-40da-bf60-ced4b18c24bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:14.115897 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b454514-736a-40da-bf60-ced4b18c24bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:14.116963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b454514-736a-40da-bf60-ced4b18c24bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:14.118841 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b454514-736a-40da-bf60-ced4b18c24bb admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:14.119145 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 805/1594] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:14.120573 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fecaf-617b-413d-9df0-27802013fe5a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:14.131156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 790/1595] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:14.131399 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fecaf-617b-413d-9df0-27802013fe5a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:14.131987 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b454514-736a-40da-bf60-ced4b18c24bb admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:14.138450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c14729-bfe9-4d5b-a98c-7b047174257a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:14.139148 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c14729-bfe9-4d5b-a98c-7b047174257a admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:14.139579 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c14729-bfe9-4d5b-a98c-7b047174257a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:14.139761 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c14729-bfe9-4d5b-a98c-7b047174257a admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:14.140509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c14729-bfe9-4d5b-a98c-7b047174257a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:14.142179 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c14729-bfe9-4d5b-a98c-7b047174257a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:14.143852 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b454514-736a-40da-bf60-ced4b18c24bb admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:14.149068 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b87f2-9fcb-46e1-a037-20d7b95d3796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:14.149999 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b87f2-9fcb-46e1-a037-20d7b95d3796 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:14.150286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b87f2-9fcb-46e1-a037-20d7b95d3796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:14.150560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b87f2-9fcb-46e1-a037-20d7b95d3796 admin admin] PATH_INFO: `/v3/projects/89a7299f01984027a505aa43d96e07b3/users/d5684eb0dd3141f5a25b61aafedbe865/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:14.155168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 806/1596] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:14.156836 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c638b27-4b49-41a0-add2-a6dc132b9c60 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:14.157153 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c638b27-4b49-41a0-add2-a6dc132b9c60 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:14.157606 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c638b27-4b49-41a0-add2-a6dc132b9c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:14.170967 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b87f2-9fcb-46e1-a037-20d7b95d3796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a7299f01984027a505aa43d96e07b3, user_id=d5684eb0dd3141f5a25b61aafedbe865, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:14.173697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b87f2-9fcb-46e1-a037-20d7b95d3796 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:14.188293 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6c638b27-4b49-41a0-add2-a6dc132b9c60 None None] MFA Rules not processed for user `9e7a86972a01482caf212f57ce540321`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:14.189548 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6c638b27-4b49-41a0-add2-a6dc132b9c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:14.246528 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:14.266042 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 807/1597] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:14.267094 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c638b27-4b49-41a0-add2-a6dc132b9c60 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:14.280984 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c638b27-4b49-41a0-add2-a6dc132b9c60 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:14.286338 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0218e-ddb0-4353-8c25-3b94fc4a7fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:14.286936 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0218e-ddb0-4353-8c25-3b94fc4a7fff admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:14.287238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0218e-ddb0-4353-8c25-3b94fc4a7fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:14.287486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0218e-ddb0-4353-8c25-3b94fc4a7fff admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:14.288218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0218e-ddb0-4353-8c25-3b94fc4a7fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:14.289972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0218e-ddb0-4353-8c25-3b94fc4a7fff admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:14.301814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 808/1598] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:14.302740 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0218e-ddb0-4353-8c25-3b94fc4a7fff admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:14.313782 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0218e-ddb0-4353-8c25-3b94fc4a7fff admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:14.319714 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8926f-3c17-47ba-8adf-73e7d58b2f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:14.320547 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8926f-3c17-47ba-8adf-73e7d58b2f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:14.320850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8926f-3c17-47ba-8adf-73e7d58b2f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:14.321131 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8926f-3c17-47ba-8adf-73e7d58b2f41 admin admin] PATH_INFO: `/v3/projects/ffac206e9d7949c9a6898d03dcd72ca1/users/d9d618bbbabc4a7e9859c76305c81655/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:14.338050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8926f-3c17-47ba-8adf-73e7d58b2f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffac206e9d7949c9a6898d03dcd72ca1, user_id=d9d618bbbabc4a7e9859c76305c81655, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:14.341590 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8926f-3c17-47ba-8adf-73e7d58b2f41 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:14.377625 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 791/1599] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:14 2022] PUT /identity/v3/projects/89a7299f01984027a505aa43d96e07b3/users/d5684eb0dd3141f5a25b61aafedbe865/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:14.378680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b87f2-9fcb-46e1-a037-20d7b95d3796 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:14.384888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:14.449229 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b87f2-9fcb-46e1-a037-20d7b95d3796 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:14.453952 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c471a-2e6e-4566-907f-5f62a7ae0922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:14.454844 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c471a-2e6e-4566-907f-5f62a7ae0922 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:14.455123 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c471a-2e6e-4566-907f-5f62a7ae0922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:14.455400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c471a-2e6e-4566-907f-5f62a7ae0922 admin admin] PATH_INFO: `/v3/projects/49d16e13fcbb43d48c8aa17eeeb77721/users/ed707c3fb31b4c3fa804651b8bff298e/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:14.471089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c471a-2e6e-4566-907f-5f62a7ae0922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d16e13fcbb43d48c8aa17eeeb77721, user_id=ed707c3fb31b4c3fa804651b8bff298e, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:14.473812 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c471a-2e6e-4566-907f-5f62a7ae0922 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:14.491213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 809/1600] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:14 2022] PUT /identity/v3/projects/ffac206e9d7949c9a6898d03dcd72ca1/users/d9d618bbbabc4a7e9859c76305c81655/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:14.493416 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8926f-3c17-47ba-8adf-73e7d58b2f41 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:14.576903 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8926f-3c17-47ba-8adf-73e7d58b2f41 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:14.581667 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe88ab-87eb-414d-852f-cbadabb9da0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:14.582342 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe88ab-87eb-414d-852f-cbadabb9da0d admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:14.582627 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe88ab-87eb-414d-852f-cbadabb9da0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:14.582938 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe88ab-87eb-414d-852f-cbadabb9da0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:14.583626 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe88ab-87eb-414d-852f-cbadabb9da0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:14.585282 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe88ab-87eb-414d-852f-cbadabb9da0d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:14.605506 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 810/1601] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:14.605506 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe88ab-87eb-414d-852f-cbadabb9da0d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:14.613663 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 792/1602] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:14 2022] PUT /identity/v3/projects/49d16e13fcbb43d48c8aa17eeeb77721/users/ed707c3fb31b4c3fa804651b8bff298e/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:14.614372 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c471a-2e6e-4566-907f-5f62a7ae0922 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:14.616965 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe88ab-87eb-414d-852f-cbadabb9da0d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:14.688785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c471a-2e6e-4566-907f-5f62a7ae0922 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:14.693824 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218d3dd-0952-44fb-bcfc-3b859c7cad6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:14.694389 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26b3ab-714c-4086-9f39-05a8a9942b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:14.694575 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218d3dd-0952-44fb-bcfc-3b859c7cad6e admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:14.694935 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26b3ab-714c-4086-9f39-05a8a9942b11 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:14.695059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218d3dd-0952-44fb-bcfc-3b859c7cad6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:14.695217 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26b3ab-714c-4086-9f39-05a8a9942b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:14.695372 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218d3dd-0952-44fb-bcfc-3b859c7cad6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:14.695484 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26b3ab-714c-4086-9f39-05a8a9942b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:14.696181 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218d3dd-0952-44fb-bcfc-3b859c7cad6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:14.696291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26b3ab-714c-4086-9f39-05a8a9942b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:14.697889 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26b3ab-714c-4086-9f39-05a8a9942b11 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:14.698199 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218d3dd-0952-44fb-bcfc-3b859c7cad6e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:14.713131 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 811/1603] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:14.713131 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26b3ab-714c-4086-9f39-05a8a9942b11 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:14.725684 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26b3ab-714c-4086-9f39-05a8a9942b11 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:14.732359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f10ff-2141-4ede-b710-cd8ca75f9bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:14.733534 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f10ff-2141-4ede-b710-cd8ca75f9bc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:14.733815 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f10ff-2141-4ede-b710-cd8ca75f9bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:14.734246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f10ff-2141-4ede-b710-cd8ca75f9bc9 admin admin] PATH_INFO: `/v3/projects/5a16c7d70bb14cd3b898751084649cd2/users/89f20368c3a747a49a3aaa556115d169/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:14.754063 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f10ff-2141-4ede-b710-cd8ca75f9bc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a16c7d70bb14cd3b898751084649cd2, user_id=89f20368c3a747a49a3aaa556115d169, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:14.756801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f10ff-2141-4ede-b710-cd8ca75f9bc9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:14.844945 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 812/1604] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:14 2022] PUT /identity/v3/projects/5a16c7d70bb14cd3b898751084649cd2/users/89f20368c3a747a49a3aaa556115d169/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:14.845133 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 793/1605] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:53:14 2022] POST /identity/v3/projects => generated 379 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:14.845133 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737fe33-f6e1-4c2e-95ca-e42776fcdc48 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:14.845357 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737fe33-f6e1-4c2e-95ca-e42776fcdc48 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:14.845625 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737fe33-f6e1-4c2e-95ca-e42776fcdc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:14.847326 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f58bb7-3099-44e6-b056-0c540b85aca7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:14.847790 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f58bb7-3099-44e6-b056-0c540b85aca7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:14.848241 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f58bb7-3099-44e6-b056-0c540b85aca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:14.866946 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a737fe33-f6e1-4c2e-95ca-e42776fcdc48 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:14.868173 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a737fe33-f6e1-4c2e-95ca-e42776fcdc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:14.886373 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-23f58bb7-3099-44e6-b056-0c540b85aca7 None None] MFA Rules not processed for user `d9d618bbbabc4a7e9859c76305c81655`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:14.887700 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-23f58bb7-3099-44e6-b056-0c540b85aca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:14.902759 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:14.941068 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 794/1606] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:14.941949 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737fe33-f6e1-4c2e-95ca-e42776fcdc48 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:14.953609 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737fe33-f6e1-4c2e-95ca-e42776fcdc48 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:14.958760 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef956877-4108-4962-a2fc-b8e317518144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:14.959792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef956877-4108-4962-a2fc-b8e317518144 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:14.960077 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef956877-4108-4962-a2fc-b8e317518144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:14.960346 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef956877-4108-4962-a2fc-b8e317518144 admin admin] PATH_INFO: `/v3/projects/5150e5b054d34d09a3cb69e35f9c86dd/users/1cf5ba73296e41c4ab58a6a962b578d3/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:14.965046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 813/1607] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:14.965552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90ed07-4ba7-4660-9375-a39bac4197f8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:14.965845 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90ed07-4ba7-4660-9375-a39bac4197f8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:14.966123 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90ed07-4ba7-4660-9375-a39bac4197f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:14.972162 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:14.979284 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef956877-4108-4962-a2fc-b8e317518144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5150e5b054d34d09a3cb69e35f9c86dd, user_id=1cf5ba73296e41c4ab58a6a962b578d3, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:14.982901 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef956877-4108-4962-a2fc-b8e317518144 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:14.994532 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-aa90ed07-4ba7-4660-9375-a39bac4197f8 None None] MFA Rules not processed for user `ed707c3fb31b4c3fa804651b8bff298e`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:14.995834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-aa90ed07-4ba7-4660-9375-a39bac4197f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:15.070040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 795/1608] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:14 2022] PUT /identity/v3/projects/5150e5b054d34d09a3cb69e35f9c86dd/users/1cf5ba73296e41c4ab58a6a962b578d3/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:15.071680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef956877-4108-4962-a2fc-b8e317518144 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:15.075289 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 814/1609] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:14 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:15.076928 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba7894-ea35-4541-8fa5-dac0f2fbf97b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:15.077409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba7894-ea35-4541-8fa5-dac0f2fbf97b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:15.077840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba7894-ea35-4541-8fa5-dac0f2fbf97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:15.098536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f7ba7894-ea35-4541-8fa5-dac0f2fbf97b None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:15.100160 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f7ba7894-ea35-4541-8fa5-dac0f2fbf97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:15.153966 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef956877-4108-4962-a2fc-b8e317518144 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:15.161236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b0609-e699-4422-ba5a-86a01e937c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:15.166542 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b0609-e699-4422-ba5a-86a01e937c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:15.166542 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b0609-e699-4422-ba5a-86a01e937c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:15.166542 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b0609-e699-4422-ba5a-86a01e937c66 admin admin] PATH_INFO: `/v3/projects/844b7e02c0cd44ffa3716cd2380cca25/users/50b0c2f106e443d882ce8b13ebf6f50b/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:15.179759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b0609-e699-4422-ba5a-86a01e937c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=844b7e02c0cd44ffa3716cd2380cca25, user_id=50b0c2f106e443d882ce8b13ebf6f50b, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:15.183158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b0609-e699-4422-ba5a-86a01e937c66 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:15.188398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 815/1610] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:15.189273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba7894-ea35-4541-8fa5-dac0f2fbf97b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:15.200492 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba7894-ea35-4541-8fa5-dac0f2fbf97b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:15.205243 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c8132-8d14-445a-92a3-44cda3c49651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:15.205950 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c8132-8d14-445a-92a3-44cda3c49651 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:15.206232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c8132-8d14-445a-92a3-44cda3c49651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:15.206510 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c8132-8d14-445a-92a3-44cda3c49651 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:15.207234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c8132-8d14-445a-92a3-44cda3c49651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:15.209162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c8132-8d14-445a-92a3-44cda3c49651 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:15.263098 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 796/1611] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:15 2022] PUT /identity/v3/projects/844b7e02c0cd44ffa3716cd2380cca25/users/50b0c2f106e443d882ce8b13ebf6f50b/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:15.263957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b0609-e699-4422-ba5a-86a01e937c66 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:15.265694 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ba8b0609-e699-4422-ba5a-86a01e937c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:15.318825 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 816/1612] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:53:15 2022] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:15.319769 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c8132-8d14-445a-92a3-44cda3c49651 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:15.327986 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b0609-e699-4422-ba5a-86a01e937c66 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:15.330566 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c8132-8d14-445a-92a3-44cda3c49651 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:15.331693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842d296-741b-4088-b65f-00a085d9de5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:15.332347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842d296-741b-4088-b65f-00a085d9de5e service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:15.332680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842d296-741b-4088-b65f-00a085d9de5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:15.332964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842d296-741b-4088-b65f-00a085d9de5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:15.356956 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:15.390834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9a6b4-54dc-44e3-a4be-8b74a50e1ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:15.391530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9a6b4-54dc-44e3-a4be-8b74a50e1ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:15.391807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9a6b4-54dc-44e3-a4be-8b74a50e1ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:15.392077 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9a6b4-54dc-44e3-a4be-8b74a50e1ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:15.392787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9a6b4-54dc-44e3-a4be-8b74a50e1ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:15.394797 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9a6b4-54dc-44e3-a4be-8b74a50e1ce5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:15.397588 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842d296-741b-4088-b65f-00a085d9de5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:15.399050 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842d296-741b-4088-b65f-00a085d9de5e service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:15.413616 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 797/1613] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:15.415180 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd741bd5-30a4-4eca-ac5e-0403ab88c4ec None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:15.415493 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd741bd5-30a4-4eca-ac5e-0403ab88c4ec None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:15.415949 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd741bd5-30a4-4eca-ac5e-0403ab88c4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:15.435740 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bd741bd5-30a4-4eca-ac5e-0403ab88c4ec None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:15.436968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bd741bd5-30a4-4eca-ac5e-0403ab88c4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:15.445935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 798/1614] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:15.446832 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd741bd5-30a4-4eca-ac5e-0403ab88c4ec None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:15.457878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd741bd5-30a4-4eca-ac5e-0403ab88c4ec None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:15.462677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e38119-f2f8-4c70-8a6f-313ece14a3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:15.463364 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e38119-f2f8-4c70-8a6f-313ece14a3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:15.463648 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e38119-f2f8-4c70-8a6f-313ece14a3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:15.464038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e38119-f2f8-4c70-8a6f-313ece14a3d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:15.464809 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e38119-f2f8-4c70-8a6f-313ece14a3d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:15.466768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e38119-f2f8-4c70-8a6f-313ece14a3d2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:15.477325 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:15.498657 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 817/1615] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:53:15 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:15.499172 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef17193-8592-494e-85b8-03c2bef4a827 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:15.499457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef17193-8592-494e-85b8-03c2bef4a827 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:15.499732 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef17193-8592-494e-85b8-03c2bef4a827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:15.530961 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8ef17193-8592-494e-85b8-03c2bef4a827 None None] MFA Rules not processed for user `e17514d68a274a0dbe606bb8db60c747`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:15.532219 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8ef17193-8592-494e-85b8-03c2bef4a827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:15.611011 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 799/1616] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:53:15 2022] POST /identity/v3/projects => generated 357 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:15.611011 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e38119-f2f8-4c70-8a6f-313ece14a3d2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:15.622442 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 818/1617] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:15.630917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72010d-822e-4994-84c3-196c7f27e23f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:15.632898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72010d-822e-4994-84c3-196c7f27e23f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:15.632898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72010d-822e-4994-84c3-196c7f27e23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:15.670296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2c72010d-822e-4994-84c3-196c7f27e23f None None] MFA Rules not processed for user `50b0c2f106e443d882ce8b13ebf6f50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:15.672097 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2c72010d-822e-4994-84c3-196c7f27e23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:15.692872 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e38119-f2f8-4c70-8a6f-313ece14a3d2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:15.696703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f28638-4bb6-4e4e-a681-99a4a7be6e40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:15.697399 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f28638-4bb6-4e4e-a681-99a4a7be6e40 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:15.701424 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f28638-4bb6-4e4e-a681-99a4a7be6e40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:15.701424 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f28638-4bb6-4e4e-a681-99a4a7be6e40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:15.760134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 819/1618] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:15.761216 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72010d-822e-4994-84c3-196c7f27e23f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:15.810099 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:15.851600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72010d-822e-4994-84c3-196c7f27e23f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:15.861122 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46434c-a4a4-400c-b962-53857c8d91a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:15.862502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46434c-a4a4-400c-b962-53857c8d91a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:15.863177 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46434c-a4a4-400c-b962-53857c8d91a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:15.863466 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46434c-a4a4-400c-b962-53857c8d91a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:15.864222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46434c-a4a4-400c-b962-53857c8d91a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:15.867275 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46434c-a4a4-400c-b962-53857c8d91a5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:15.880575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 820/1619] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:15.881470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46434c-a4a4-400c-b962-53857c8d91a5 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:15.892546 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46434c-a4a4-400c-b962-53857c8d91a5 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:15.896815 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36ae60-4b8e-486a-b0ba-e983e6c4527c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:15.898073 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36ae60-4b8e-486a-b0ba-e983e6c4527c service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:15.898369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36ae60-4b8e-486a-b0ba-e983e6c4527c service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:15.898653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36ae60-4b8e-486a-b0ba-e983e6c4527c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:15.909686 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36ae60-4b8e-486a-b0ba-e983e6c4527c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:15.911471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36ae60-4b8e-486a-b0ba-e983e6c4527c service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:15.929144 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f28638-4bb6-4e4e-a681-99a4a7be6e40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:15.931492 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f28638-4bb6-4e4e-a681-99a4a7be6e40 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:15.936717 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 821/1620] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:15.939586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36ae60-4b8e-486a-b0ba-e983e6c4527c service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:15.947198 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 800/1621] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:15.952572 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f28638-4bb6-4e4e-a681-99a4a7be6e40 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:15.952779 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36ae60-4b8e-486a-b0ba-e983e6c4527c service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:15.958270 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df0780-56e4-4901-ad05-3a6df047b700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:15.958460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df0780-56e4-4901-ad05-3a6df047b700 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:15.958829 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df0780-56e4-4901-ad05-3a6df047b700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:15.959108 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df0780-56e4-4901-ad05-3a6df047b700 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:15.959709 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df0780-56e4-4901-ad05-3a6df047b700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:15.961292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f28638-4bb6-4e4e-a681-99a4a7be6e40 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:15.961789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df0780-56e4-4901-ad05-3a6df047b700 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:15.966802 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406292a-bf2b-448a-9670-6110f1c70afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:15.967602 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406292a-bf2b-448a-9670-6110f1c70afe admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:15.967912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406292a-bf2b-448a-9670-6110f1c70afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:15.968247 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406292a-bf2b-448a-9670-6110f1c70afe admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:15.969473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406292a-bf2b-448a-9670-6110f1c70afe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:15.971520 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406292a-bf2b-448a-9670-6110f1c70afe admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:16.074546 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 822/1622] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:53:15 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:16.076225 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f08492-c81d-46fe-8d80-48ccbac5d937 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:16.076517 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f08492-c81d-46fe-8d80-48ccbac5d937 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:16.076798 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f08492-c81d-46fe-8d80-48ccbac5d937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:16.081063 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 801/1623] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:53:15 2022] POST /identity/v3/users => generated 285 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:16.081063 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de35fa-fe67-4788-98ca-2487a8d5dc26 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:16.081063 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de35fa-fe67-4788-98ca-2487a8d5dc26 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:16.081421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de35fa-fe67-4788-98ca-2487a8d5dc26 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:16.083023 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 802/1624] 10.222.0.48 () {54 vars in 961 bytes} [Thu May 26 16:53:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:53:16.083727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de35fa-fe67-4788-98ca-2487a8d5dc26 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:16.099043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de35fa-fe67-4788-98ca-2487a8d5dc26 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:16.106191 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-92f08492-c81d-46fe-8d80-48ccbac5d937 None None] MFA Rules not processed for user `e17514d68a274a0dbe606bb8db60c747`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:16.107579 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-92f08492-c81d-46fe-8d80-48ccbac5d937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:16.111057 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516b171-0004-4ca6-9ab5-87e83dd07edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:16.114358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516b171-0004-4ca6-9ab5-87e83dd07edf admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:16.115524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516b171-0004-4ca6-9ab5-87e83dd07edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:16.116373 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516b171-0004-4ca6-9ab5-87e83dd07edf admin admin] PATH_INFO: `/v3/projects/f39da86efcef466c86f8906d35fc4a4a/users/7404d3b06fd44bf8b3d81b69d474fc2f/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:16.140474 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516b171-0004-4ca6-9ab5-87e83dd07edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f39da86efcef466c86f8906d35fc4a4a, user_id=7404d3b06fd44bf8b3d81b69d474fc2f, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:16.144096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516b171-0004-4ca6-9ab5-87e83dd07edf admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:16.180882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 823/1625] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:16.181809 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f08492-c81d-46fe-8d80-48ccbac5d937 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:16.198122 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f08492-c81d-46fe-8d80-48ccbac5d937 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:16.206420 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f990c2-a487-4b4e-8158-bf5b3dda184c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:16.207125 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f990c2-a487-4b4e-8158-bf5b3dda184c admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:16.207411 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f990c2-a487-4b4e-8158-bf5b3dda184c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:16.207691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f990c2-a487-4b4e-8158-bf5b3dda184c admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:16.208434 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f990c2-a487-4b4e-8158-bf5b3dda184c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:16.210149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f990c2-a487-4b4e-8158-bf5b3dda184c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:16.232542 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 803/1626] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:16 2022] PUT /identity/v3/projects/f39da86efcef466c86f8906d35fc4a4a/users/7404d3b06fd44bf8b3d81b69d474fc2f/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:16.234366 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516b171-0004-4ca6-9ab5-87e83dd07edf admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:16.246612 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 824/1627] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:16.248304 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4152c-ddcd-4cee-bd19-dfc331139a6e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:16.248598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4152c-ddcd-4cee-bd19-dfc331139a6e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:16.248878 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4152c-ddcd-4cee-bd19-dfc331139a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:16.278490 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3ce4152c-ddcd-4cee-bd19-dfc331139a6e None None] MFA Rules not processed for user `35c9fa9c29494ff9b1f749974dca2719`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:16.280848 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3ce4152c-ddcd-4cee-bd19-dfc331139a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:16.348469 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516b171-0004-4ca6-9ab5-87e83dd07edf admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:16.355262 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d80f0-f050-4db4-ad8d-918ed62aace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:16.356700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d80f0-f050-4db4-ad8d-918ed62aace8 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:16.357145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d80f0-f050-4db4-ad8d-918ed62aace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:16.358183 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d80f0-f050-4db4-ad8d-918ed62aace8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:16.359445 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d80f0-f050-4db4-ad8d-918ed62aace8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:16.362295 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d80f0-f050-4db4-ad8d-918ed62aace8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:16.364456 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:16.382933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 804/1628] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:16.382933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb2535-2fc4-4843-a8fb-dcf1de6f4021 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:16.382933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb2535-2fc4-4843-a8fb-dcf1de6f4021 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:16.383422 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb2535-2fc4-4843-a8fb-dcf1de6f4021 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:16.386077 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 805/1629] 10.222.0.48 () {54 vars in 961 bytes} [Thu May 26 16:53:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:53:16.386936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb2535-2fc4-4843-a8fb-dcf1de6f4021 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:16.390728 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 825/1630] 10.222.0.48 () {58 vars in 1058 bytes} [Thu May 26 16:53:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:16.391917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4152c-ddcd-4cee-bd19-dfc331139a6e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:16.404451 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4152c-ddcd-4cee-bd19-dfc331139a6e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:16.415191 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb2535-2fc4-4843-a8fb-dcf1de6f4021 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:16.415745 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d99cda-14d5-4912-9763-684f183c3454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:16.415856 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821aeba-7be2-412c-bc04-8cf149edb1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:16.415990 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d99cda-14d5-4912-9763-684f183c3454 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:16.415990 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d99cda-14d5-4912-9763-684f183c3454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:16.415990 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d99cda-14d5-4912-9763-684f183c3454 admin admin] PATH_INFO: `/v3/projects/62d18121afb64437ac739e33a59d093a/users/d58a02d81e9044109056aa646576b32b/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:16.416248 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821aeba-7be2-412c-bc04-8cf149edb1bd admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:16.416248 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821aeba-7be2-412c-bc04-8cf149edb1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:16.416248 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821aeba-7be2-412c-bc04-8cf149edb1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:16.416248 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821aeba-7be2-412c-bc04-8cf149edb1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:16.416627 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821aeba-7be2-412c-bc04-8cf149edb1bd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:16.429035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d99cda-14d5-4912-9763-684f183c3454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d18121afb64437ac739e33a59d093a, user_id=d58a02d81e9044109056aa646576b32b, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:16.430003 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 806/1631] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:16.430965 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821aeba-7be2-412c-bc04-8cf149edb1bd admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:16.432855 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d99cda-14d5-4912-9763-684f183c3454 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:16.442263 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821aeba-7be2-412c-bc04-8cf149edb1bd admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:16.447052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db665b-4bbf-421c-bb5a-1ddf786685cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:16.452191 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db665b-4bbf-421c-bb5a-1ddf786685cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:16.452191 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db665b-4bbf-421c-bb5a-1ddf786685cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:16.452191 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db665b-4bbf-421c-bb5a-1ddf786685cf admin admin] PATH_INFO: `/v3/projects/a3edce6120704c86b3b15e2015691ded/users/0bbf65c082b340fa8c73871f2134b4a2/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:16.464609 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db665b-4bbf-421c-bb5a-1ddf786685cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3edce6120704c86b3b15e2015691ded, user_id=0bbf65c082b340fa8c73871f2134b4a2, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:16.467459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db665b-4bbf-421c-bb5a-1ddf786685cf admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:16.537601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:16.543182 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 826/1632] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:16 2022] PUT /identity/v3/projects/62d18121afb64437ac739e33a59d093a/users/d58a02d81e9044109056aa646576b32b/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:16.547050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d99cda-14d5-4912-9763-684f183c3454 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:16.579795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 807/1633] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:16 2022] PUT /identity/v3/projects/a3edce6120704c86b3b15e2015691ded/users/0bbf65c082b340fa8c73871f2134b4a2/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:16.583115 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d8343-3167-4259-b098-270346416299 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:16.583115 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d8343-3167-4259-b098-270346416299 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:16.583115 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d8343-3167-4259-b098-270346416299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:16.606942 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-247d8343-3167-4259-b098-270346416299 None None] MFA Rules not processed for user `35c9fa9c29494ff9b1f749974dca2719`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:16.611028 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-247d8343-3167-4259-b098-270346416299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:16.855008 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d99cda-14d5-4912-9763-684f183c3454 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:16.856163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 808/1634] 10.222.0.48 () {58 vars in 1058 bytes} [Thu May 26 16:53:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:16.856163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d8343-3167-4259-b098-270346416299 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:16.857244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bee87-2598-472f-a749-94e619a6106b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:16.857244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bee87-2598-472f-a749-94e619a6106b service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:16.857244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bee87-2598-472f-a749-94e619a6106b service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:16.857244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bee87-2598-472f-a749-94e619a6106b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:16.882187 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d8343-3167-4259-b098-270346416299 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:16.882187 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4896855-710b-4ff6-86a1-544fa86c8ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:16.882187 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4896855-710b-4ff6-86a1-544fa86c8ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:16.882187 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4896855-710b-4ff6-86a1-544fa86c8ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:16.883889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4896855-710b-4ff6-86a1-544fa86c8ecb admin admin] PATH_INFO: `/v3/projects/f39da86efcef466c86f8906d35fc4a4a/users/7404d3b06fd44bf8b3d81b69d474fc2f/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:16.883889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4896855-710b-4ff6-86a1-544fa86c8ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f39da86efcef466c86f8906d35fc4a4a, user_id=7404d3b06fd44bf8b3d81b69d474fc2f, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:16.883889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4896855-710b-4ff6-86a1-544fa86c8ecb admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:16.883889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 809/1635] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:16 2022] PUT /identity/v3/projects/f39da86efcef466c86f8906d35fc4a4a/users/7404d3b06fd44bf8b3d81b69d474fc2f/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:16.883889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4896855-710b-4ff6-86a1-544fa86c8ecb admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:16.884615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bee87-2598-472f-a749-94e619a6106b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:16.884615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bee87-2598-472f-a749-94e619a6106b service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:16.884615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 827/1636] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:16.884615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bee87-2598-472f-a749-94e619a6106b service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:16.884615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bee87-2598-472f-a749-94e619a6106b service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:16.909106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6845e-ce5c-48d3-b30f-ab7b53bba7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:16.910630 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6845e-ce5c-48d3-b30f-ab7b53bba7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:16.910630 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6845e-ce5c-48d3-b30f-ab7b53bba7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:16.910974 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6845e-ce5c-48d3-b30f-ab7b53bba7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:16.911707 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6845e-ce5c-48d3-b30f-ab7b53bba7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:16.913764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6845e-ce5c-48d3-b30f-ab7b53bba7c0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:16.930699 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 828/1637] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:16.930699 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6845e-ce5c-48d3-b30f-ab7b53bba7c0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:16.942676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4896855-710b-4ff6-86a1-544fa86c8ecb admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:16.949912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b9720-0746-4102-b961-657ccf2a1e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:16.950904 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b9720-0746-4102-b961-657ccf2a1e92 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:16.951327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b9720-0746-4102-b961-657ccf2a1e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:16.951902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b9720-0746-4102-b961-657ccf2a1e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:16.953670 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b9720-0746-4102-b961-657ccf2a1e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:16.955905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b9720-0746-4102-b961-657ccf2a1e92 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:16.972120 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 810/1638] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:16.975103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e2c6b-b3dc-4d0e-9713-a7a1843ff1f6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:16.975681 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e2c6b-b3dc-4d0e-9713-a7a1843ff1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:16.976266 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e2c6b-b3dc-4d0e-9713-a7a1843ff1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:17.031201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ee7e2c6b-b3dc-4d0e-9713-a7a1843ff1f6 None None] MFA Rules not processed for user `7404d3b06fd44bf8b3d81b69d474fc2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:17.033704 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ee7e2c6b-b3dc-4d0e-9713-a7a1843ff1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:17.053506 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6845e-ce5c-48d3-b30f-ab7b53bba7c0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:17.060316 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae7b92-c1ba-4171-b8fd-ca481435732e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:17.061136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae7b92-c1ba-4171-b8fd-ca481435732e service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:17.061457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae7b92-c1ba-4171-b8fd-ca481435732e service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:17.061890 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae7b92-c1ba-4171-b8fd-ca481435732e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:17.145782 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae7b92-c1ba-4171-b8fd-ca481435732e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:17.148015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae7b92-c1ba-4171-b8fd-ca481435732e service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:17.172171 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 811/1639] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:17.178984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e2c6b-b3dc-4d0e-9713-a7a1843ff1f6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:17.180354 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 829/1640] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:17.180354 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae7b92-c1ba-4171-b8fd-ca481435732e service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:17.186639 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae7b92-c1ba-4171-b8fd-ca481435732e service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:17.192644 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be294001-4916-4f5e-b8cb-3ad2d37d8ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:17.193579 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be294001-4916-4f5e-b8cb-3ad2d37d8ebe admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:17.193865 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be294001-4916-4f5e-b8cb-3ad2d37d8ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:17.194175 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be294001-4916-4f5e-b8cb-3ad2d37d8ebe admin admin] PATH_INFO: `/v3/projects/62d18121afb64437ac739e33a59d093a/users/d58a02d81e9044109056aa646576b32b/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:17.202340 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be294001-4916-4f5e-b8cb-3ad2d37d8ebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d18121afb64437ac739e33a59d093a, user_id=d58a02d81e9044109056aa646576b32b, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:17.224021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e2c6b-b3dc-4d0e-9713-a7a1843ff1f6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:17.229673 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be294001-4916-4f5e-b8cb-3ad2d37d8ebe admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:17.231056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3f60e-c7a9-41ec-861f-8130f65fbd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:17.232158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3f60e-c7a9-41ec-861f-8130f65fbd89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:17.232533 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3f60e-c7a9-41ec-861f-8130f65fbd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:17.233038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3f60e-c7a9-41ec-861f-8130f65fbd89 admin admin] PATH_INFO: `/v3/projects/a3edce6120704c86b3b15e2015691ded/users/0bbf65c082b340fa8c73871f2134b4a2/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:17.236497 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3f60e-c7a9-41ec-861f-8130f65fbd89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3edce6120704c86b3b15e2015691ded, user_id=0bbf65c082b340fa8c73871f2134b4a2, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:17.247253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 830/1641] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:17 2022] PUT /identity/v3/projects/62d18121afb64437ac739e33a59d093a/users/d58a02d81e9044109056aa646576b32b/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:17.257913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3f60e-c7a9-41ec-861f-8130f65fbd89 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:17.258069 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be294001-4916-4f5e-b8cb-3ad2d37d8ebe admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:17.271119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 812/1642] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:17 2022] PUT /identity/v3/projects/a3edce6120704c86b3b15e2015691ded/users/0bbf65c082b340fa8c73871f2134b4a2/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:17.273539 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c72dc7-69d2-4244-aa71-5024d9fe1b35 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:17.274019 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c72dc7-69d2-4244-aa71-5024d9fe1b35 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:17.274474 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c72dc7-69d2-4244-aa71-5024d9fe1b35 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:17.282445 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 813/1643] 10.222.0.48 () {54 vars in 912 bytes} [Thu May 26 16:53:17 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:53:17.284494 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd91501-46e9-4614-9ba1-506d47eecb73 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:17.284978 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd91501-46e9-4614-9ba1-506d47eecb73 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:17.285481 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd91501-46e9-4614-9ba1-506d47eecb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:17.349214 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be294001-4916-4f5e-b8cb-3ad2d37d8ebe admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:17.352737 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-edd91501-46e9-4614-9ba1-506d47eecb73 None None] MFA Rules not processed for user `d58a02d81e9044109056aa646576b32b`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:17.357216 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-edd91501-46e9-4614-9ba1-506d47eecb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:17.506867 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4733bb-62bb-447b-b7bb-b389150276e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:17.511699 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4733bb-62bb-447b-b7bb-b389150276e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:17.513770 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4733bb-62bb-447b-b7bb-b389150276e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:17.514206 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4733bb-62bb-447b-b7bb-b389150276e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:17.546928 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 814/1644] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:17 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:17.550936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdff82-4b9b-4d5e-9119-bfcb9fbf3380 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:17.551387 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdff82-4b9b-4d5e-9119-bfcb9fbf3380 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:17.556239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdff82-4b9b-4d5e-9119-bfcb9fbf3380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:17.580311 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1fcdff82-4b9b-4d5e-9119-bfcb9fbf3380 None None] MFA Rules not processed for user `35c9fa9c29494ff9b1f749974dca2719`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:17.581607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1fcdff82-4b9b-4d5e-9119-bfcb9fbf3380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:17.666031 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4733bb-62bb-447b-b7bb-b389150276e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:17.668077 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4733bb-62bb-447b-b7bb-b389150276e0 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:17.679086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 815/1645] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 16:53:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:17.680611 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b45372-c296-400d-91c1-bd93a11432ca None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:17.680897 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b45372-c296-400d-91c1-bd93a11432ca None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:17.682244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b45372-c296-400d-91c1-bd93a11432ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:17.692278 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 831/1646] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:17.693941 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe6a28-7459-4a60-a6a4-de096012a290 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:17.694762 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe6a28-7459-4a60-a6a4-de096012a290 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:17.694762 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe6a28-7459-4a60-a6a4-de096012a290 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:17.696187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 832/1647] 10.222.0.48 () {54 vars in 912 bytes} [Thu May 26 16:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:53:17.696944 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe6a28-7459-4a60-a6a4-de096012a290 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:17.708518 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe6a28-7459-4a60-a6a4-de096012a290 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:17.712482 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84519212-a7a9-4b70-bc0a-e73d9ddab1f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:17.713810 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84519212-a7a9-4b70-bc0a-e73d9ddab1f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:17.714030 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84519212-a7a9-4b70-bc0a-e73d9ddab1f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:17.714309 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84519212-a7a9-4b70-bc0a-e73d9ddab1f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:17.720534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-50b45372-c296-400d-91c1-bd93a11432ca None None] MFA Rules not processed for user `0bbf65c082b340fa8c73871f2134b4a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:17.722090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-50b45372-c296-400d-91c1-bd93a11432ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:17.731341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84519212-a7a9-4b70-bc0a-e73d9ddab1f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:17.733135 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84519212-a7a9-4b70-bc0a-e73d9ddab1f2 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:17.747182 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 833/1648] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:17 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:17.748897 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdddf3-f70d-4768-8d95-d8e247af711b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:17.749432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdddf3-f70d-4768-8d95-d8e247af711b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:17.749709 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdddf3-f70d-4768-8d95-d8e247af711b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:17.781518 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-39bdddf3-f70d-4768-8d95-d8e247af711b None None] MFA Rules not processed for user `35c9fa9c29494ff9b1f749974dca2719`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:17.783449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-39bdddf3-f70d-4768-8d95-d8e247af711b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:17.787992 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:17.810608 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 834/1649] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 16:53:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:17.817827 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdddf3-f70d-4768-8d95-d8e247af711b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:17.820775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-39bdddf3-f70d-4768-8d95-d8e247af711b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:17.829582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 816/1650] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:17 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:17.872046 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b45372-c296-400d-91c1-bd93a11432ca None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:17.882321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b45372-c296-400d-91c1-bd93a11432ca None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:17.887180 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4d14c-ddc4-4355-b436-159135120764 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:17.887855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4d14c-ddc4-4355-b436-159135120764 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:17.888139 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4d14c-ddc4-4355-b436-159135120764 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:17.888413 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4d14c-ddc4-4355-b436-159135120764 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:17.902136 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4d14c-ddc4-4355-b436-159135120764 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:17.903931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4d14c-ddc4-4355-b436-159135120764 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:17.917433 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 817/1651] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:53:17.929327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdddf3-f70d-4768-8d95-d8e247af711b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:17.933579 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ee22a-336f-429d-9c1d-02d124f2d78b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7701907eb3b24c3681352c91ad6a3aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:17.934251 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ee22a-336f-429d-9c1d-02d124f2d78b service glance] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:17.934534 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ee22a-336f-429d-9c1d-02d124f2d78b service glance] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:17.934957 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ee22a-336f-429d-9c1d-02d124f2d78b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:17.974785 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ee22a-336f-429d-9c1d-02d124f2d78b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:17.977650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ee22a-336f-429d-9c1d-02d124f2d78b service glance] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:17.980490 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4d14c-ddc4-4355-b436-159135120764 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:17.991193 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4d14c-ddc4-4355-b436-159135120764 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:18.002928 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c029917-2c70-4352-99a5-d5ca8df6d42e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:18.004049 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c029917-2c70-4352-99a5-d5ca8df6d42e service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:18.006707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c029917-2c70-4352-99a5-d5ca8df6d42e service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:18.007238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c029917-2c70-4352-99a5-d5ca8df6d42e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:18.041207 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 835/1652] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:53:18.047109 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c029917-2c70-4352-99a5-d5ca8df6d42e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:18.052965 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c029917-2c70-4352-99a5-d5ca8df6d42e service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:18.091247 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 818/1653] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:17 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:53:18.130369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:18.529364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ee22a-336f-429d-9c1d-02d124f2d78b service glance] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:18.541597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ee22a-336f-429d-9c1d-02d124f2d78b service glance] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:18.548029 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a0da6-42eb-47e8-a334-c43112996806 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:18.548704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a0da6-42eb-47e8-a334-c43112996806 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:18.549048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a0da6-42eb-47e8-a334-c43112996806 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:18.549360 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a0da6-42eb-47e8-a334-c43112996806 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:18.566856 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd955c-021f-4bc5-be0b-7ce948475685 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:18.566856 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd955c-021f-4bc5-be0b-7ce948475685 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:18.567423 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd955c-021f-4bc5-be0b-7ce948475685 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:18.569009 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 819/1654] 10.222.0.48 () {54 vars in 912 bytes} [Thu May 26 16:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:53:18.574961 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891c2b1-62e9-4f2c-a4ad-6cc4e364871d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:18.575238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891c2b1-62e9-4f2c-a4ad-6cc4e364871d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:18.575511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891c2b1-62e9-4f2c-a4ad-6cc4e364871d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:18.638337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9891c2b1-62e9-4f2c-a4ad-6cc4e364871d None None] MFA Rules not processed for user `d577b5295f9e4a4388bb6293d1c33d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:18.640763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a0da6-42eb-47e8-a334-c43112996806 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:18.642022 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9891c2b1-62e9-4f2c-a4ad-6cc4e364871d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:18.642662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a0da6-42eb-47e8-a334-c43112996806 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:18.658299 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 836/1655] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:18.705892 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a0da6-42eb-47e8-a334-c43112996806 service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:18.759544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:18.817791 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 820/1656] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 16:53:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:18.874103 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a0da6-42eb-47e8-a334-c43112996806 service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:18.881102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42895a2-39d4-4f5b-a2b8-492c28edbd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:18.881945 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42895a2-39d4-4f5b-a2b8-492c28edbd7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:18.882240 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42895a2-39d4-4f5b-a2b8-492c28edbd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:18.882522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42895a2-39d4-4f5b-a2b8-492c28edbd7d admin admin] PATH_INFO: `/v3/users/50b0c2f106e443d882ce8b13ebf6f50b` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:18.884047 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42895a2-39d4-4f5b-a2b8-492c28edbd7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=50b0c2f106e443d882ce8b13ebf6f50b)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:18.886351 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42895a2-39d4-4f5b-a2b8-492c28edbd7d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:18.896329 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891c2b1-62e9-4f2c-a4ad-6cc4e364871d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:18.913767 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891c2b1-62e9-4f2c-a4ad-6cc4e364871d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:18.919328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ce7e6-a5cd-4591-ab9b-d381c4ba9ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:18.920107 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ce7e6-a5cd-4591-ab9b-d381c4ba9ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:18.920497 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ce7e6-a5cd-4591-ab9b-d381c4ba9ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:18.920898 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ce7e6-a5cd-4591-ab9b-d381c4ba9ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:18.933581 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ce7e6-a5cd-4591-ab9b-d381c4ba9ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:18.935258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ce7e6-a5cd-4591-ab9b-d381c4ba9ed0 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:18.950484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 821/1657] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:53:18.951518 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ce7e6-a5cd-4591-ab9b-d381c4ba9ed0 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:18.964432 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ce7e6-a5cd-4591-ab9b-d381c4ba9ed0 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:18.969986 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143dbd18-26ca-4db1-abc2-b298109706f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:18.970873 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dbd18-26ca-4db1-abc2-b298109706f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:18.971262 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dbd18-26ca-4db1-abc2-b298109706f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:18.971644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dbd18-26ca-4db1-abc2-b298109706f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:19.112083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143dbd18-26ca-4db1-abc2-b298109706f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:19.113852 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143dbd18-26ca-4db1-abc2-b298109706f8 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:19.127195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 822/1658] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:18 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:19.172064 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c42895a2-39d4-4f5b-a2b8-492c28edbd7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50b0c2f106e443d882ce8b13ebf6f50b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:19.173438 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c42895a2-39d4-4f5b-a2b8-492c28edbd7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50b0c2f106e443d882ce8b13ebf6f50b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:19.189569 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c42895a2-39d4-4f5b-a2b8-492c28edbd7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50b0c2f106e443d882ce8b13ebf6f50b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:19.296246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c42895a2-39d4-4f5b-a2b8-492c28edbd7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50b0c2f106e443d882ce8b13ebf6f50b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:19.297141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c42895a2-39d4-4f5b-a2b8-492c28edbd7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50b0c2f106e443d882ce8b13ebf6f50b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:19.323582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:19.342002 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 837/1659] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:53:18 2022] DELETE /identity/v3/users/50b0c2f106e443d882ce8b13ebf6f50b => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:53:19.345384 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de0994-afa0-43ff-8403-9921c56ba68e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:19.345894 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de0994-afa0-43ff-8403-9921c56ba68e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:19.347064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de0994-afa0-43ff-8403-9921c56ba68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:19.378001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f6de0994-afa0-43ff-8403-9921c56ba68e None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:19.380357 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f6de0994-afa0-43ff-8403-9921c56ba68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:19.508728 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 823/1660] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:19.551766 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42895a2-39d4-4f5b-a2b8-492c28edbd7d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:19.555852 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c42895a2-39d4-4f5b-a2b8-492c28edbd7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:19.707002 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42895a2-39d4-4f5b-a2b8-492c28edbd7d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:19.714359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6c9dc-1521-4623-9158-342e3270436d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:19.718454 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6c9dc-1521-4623-9158-342e3270436d service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:19.718454 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6c9dc-1521-4623-9158-342e3270436d service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:19.718454 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6c9dc-1521-4623-9158-342e3270436d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:19.734449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6c9dc-1521-4623-9158-342e3270436d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:19.737056 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6c9dc-1521-4623-9158-342e3270436d service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:19.755424 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 838/1661] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:20.272831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:20.598158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2cb7a-5911-4d18-a31e-62f131bc8031 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:20.598623 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2cb7a-5911-4d18-a31e-62f131bc8031 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:20.598729 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2cb7a-5911-4d18-a31e-62f131bc8031 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:20.612238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 824/1662] 10.222.0.48 () {54 vars in 960 bytes} [Thu May 26 16:53:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:53:20.612397 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b6021-cc3e-4c0f-9022-80e94499926d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:20.612397 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b6021-cc3e-4c0f-9022-80e94499926d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:20.612397 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b6021-cc3e-4c0f-9022-80e94499926d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:20.653563 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2cb7a-5911-4d18-a31e-62f131bc8031 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:20.656703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3a3b6021-cc3e-4c0f-9022-80e94499926d None None] MFA Rules not processed for user `beeefb9b8d394407a5e7a32f5a00ffad`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:20.656964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a4e2cb7a-5911-4d18-a31e-62f131bc8031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:20.670051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3a3b6021-cc3e-4c0f-9022-80e94499926d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:20.731509 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2cb7a-5911-4d18-a31e-62f131bc8031 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:20.743736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:20.755532 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a64c7-6729-4223-bce5-76993e19847c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:20.756711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a64c7-6729-4223-bce5-76993e19847c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:20.757296 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a64c7-6729-4223-bce5-76993e19847c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:20.757743 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a64c7-6729-4223-bce5-76993e19847c admin admin] PATH_INFO: `/v3/users/d9d618bbbabc4a7e9859c76305c81655` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:20.759370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a64c7-6729-4223-bce5-76993e19847c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d618bbbabc4a7e9859c76305c81655)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:20.762065 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: WARNING py.warnings [None req-7d8a64c7-6729-4223-bce5-76993e19847c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:53:20.762065 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: warnings.warn(msg) May 26 16:53:20.762065 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: May 26 16:53:20.763895 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a64c7-6729-4223-bce5-76993e19847c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:20.845363 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:20.910181 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 839/1663] 10.222.0.48 () {58 vars in 1057 bytes} [Thu May 26 16:53:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:20.919953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b6021-cc3e-4c0f-9022-80e94499926d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:20.943057 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b6021-cc3e-4c0f-9022-80e94499926d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:20.968162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7a75e-35b1-4032-ba61-f200a8898590 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beeefb9b8d394407a5e7a32f5a00ffad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:20.969183 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7a75e-35b1-4032-ba61-f200a8898590 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:20.969451 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7a75e-35b1-4032-ba61-f200a8898590 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:20.969737 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7a75e-35b1-4032-ba61-f200a8898590 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:20.984522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-87f7a75e-35b1-4032-ba61-f200a8898590 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:21.037554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7a75e-35b1-4032-ba61-f200a8898590 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:21.042145 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7a75e-35b1-4032-ba61-f200a8898590 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:21.058566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7d8a64c7-6729-4223-bce5-76993e19847c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d618bbbabc4a7e9859c76305c81655'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:21.104651 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 840/1664] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:21.182049 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7d8a64c7-6729-4223-bce5-76993e19847c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d618bbbabc4a7e9859c76305c81655'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:21.183271 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7d8a64c7-6729-4223-bce5-76993e19847c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d618bbbabc4a7e9859c76305c81655'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:21.183920 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7d8a64c7-6729-4223-bce5-76993e19847c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d618bbbabc4a7e9859c76305c81655'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:21.203102 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7d8a64c7-6729-4223-bce5-76993e19847c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d618bbbabc4a7e9859c76305c81655'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:21.273648 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ecc02-216e-48a3-b801-9d71a93fa26e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:21.274041 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ecc02-216e-48a3-b801-9d71a93fa26e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:21.274390 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ecc02-216e-48a3-b801-9d71a93fa26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:21.276524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 825/1665] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:53:20 2022] DELETE /identity/v3/users/d9d618bbbabc4a7e9859c76305c81655 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:53:21.311812 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-406ecc02-216e-48a3-b801-9d71a93fa26e None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:21.318187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-406ecc02-216e-48a3-b801-9d71a93fa26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:21.340551 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a64c7-6729-4223-bce5-76993e19847c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:21.342173 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7d8a64c7-6729-4223-bce5-76993e19847c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:21.482816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 841/1666] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:21.506398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a64c7-6729-4223-bce5-76993e19847c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:21.525884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c8ff7-2ecd-413b-9881-ac2cad1a8d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:21.529158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c8ff7-2ecd-413b-9881-ac2cad1a8d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:21.529703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c8ff7-2ecd-413b-9881-ac2cad1a8d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:21.530369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c8ff7-2ecd-413b-9881-ac2cad1a8d19 admin admin] PATH_INFO: `/v3/projects/844b7e02c0cd44ffa3716cd2380cca25` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:21.532310 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c8ff7-2ecd-413b-9881-ac2cad1a8d19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=844b7e02c0cd44ffa3716cd2380cca25)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:21.535517 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c8ff7-2ecd-413b-9881-ac2cad1a8d19 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:21.537404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ecc02-216e-48a3-b801-9d71a93fa26e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:21.539075 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-406ecc02-216e-48a3-b801-9d71a93fa26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:21.594277 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:21.730095 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ecc02-216e-48a3-b801-9d71a93fa26e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:21.752227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14426aba-a46e-4716-8e4b-b4f6f495d2d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:21.755502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14426aba-a46e-4716-8e4b-b4f6f495d2d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:21.756301 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14426aba-a46e-4716-8e4b-b4f6f495d2d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:21.756763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14426aba-a46e-4716-8e4b-b4f6f495d2d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:21.808050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14426aba-a46e-4716-8e4b-b4f6f495d2d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:21.809707 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14426aba-a46e-4716-8e4b-b4f6f495d2d0 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:21.810116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f2c8ff7-2ecd-413b-9881-ac2cad1a8d19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '844b7e02c0cd44ffa3716cd2380cca25', 'request_id': 'req-0f2c8ff7-2ecd-413b-9881-ac2cad1a8d19'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:21.852350 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 842/1667] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:21.856077 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f2c8ff7-2ecd-413b-9881-ac2cad1a8d19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '844b7e02c0cd44ffa3716cd2380cca25', 'request_id': 'req-0f2c8ff7-2ecd-413b-9881-ac2cad1a8d19'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:21.874649 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f2c8ff7-2ecd-413b-9881-ac2cad1a8d19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '844b7e02c0cd44ffa3716cd2380cca25', 'request_id': 'req-0f2c8ff7-2ecd-413b-9881-ac2cad1a8d19'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:22.023867 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f2c8ff7-2ecd-413b-9881-ac2cad1a8d19 admin admin] The token cache is being invalidate because project 844b7e02c0cd44ffa3716cd2380cca25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:53:22.023867 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f2c8ff7-2ecd-413b-9881-ac2cad1a8d19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:22.024032 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f2c8ff7-2ecd-413b-9881-ac2cad1a8d19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:22.026462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 826/1668] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:53:21 2022] DELETE /identity/v3/projects/844b7e02c0cd44ffa3716cd2380cca25 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:53:22.031114 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6797f0-f2d1-4435-92e2-ceb44e2086e9 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:22.031779 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6797f0-f2d1-4435-92e2-ceb44e2086e9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:22.032137 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6797f0-f2d1-4435-92e2-ceb44e2086e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:22.085222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5a6797f0-f2d1-4435-92e2-ceb44e2086e9 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:22.091293 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5a6797f0-f2d1-4435-92e2-ceb44e2086e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:22.254635 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 843/1669] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:22.271864 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dac898-05ae-4cfd-ba3d-fdc4bde41ba7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:22.272152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dac898-05ae-4cfd-ba3d-fdc4bde41ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:22.272724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dac898-05ae-4cfd-ba3d-fdc4bde41ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:22.326068 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a0dac898-05ae-4cfd-ba3d-fdc4bde41ba7 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:22.333134 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a0dac898-05ae-4cfd-ba3d-fdc4bde41ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:22.383869 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6797f0-f2d1-4435-92e2-ceb44e2086e9 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:22.393583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 827/1670] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:22.399270 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6797f0-f2d1-4435-92e2-ceb44e2086e9 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:22.411006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b5092-38bc-40ee-b871-1694cd37f10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:22.412904 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b5092-38bc-40ee-b871-1694cd37f10d admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:22.413195 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b5092-38bc-40ee-b871-1694cd37f10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:22.415231 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b5092-38bc-40ee-b871-1694cd37f10d admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:22.416188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b5092-38bc-40ee-b871-1694cd37f10d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:53:22.419953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b5092-38bc-40ee-b871-1694cd37f10d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:22.424827 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b5092-38bc-40ee-b871-1694cd37f10d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:22.475161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dac898-05ae-4cfd-ba3d-fdc4bde41ba7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:22.480858 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 844/1671] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:53:22.489979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dac898-05ae-4cfd-ba3d-fdc4bde41ba7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:22.505202 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109bc8d-24a0-4675-b193-9a03edf83bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:22.505202 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109bc8d-24a0-4675-b193-9a03edf83bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:22.505202 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109bc8d-24a0-4675-b193-9a03edf83bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:22.505498 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109bc8d-24a0-4675-b193-9a03edf83bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:22.506428 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109bc8d-24a0-4675-b193-9a03edf83bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:22.509159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109bc8d-24a0-4675-b193-9a03edf83bf4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:22.658597 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 828/1672] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:53:22 2022] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:22.662418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b5092-38bc-40ee-b871-1694cd37f10d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:22.691000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b5092-38bc-40ee-b871-1694cd37f10d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:22.835864 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde6ba3-f50c-421c-9b03-9db5756f7dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:22.836740 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde6ba3-f50c-421c-9b03-9db5756f7dec admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:22.837721 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde6ba3-f50c-421c-9b03-9db5756f7dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:22.838805 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde6ba3-f50c-421c-9b03-9db5756f7dec admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:22.839804 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde6ba3-f50c-421c-9b03-9db5756f7dec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:22.843387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde6ba3-f50c-421c-9b03-9db5756f7dec admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:22.960430 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 845/1673] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:53:22 2022] POST /identity/v3/users => generated 287 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:53:22.964476 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109bc8d-24a0-4675-b193-9a03edf83bf4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:22.982252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109bc8d-24a0-4675-b193-9a03edf83bf4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:23.001321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac12633-6552-4a95-aeff-8eccff648fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:23.002364 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac12633-6552-4a95-aeff-8eccff648fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:23.002795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac12633-6552-4a95-aeff-8eccff648fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:23.003244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac12633-6552-4a95-aeff-8eccff648fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:23.004126 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac12633-6552-4a95-aeff-8eccff648fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:23.009011 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac12633-6552-4a95-aeff-8eccff648fd2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:23.033360 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 829/1674] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:23.033999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde6ba3-f50c-421c-9b03-9db5756f7dec admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:23.046666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde6ba3-f50c-421c-9b03-9db5756f7dec admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:23.063536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4836a8a-67be-421a-a0a4-68eb92523ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:23.086147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4836a8a-67be-421a-a0a4-68eb92523ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:23.087795 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4836a8a-67be-421a-a0a4-68eb92523ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:23.097974 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4836a8a-67be-421a-a0a4-68eb92523ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:23.099011 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4836a8a-67be-421a-a0a4-68eb92523ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:23.101591 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4836a8a-67be-421a-a0a4-68eb92523ee4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:23.135855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac12633-6552-4a95-aeff-8eccff648fd2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:23.136606 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 846/1675] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:23.153194 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac12633-6552-4a95-aeff-8eccff648fd2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:23.171340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47956ba-23b3-42ad-b2f5-a2967c059df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:23.172693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47956ba-23b3-42ad-b2f5-a2967c059df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:23.173206 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47956ba-23b3-42ad-b2f5-a2967c059df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:23.175451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47956ba-23b3-42ad-b2f5-a2967c059df1 admin admin] PATH_INFO: `/v3/projects/b9e9f7da0b1c4ed9aee58d936cd30d4d/users/b8f3a5ad4ad0492e98a051930d63b6e0/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:23.236355 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47956ba-23b3-42ad-b2f5-a2967c059df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9e9f7da0b1c4ed9aee58d936cd30d4d, user_id=b8f3a5ad4ad0492e98a051930d63b6e0, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:23.240591 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47956ba-23b3-42ad-b2f5-a2967c059df1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:23.316443 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4836a8a-67be-421a-a0a4-68eb92523ee4 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:23.318578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a4836a8a-67be-421a-a0a4-68eb92523ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:23.344108 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4836a8a-67be-421a-a0a4-68eb92523ee4 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:23.374027 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 830/1676] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:23 2022] PUT /identity/v3/projects/b9e9f7da0b1c4ed9aee58d936cd30d4d/users/b8f3a5ad4ad0492e98a051930d63b6e0/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:23.375809 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93447b36-5cb4-4bfd-81a9-6fa90aa28ba9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:23.376103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93447b36-5cb4-4bfd-81a9-6fa90aa28ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:23.376379 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93447b36-5cb4-4bfd-81a9-6fa90aa28ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:23.452270 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-93447b36-5cb4-4bfd-81a9-6fa90aa28ba9 None None] MFA Rules not processed for user `b8f3a5ad4ad0492e98a051930d63b6e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:23.453574 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-93447b36-5cb4-4bfd-81a9-6fa90aa28ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:23.456390 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:23.557472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc008f5f-c30f-40bb-a44d-f735ab3c539a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:23.558562 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc008f5f-c30f-40bb-a44d-f735ab3c539a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:23.558859 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc008f5f-c30f-40bb-a44d-f735ab3c539a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:23.559141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc008f5f-c30f-40bb-a44d-f735ab3c539a admin admin] PATH_INFO: `/v3/projects/ffac206e9d7949c9a6898d03dcd72ca1` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:23.562066 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc008f5f-c30f-40bb-a44d-f735ab3c539a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffac206e9d7949c9a6898d03dcd72ca1)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:23.565234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: WARNING py.warnings [None req-bc008f5f-c30f-40bb-a44d-f735ab3c539a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:53:23.565234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: warnings.warn(msg) May 26 16:53:23.565234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: May 26 16:53:23.566670 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc008f5f-c30f-40bb-a44d-f735ab3c539a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:23.667721 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 831/1677] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:23.672876 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93447b36-5cb4-4bfd-81a9-6fa90aa28ba9 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:23.703173 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93447b36-5cb4-4bfd-81a9-6fa90aa28ba9 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:23.734554 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f029cb0-d3d3-4de1-ae92-d9cbf9727827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:23.736365 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f029cb0-d3d3-4de1-ae92-d9cbf9727827 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:23.739326 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f029cb0-d3d3-4de1-ae92-d9cbf9727827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:23.740551 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f029cb0-d3d3-4de1-ae92-d9cbf9727827 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:23.743635 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f029cb0-d3d3-4de1-ae92-d9cbf9727827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:23.749534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f029cb0-d3d3-4de1-ae92-d9cbf9727827 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:23.822417 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bc008f5f-c30f-40bb-a44d-f735ab3c539a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffac206e9d7949c9a6898d03dcd72ca1', 'request_id': 'req-bc008f5f-c30f-40bb-a44d-f735ab3c539a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:23.901355 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bc008f5f-c30f-40bb-a44d-f735ab3c539a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffac206e9d7949c9a6898d03dcd72ca1', 'request_id': 'req-bc008f5f-c30f-40bb-a44d-f735ab3c539a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:23.925845 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 832/1678] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:53:23 2022] POST /identity/v3/projects => generated 373 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:23.930305 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f029cb0-d3d3-4de1-ae92-d9cbf9727827 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:23.936779 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bc008f5f-c30f-40bb-a44d-f735ab3c539a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffac206e9d7949c9a6898d03dcd72ca1', 'request_id': 'req-bc008f5f-c30f-40bb-a44d-f735ab3c539a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:23.966439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bc008f5f-c30f-40bb-a44d-f735ab3c539a admin admin] The token cache is being invalidate because project ffac206e9d7949c9a6898d03dcd72ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:53:23.966894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bc008f5f-c30f-40bb-a44d-f735ab3c539a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:23.968554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bc008f5f-c30f-40bb-a44d-f735ab3c539a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:23.972885 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 847/1679] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:53:23 2022] DELETE /identity/v3/projects/ffac206e9d7949c9a6898d03dcd72ca1 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:53:23.978092 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc008f5f-c30f-40bb-a44d-f735ab3c539a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:23.980946 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bc008f5f-c30f-40bb-a44d-f735ab3c539a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:24.129190 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f029cb0-d3d3-4de1-ae92-d9cbf9727827 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:24.134504 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca9424-faa2-4036-90c9-3ca9f2afc9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:24.136521 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca9424-faa2-4036-90c9-3ca9f2afc9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:24.136717 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca9424-faa2-4036-90c9-3ca9f2afc9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:24.137766 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca9424-faa2-4036-90c9-3ca9f2afc9f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:24.138499 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca9424-faa2-4036-90c9-3ca9f2afc9f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:24.140676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca9424-faa2-4036-90c9-3ca9f2afc9f8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:24.159424 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:24.214176 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 833/1680] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:53:23 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:24.220982 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca9424-faa2-4036-90c9-3ca9f2afc9f8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:24.224932 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8cca9424-faa2-4036-90c9-3ca9f2afc9f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:24.273225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca9424-faa2-4036-90c9-3ca9f2afc9f8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:24.295791 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f62da-1bec-44d2-b6b9-392e5150981d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:24.296508 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f62da-1bec-44d2-b6b9-392e5150981d admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:24.296813 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f62da-1bec-44d2-b6b9-392e5150981d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:24.297066 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f62da-1bec-44d2-b6b9-392e5150981d admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:24.297843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f62da-1bec-44d2-b6b9-392e5150981d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:24.314359 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f62da-1bec-44d2-b6b9-392e5150981d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:24.344317 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:24.360193 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 834/1681] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:24.360193 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f62da-1bec-44d2-b6b9-392e5150981d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:24.411888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f62da-1bec-44d2-b6b9-392e5150981d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:24.441352 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89c9e0-5fb8-46bc-9ee1-aeadb033588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:24.441560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89c9e0-5fb8-46bc-9ee1-aeadb033588f admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:24.441797 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89c9e0-5fb8-46bc-9ee1-aeadb033588f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:24.442076 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89c9e0-5fb8-46bc-9ee1-aeadb033588f admin admin] PATH_INFO: `/v3/projects/fef0b12542dc4358aec0968bd61f3331/users/24268ad4ac404f93ba0a099936dc52aa/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:24.490048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc008f5f-c30f-40bb-a44d-f735ab3c539a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:24.501535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89c9e0-5fb8-46bc-9ee1-aeadb033588f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fef0b12542dc4358aec0968bd61f3331, user_id=24268ad4ac404f93ba0a099936dc52aa, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:24.504452 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89c9e0-5fb8-46bc-9ee1-aeadb033588f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:24.517659 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973ff59-0215-45c9-9216-9bf29e61b720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:24.522105 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973ff59-0215-45c9-9216-9bf29e61b720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:24.525725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973ff59-0215-45c9-9216-9bf29e61b720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:24.526071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973ff59-0215-45c9-9216-9bf29e61b720 admin admin] PATH_INFO: `/v3/users/d58a02d81e9044109056aa646576b32b` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:24.537022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973ff59-0215-45c9-9216-9bf29e61b720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d58a02d81e9044109056aa646576b32b)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:24.546929 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973ff59-0215-45c9-9216-9bf29e61b720 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:24.657848 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 835/1682] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:24 2022] PUT /identity/v3/projects/fef0b12542dc4358aec0968bd61f3331/users/24268ad4ac404f93ba0a099936dc52aa/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:24.662131 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89c9e0-5fb8-46bc-9ee1-aeadb033588f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:24.826651 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89c9e0-5fb8-46bc-9ee1-aeadb033588f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:24.845963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d5956-86a5-4682-a84d-605ee216fa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:24.846819 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d5956-86a5-4682-a84d-605ee216fa9e admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:24.847209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d5956-86a5-4682-a84d-605ee216fa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:24.847597 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d5956-86a5-4682-a84d-605ee216fa9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:24.848440 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d5956-86a5-4682-a84d-605ee216fa9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:24.850244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d5956-86a5-4682-a84d-605ee216fa9e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:24.891496 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e973ff59-0215-45c9-9216-9bf29e61b720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd58a02d81e9044109056aa646576b32b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:24.892246 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 836/1683] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:24.893881 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d5956-86a5-4682-a84d-605ee216fa9e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:24.895052 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e973ff59-0215-45c9-9216-9bf29e61b720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd58a02d81e9044109056aa646576b32b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:24.934119 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e973ff59-0215-45c9-9216-9bf29e61b720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd58a02d81e9044109056aa646576b32b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:24.942759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d5956-86a5-4682-a84d-605ee216fa9e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:24.950362 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bb0e3-2e33-4855-b0c1-bcb1e0f44bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:24.951685 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bb0e3-2e33-4855-b0c1-bcb1e0f44bd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:24.952104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bb0e3-2e33-4855-b0c1-bcb1e0f44bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:24.952665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bb0e3-2e33-4855-b0c1-bcb1e0f44bd2 admin admin] PATH_INFO: `/v3/projects/fef0b12542dc4358aec0968bd61f3331/users/24268ad4ac404f93ba0a099936dc52aa/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:24.955655 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bb0e3-2e33-4855-b0c1-bcb1e0f44bd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fef0b12542dc4358aec0968bd61f3331, user_id=24268ad4ac404f93ba0a099936dc52aa, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:24.960198 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bb0e3-2e33-4855-b0c1-bcb1e0f44bd2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:24.981315 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 837/1684] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:24 2022] PUT /identity/v3/projects/fef0b12542dc4358aec0968bd61f3331/users/24268ad4ac404f93ba0a099936dc52aa/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:25.002527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b72762-40ad-4700-b608-fd0a1a62c23c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:25.002843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b72762-40ad-4700-b608-fd0a1a62c23c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:25.003128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b72762-40ad-4700-b608-fd0a1a62c23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:25.081838 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a6b72762-40ad-4700-b608-fd0a1a62c23c None None] MFA Rules not processed for user `24268ad4ac404f93ba0a099936dc52aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:25.082337 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e973ff59-0215-45c9-9216-9bf29e61b720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd58a02d81e9044109056aa646576b32b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:25.083212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a6b72762-40ad-4700-b608-fd0a1a62c23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:25.084292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e973ff59-0215-45c9-9216-9bf29e61b720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd58a02d81e9044109056aa646576b32b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:25.153248 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 848/1685] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:53:23 2022] DELETE /identity/v3/users/d58a02d81e9044109056aa646576b32b => generated 0 bytes in 1172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:53:25.240457 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 838/1686] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:53:25.255369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973ff59-0215-45c9-9216-9bf29e61b720 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:25.259391 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e973ff59-0215-45c9-9216-9bf29e61b720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:25.440683 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973ff59-0215-45c9-9216-9bf29e61b720 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:25.445814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5094a81-a839-4f87-a493-01ff049e0265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:25.446657 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5094a81-a839-4f87-a493-01ff049e0265 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:25.446785 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5094a81-a839-4f87-a493-01ff049e0265 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:25.447169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5094a81-a839-4f87-a493-01ff049e0265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:25.664569 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5094a81-a839-4f87-a493-01ff049e0265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:25.667283 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5094a81-a839-4f87-a493-01ff049e0265 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:25.689849 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 849/1687] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:26.409591 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b72762-40ad-4700-b608-fd0a1a62c23c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:26.506612 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b72762-40ad-4700-b608-fd0a1a62c23c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:26.512419 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a04691-69fc-423f-b6fb-79cbe61ad61d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:26.513489 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a04691-69fc-423f-b6fb-79cbe61ad61d service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:26.513992 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a04691-69fc-423f-b6fb-79cbe61ad61d service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:26.514469 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a04691-69fc-423f-b6fb-79cbe61ad61d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:26.517232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c6a04691-69fc-423f-b6fb-79cbe61ad61d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:26.721688 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a04691-69fc-423f-b6fb-79cbe61ad61d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:26.726122 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a04691-69fc-423f-b6fb-79cbe61ad61d service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:26.752012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 839/1688] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:26.810271 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:27.072176 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:27.276188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5094a81-a839-4f87-a493-01ff049e0265 service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:27.277927 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b5094a81-a839-4f87-a493-01ff049e0265 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:27.396900 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49193493-e953-4258-a172-f1fcb96bf9bf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:27.397579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49193493-e953-4258-a172-f1fcb96bf9bf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:27.398179 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49193493-e953-4258-a172-f1fcb96bf9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:27.448097 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5094a81-a839-4f87-a493-01ff049e0265 service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:27.459466 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd1224-7572-414c-b556-61d55edb6aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:27.460452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd1224-7572-414c-b556-61d55edb6aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:27.468446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd1224-7572-414c-b556-61d55edb6aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:27.468816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd1224-7572-414c-b556-61d55edb6aeb admin admin] PATH_INFO: `/v3/projects/62d18121afb64437ac739e33a59d093a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:27.474109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd1224-7572-414c-b556-61d55edb6aeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=62d18121afb64437ac739e33a59d093a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:27.477587 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd1224-7572-414c-b556-61d55edb6aeb admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:27.484895 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-49193493-e953-4258-a172-f1fcb96bf9bf None None] MFA Rules not processed for user `1cf5ba73296e41c4ab58a6a962b578d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:27.487584 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-49193493-e953-4258-a172-f1fcb96bf9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:27.672769 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e9fd1224-7572-414c-b556-61d55edb6aeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62d18121afb64437ac739e33a59d093a', 'request_id': 'req-e9fd1224-7572-414c-b556-61d55edb6aeb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:27.729856 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 840/1689] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:27.741040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beee4ec-cac0-4e4f-8de2-ea03aa7ce8b5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:27.741686 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beee4ec-cac0-4e4f-8de2-ea03aa7ce8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:27.742758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beee4ec-cac0-4e4f-8de2-ea03aa7ce8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:27.759772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e9fd1224-7572-414c-b556-61d55edb6aeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62d18121afb64437ac739e33a59d093a', 'request_id': 'req-e9fd1224-7572-414c-b556-61d55edb6aeb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:27.769069 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e9fd1224-7572-414c-b556-61d55edb6aeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62d18121afb64437ac739e33a59d093a', 'request_id': 'req-e9fd1224-7572-414c-b556-61d55edb6aeb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:27.782358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3beee4ec-cac0-4e4f-8de2-ea03aa7ce8b5 None None] MFA Rules not processed for user `1cf5ba73296e41c4ab58a6a962b578d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:27.783596 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3beee4ec-cac0-4e4f-8de2-ea03aa7ce8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:27.798772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e9fd1224-7572-414c-b556-61d55edb6aeb admin admin] The token cache is being invalidate because project 62d18121afb64437ac739e33a59d093a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:53:27.799095 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e9fd1224-7572-414c-b556-61d55edb6aeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:27.799907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e9fd1224-7572-414c-b556-61d55edb6aeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:27.801704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 850/1690] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:53:27 2022] DELETE /identity/v3/projects/62d18121afb64437ac739e33a59d093a => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:27.808861 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baec46-edad-468b-bb3b-5be76fdcde05 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:27.809157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baec46-edad-468b-bb3b-5be76fdcde05 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:27.811192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baec46-edad-468b-bb3b-5be76fdcde05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:27.836189 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b7baec46-edad-468b-bb3b-5be76fdcde05 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:27.838959 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b7baec46-edad-468b-bb3b-5be76fdcde05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:27.975190 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 841/1691] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:53:27.989634 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beee4ec-cac0-4e4f-8de2-ea03aa7ce8b5 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:27.992955 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3beee4ec-cac0-4e4f-8de2-ea03aa7ce8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:28.036648 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 851/1692] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:53:28.045655 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986130cb-1dfa-49e9-9fc7-2b97a3521318 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:28.052674 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986130cb-1dfa-49e9-9fc7-2b97a3521318 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:28.052674 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986130cb-1dfa-49e9-9fc7-2b97a3521318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:28.093888 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-986130cb-1dfa-49e9-9fc7-2b97a3521318 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:28.098459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-986130cb-1dfa-49e9-9fc7-2b97a3521318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:28.114791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 852/1693] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:28.128978 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986130cb-1dfa-49e9-9fc7-2b97a3521318 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:28.156125 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986130cb-1dfa-49e9-9fc7-2b97a3521318 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:28.169444 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3149f7-df6b-4338-9fd5-b20194b87c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:28.170819 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3149f7-df6b-4338-9fd5-b20194b87c1e admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:28.170819 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3149f7-df6b-4338-9fd5-b20194b87c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:28.171006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3149f7-df6b-4338-9fd5-b20194b87c1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:28.172612 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3149f7-df6b-4338-9fd5-b20194b87c1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:53:28.174150 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3149f7-df6b-4338-9fd5-b20194b87c1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:28.178286 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3149f7-df6b-4338-9fd5-b20194b87c1e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:28.218076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 853/1694] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:53:28.219766 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beee4ec-cac0-4e4f-8de2-ea03aa7ce8b5 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:28.223185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3149f7-df6b-4338-9fd5-b20194b87c1e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:28.242159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a7043-1c21-4665-9ab6-567034920d4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:28.244978 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a7043-1c21-4665-9ab6-567034920d4b service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:28.245529 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a7043-1c21-4665-9ab6-567034920d4b service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:28.246004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a7043-1c21-4665-9ab6-567034920d4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:28.248882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-925a7043-1c21-4665-9ab6-567034920d4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:28.252598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3149f7-df6b-4338-9fd5-b20194b87c1e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:28.263076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6636740-1dd1-450b-bf6e-7c0ca547a37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:28.264446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6636740-1dd1-450b-bf6e-7c0ca547a37b admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:28.265659 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6636740-1dd1-450b-bf6e-7c0ca547a37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:28.266151 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6636740-1dd1-450b-bf6e-7c0ca547a37b admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:28.267968 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6636740-1dd1-450b-bf6e-7c0ca547a37b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:28.272917 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a7043-1c21-4665-9ab6-567034920d4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:28.277495 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6636740-1dd1-450b-bf6e-7c0ca547a37b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:28.278500 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a7043-1c21-4665-9ab6-567034920d4b service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:28.307438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 842/1695] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:28.446238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 854/1696] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:53:28 2022] POST /identity/v3/projects => generated 363 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:28.452537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a7043-1c21-4665-9ab6-567034920d4b service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:28.468699 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a7043-1c21-4665-9ab6-567034920d4b service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:28.608719 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefde99-6d76-43d5-8904-7e51c479b52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:28.609584 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefde99-6d76-43d5-8904-7e51c479b52a admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:28.609864 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefde99-6d76-43d5-8904-7e51c479b52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:28.610336 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefde99-6d76-43d5-8904-7e51c479b52a admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:28.612314 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefde99-6d76-43d5-8904-7e51c479b52a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:28.614367 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefde99-6d76-43d5-8904-7e51c479b52a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:28.762182 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 843/1697] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:53:28 2022] POST /identity/v3/users => generated 282 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:28.767213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6636740-1dd1-450b-bf6e-7c0ca547a37b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:28.781139 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6636740-1dd1-450b-bf6e-7c0ca547a37b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:28.797559 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:28.806151 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2d9e3-5184-4f6d-b092-d92a93359aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:28.808206 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2d9e3-5184-4f6d-b092-d92a93359aef admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:28.808725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2d9e3-5184-4f6d-b092-d92a93359aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:28.809187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2d9e3-5184-4f6d-b092-d92a93359aef admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:28.813765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2d9e3-5184-4f6d-b092-d92a93359aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:28.816742 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2d9e3-5184-4f6d-b092-d92a93359aef admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:28.835601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 855/1698] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:28.840922 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefde99-6d76-43d5-8904-7e51c479b52a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:28.865248 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefde99-6d76-43d5-8904-7e51c479b52a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:28.884691 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863c9c6-d821-4ec3-b593-13a26b3ee52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:28.886053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863c9c6-d821-4ec3-b593-13a26b3ee52a admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:28.886338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863c9c6-d821-4ec3-b593-13a26b3ee52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:28.894061 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863c9c6-d821-4ec3-b593-13a26b3ee52a admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:28.894061 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863c9c6-d821-4ec3-b593-13a26b3ee52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:28.894061 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863c9c6-d821-4ec3-b593-13a26b3ee52a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:28.934766 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 844/1699] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:28.937925 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2d9e3-5184-4f6d-b092-d92a93359aef admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:28.954359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2d9e3-5184-4f6d-b092-d92a93359aef admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:28.969437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3611214-80f8-43d3-b190-d3959a68fef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:28.969437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3611214-80f8-43d3-b190-d3959a68fef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:28.969437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3611214-80f8-43d3-b190-d3959a68fef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:28.969437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3611214-80f8-43d3-b190-d3959a68fef0 admin admin] PATH_INFO: `/v3/projects/fc51e8794eed4328a0a5d9a72687bd96/users/aacb3b592bb94a8486e7a02c19b057c1/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:28.990030 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3611214-80f8-43d3-b190-d3959a68fef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc51e8794eed4328a0a5d9a72687bd96, user_id=aacb3b592bb94a8486e7a02c19b057c1, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:28.992914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3611214-80f8-43d3-b190-d3959a68fef0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:29.140852 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 856/1700] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:28 2022] PUT /identity/v3/projects/fc51e8794eed4328a0a5d9a72687bd96/users/aacb3b592bb94a8486e7a02c19b057c1/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:29.157359 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77ee8a-4dbd-4283-aafa-860f67fedfcf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:29.158179 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77ee8a-4dbd-4283-aafa-860f67fedfcf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:29.158179 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77ee8a-4dbd-4283-aafa-860f67fedfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:29.219322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9b77ee8a-4dbd-4283-aafa-860f67fedfcf None None] MFA Rules not processed for user `aacb3b592bb94a8486e7a02c19b057c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:29.220578 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9b77ee8a-4dbd-4283-aafa-860f67fedfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:29.328563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae50fa-5e8d-4491-9d01-91525e3d2b52 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:29.329607 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae50fa-5e8d-4491-9d01-91525e3d2b52 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:29.329872 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae50fa-5e8d-4491-9d01-91525e3d2b52 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:29.338465 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 857/1701] 10.222.0.48 () {54 vars in 912 bytes} [Thu May 26 16:53:29 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:53:29.347523 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8fc12-b227-4867-8732-0f44260a65b8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:29.352772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8fc12-b227-4867-8732-0f44260a65b8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:29.355062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8fc12-b227-4867-8732-0f44260a65b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:29.397078 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-25b8fc12-b227-4867-8732-0f44260a65b8 None None] MFA Rules not processed for user `d577b5295f9e4a4388bb6293d1c33d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:29.399125 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-25b8fc12-b227-4867-8732-0f44260a65b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:29.416154 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 845/1702] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:29 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:29.421001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77ee8a-4dbd-4283-aafa-860f67fedfcf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:29.509362 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 858/1703] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 16:53:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:29.558030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77ee8a-4dbd-4283-aafa-860f67fedfcf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:29.563635 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cbd76-0cea-4d52-a069-11341c172ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:29.564825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cbd76-0cea-4d52-a069-11341c172ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:29.565011 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cbd76-0cea-4d52-a069-11341c172ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:29.565217 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cbd76-0cea-4d52-a069-11341c172ef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:29.568507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cbd76-0cea-4d52-a069-11341c172ef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:29.571871 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cbd76-0cea-4d52-a069-11341c172ef2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:29.612382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8fc12-b227-4867-8732-0f44260a65b8 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:29.614158 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-25b8fc12-b227-4867-8732-0f44260a65b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:29.633569 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8fc12-b227-4867-8732-0f44260a65b8 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:29.639804 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38681535-c02e-427f-88b9-4fc06a894dfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:29.640495 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38681535-c02e-427f-88b9-4fc06a894dfb service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:29.641473 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38681535-c02e-427f-88b9-4fc06a894dfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:29.641473 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38681535-c02e-427f-88b9-4fc06a894dfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:29.654516 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:29.672650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38681535-c02e-427f-88b9-4fc06a894dfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:29.674222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38681535-c02e-427f-88b9-4fc06a894dfb service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:29.706026 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 859/1704] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:29.770180 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 846/1705] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:53:29 2022] POST /identity/v3/projects => generated 365 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:53:29.774323 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38681535-c02e-427f-88b9-4fc06a894dfb service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:29.803889 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38681535-c02e-427f-88b9-4fc06a894dfb service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:30.066280 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb8075-06ba-4f75-b80e-ae1cae10e4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:30.072127 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb8075-06ba-4f75-b80e-ae1cae10e4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:30.074117 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb8075-06ba-4f75-b80e-ae1cae10e4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:30.075351 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb8075-06ba-4f75-b80e-ae1cae10e4e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:30.077386 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb8075-06ba-4f75-b80e-ae1cae10e4e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:30.086174 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb8075-06ba-4f75-b80e-ae1cae10e4e2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:30.273167 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 860/1706] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:53:29 2022] POST /identity/v3/users => generated 289 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:30.278578 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cbd76-0cea-4d52-a069-11341c172ef2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:30.279405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:30.299942 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cbd76-0cea-4d52-a069-11341c172ef2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:30.320641 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79597118-8d8c-463e-900e-c2ecfb267148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:30.321415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79597118-8d8c-463e-900e-c2ecfb267148 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:30.322110 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79597118-8d8c-463e-900e-c2ecfb267148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:30.322642 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79597118-8d8c-463e-900e-c2ecfb267148 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:30.323502 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79597118-8d8c-463e-900e-c2ecfb267148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:30.325236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79597118-8d8c-463e-900e-c2ecfb267148 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:30.367176 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 847/1707] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:30.371985 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb8075-06ba-4f75-b80e-ae1cae10e4e2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:30.385563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb8075-06ba-4f75-b80e-ae1cae10e4e2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:30.391884 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34c43c-ea3a-4aea-8ae0-c0dc66a5e1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:30.393189 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34c43c-ea3a-4aea-8ae0-c0dc66a5e1a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:30.393680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34c43c-ea3a-4aea-8ae0-c0dc66a5e1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:30.394127 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34c43c-ea3a-4aea-8ae0-c0dc66a5e1a6 admin admin] PATH_INFO: `/v3/projects/4f988354e3364111bc0bc6b4e3e0a6bb/users/2c23f20ee7aa47319eade600e080379a/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:30.424993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34c43c-ea3a-4aea-8ae0-c0dc66a5e1a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f988354e3364111bc0bc6b4e3e0a6bb, user_id=2c23f20ee7aa47319eade600e080379a, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:30.428566 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34c43c-ea3a-4aea-8ae0-c0dc66a5e1a6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:30.539865 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158d6e0-b6eb-4e96-9af2-93381dfb64e0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:30.541052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158d6e0-b6eb-4e96-9af2-93381dfb64e0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:30.542076 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158d6e0-b6eb-4e96-9af2-93381dfb64e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:30.582049 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9158d6e0-b6eb-4e96-9af2-93381dfb64e0 None None] MFA Rules not processed for user `4d2ab3eeb5b44979956dd223ac6b7c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:30.592123 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9158d6e0-b6eb-4e96-9af2-93381dfb64e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:30.662171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 861/1708] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:30 2022] PUT /identity/v3/projects/4f988354e3364111bc0bc6b4e3e0a6bb/users/2c23f20ee7aa47319eade600e080379a/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:30.664649 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34c43c-ea3a-4aea-8ae0-c0dc66a5e1a6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:30.758326 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 848/1709] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 16:53:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:53:30.856818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:30.875318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34c43c-ea3a-4aea-8ae0-c0dc66a5e1a6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:30.881546 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b176e1-4b95-4347-8cda-0ad61b50eb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:30.882516 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b176e1-4b95-4347-8cda-0ad61b50eb95 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:30.882966 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b176e1-4b95-4347-8cda-0ad61b50eb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:30.884510 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b176e1-4b95-4347-8cda-0ad61b50eb95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:30.886286 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b176e1-4b95-4347-8cda-0ad61b50eb95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:30.889009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b176e1-4b95-4347-8cda-0ad61b50eb95 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:30.915437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 862/1710] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:30.920470 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158d6e0-b6eb-4e96-9af2-93381dfb64e0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:30.941594 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158d6e0-b6eb-4e96-9af2-93381dfb64e0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:30.954450 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa3203-0f01-4872-bb38-8a05ff19d312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:30.955371 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa3203-0f01-4872-bb38-8a05ff19d312 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:30.955670 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa3203-0f01-4872-bb38-8a05ff19d312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:30.955952 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa3203-0f01-4872-bb38-8a05ff19d312 admin admin] PATH_INFO: `/v3/projects/4f988354e3364111bc0bc6b4e3e0a6bb/users/2c23f20ee7aa47319eade600e080379a/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:30.961044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa3203-0f01-4872-bb38-8a05ff19d312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f988354e3364111bc0bc6b4e3e0a6bb, user_id=2c23f20ee7aa47319eade600e080379a, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:30.970293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa3203-0f01-4872-bb38-8a05ff19d312 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:30.999169 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 849/1711] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:30 2022] PUT /identity/v3/projects/4f988354e3364111bc0bc6b4e3e0a6bb/users/2c23f20ee7aa47319eade600e080379a/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:31.011971 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eea9e2-75e3-4fc3-a59e-76f3fa0e647e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:31.022616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eea9e2-75e3-4fc3-a59e-76f3fa0e647e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:31.022616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eea9e2-75e3-4fc3-a59e-76f3fa0e647e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:31.161905 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-13eea9e2-75e3-4fc3-a59e-76f3fa0e647e None None] MFA Rules not processed for user `2c23f20ee7aa47319eade600e080379a`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:31.184973 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-13eea9e2-75e3-4fc3-a59e-76f3fa0e647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:31.334051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa3203-0f01-4872-bb38-8a05ff19d312 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:31.336197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-67fa3203-0f01-4872-bb38-8a05ff19d312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:31.594796 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 863/1712] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 579 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:31.630403 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa3203-0f01-4872-bb38-8a05ff19d312 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:31.644188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1dec73-0630-4c4a-b134-8ecc6328f99c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cc455638fb4db4939af3657ab4203e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:31.647693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dec73-0630-4c4a-b134-8ecc6328f99c service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:31.648227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dec73-0630-4c4a-b134-8ecc6328f99c service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:31.648655 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dec73-0630-4c4a-b134-8ecc6328f99c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:31.738066 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eea9e2-75e3-4fc3-a59e-76f3fa0e647e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:31.740118 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-13eea9e2-75e3-4fc3-a59e-76f3fa0e647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:31.819044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1dec73-0630-4c4a-b134-8ecc6328f99c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:31.821063 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1dec73-0630-4c4a-b134-8ecc6328f99c service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:31.906365 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 850/1713] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 16:53:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:53:31.908011 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b089b-2dee-4273-b2e0-cfa419ce1b91 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:31.908515 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b089b-2dee-4273-b2e0-cfa419ce1b91 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:31.908953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b089b-2dee-4273-b2e0-cfa419ce1b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:32.014368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-949b089b-2dee-4273-b2e0-cfa419ce1b91 None None] MFA Rules not processed for user `1cf5ba73296e41c4ab58a6a962b578d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:32.017995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-949b089b-2dee-4273-b2e0-cfa419ce1b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:32.061809 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eea9e2-75e3-4fc3-a59e-76f3fa0e647e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:32.081308 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771bcce-6516-4c8c-a0d3-a6dd31ad3579 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:32.082191 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771bcce-6516-4c8c-a0d3-a6dd31ad3579 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:32.082642 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771bcce-6516-4c8c-a0d3-a6dd31ad3579 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:32.083072 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771bcce-6516-4c8c-a0d3-a6dd31ad3579 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:32.118166 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771bcce-6516-4c8c-a0d3-a6dd31ad3579 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:32.120048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771bcce-6516-4c8c-a0d3-a6dd31ad3579 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:32.143527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 864/1714] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:31 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:53:32.179415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75527014-0c15-493f-a210-368313ceb472 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:32.179754 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75527014-0c15-493f-a210-368313ceb472 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:32.180081 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75527014-0c15-493f-a210-368313ceb472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:32.259742 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 851/1715] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:32.273327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-75527014-0c15-493f-a210-368313ceb472 None None] MFA Rules not processed for user `d5684eb0dd3141f5a25b61aafedbe865`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:32.277370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-75527014-0c15-493f-a210-368313ceb472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:32.481142 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b089b-2dee-4273-b2e0-cfa419ce1b91 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:32.503104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b089b-2dee-4273-b2e0-cfa419ce1b91 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:32.527145 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 865/1716] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:53:32.544018 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77379df5-ed86-4939-8455-7a96ea788de2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:32.550246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75527014-0c15-493f-a210-368313ceb472 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:32.550323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77379df5-ed86-4939-8455-7a96ea788de2 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:32.550323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77379df5-ed86-4939-8455-7a96ea788de2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:32.550323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77379df5-ed86-4939-8455-7a96ea788de2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:32.707106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77379df5-ed86-4939-8455-7a96ea788de2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:32.709222 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77379df5-ed86-4939-8455-7a96ea788de2 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:32.768745 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 852/1717] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:32 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:53:32.774376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b132468-e813-48b0-963e-55606dd16306 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:32.778438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b132468-e813-48b0-963e-55606dd16306 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:32.778677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b132468-e813-48b0-963e-55606dd16306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:32.853472 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2b132468-e813-48b0-963e-55606dd16306 None None] MFA Rules not processed for user `89f20368c3a747a49a3aaa556115d169`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:32.855372 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2b132468-e813-48b0-963e-55606dd16306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:32.909670 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75527014-0c15-493f-a210-368313ceb472 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:32.939839 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6140b-8afc-41f9-b293-f4ad09fc3fe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:32.940551 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6140b-8afc-41f9-b293-f4ad09fc3fe9 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:32.940836 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6140b-8afc-41f9-b293-f4ad09fc3fe9 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:32.941136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6140b-8afc-41f9-b293-f4ad09fc3fe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:32.960404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6140b-8afc-41f9-b293-f4ad09fc3fe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:32.962838 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6140b-8afc-41f9-b293-f4ad09fc3fe9 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:32.979384 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 866/1718] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:32.983286 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f56f8-1952-4e45-8b5e-cdbacc1ff284 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:32.983755 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f56f8-1952-4e45-8b5e-cdbacc1ff284 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:32.984178 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f56f8-1952-4e45-8b5e-cdbacc1ff284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:33.020062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4f2f56f8-1952-4e45-8b5e-cdbacc1ff284 None None] MFA Rules not processed for user `d577b5295f9e4a4388bb6293d1c33d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:33.023776 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4f2f56f8-1952-4e45-8b5e-cdbacc1ff284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:33.045474 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 853/1719] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:33.167481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 867/1720] 10.222.0.95 () {58 vars in 1015 bytes} [Thu May 26 16:53:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:33.256220 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b132468-e813-48b0-963e-55606dd16306 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:33.276608 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b132468-e813-48b0-963e-55606dd16306 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:33.290764 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf00fc-9342-401f-812c-84dee88363a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:33.292025 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf00fc-9342-401f-812c-84dee88363a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:33.292502 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf00fc-9342-401f-812c-84dee88363a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:33.292990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf00fc-9342-401f-812c-84dee88363a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:33.317235 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf00fc-9342-401f-812c-84dee88363a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:33.319188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf00fc-9342-401f-812c-84dee88363a7 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:33.344827 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 854/1721] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:33.977553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:34.624507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:34.719546 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f56f8-1952-4e45-8b5e-cdbacc1ff284 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:34.721348 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4f2f56f8-1952-4e45-8b5e-cdbacc1ff284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:34.762552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f56f8-1952-4e45-8b5e-cdbacc1ff284 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:34.788286 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c5564-2b03-4e39-a055-0b82b81b3d21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:34.789889 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c5564-2b03-4e39-a055-0b82b81b3d21 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:34.792981 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c5564-2b03-4e39-a055-0b82b81b3d21 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:34.793628 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c5564-2b03-4e39-a055-0b82b81b3d21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:34.824365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c5564-2b03-4e39-a055-0b82b81b3d21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:34.832762 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c5564-2b03-4e39-a055-0b82b81b3d21 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:34.860305 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 868/1722] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:36.873391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfe942-c06f-45ab-8228-90bb760ba46b None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:36.874504 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfe942-c06f-45ab-8228-90bb760ba46b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:36.874972 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfe942-c06f-45ab-8228-90bb760ba46b None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:36.877721 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 855/1723] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 16:53:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:53:36.892737 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fa9fd-64d1-4091-a01d-a44550dce5da None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:36.893714 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fa9fd-64d1-4091-a01d-a44550dce5da None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:36.894523 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fa9fd-64d1-4091-a01d-a44550dce5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:36.935276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e96fa9fd-64d1-4091-a01d-a44550dce5da None None] MFA Rules not processed for user `35c9fa9c29494ff9b1f749974dca2719`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:36.935702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e96fa9fd-64d1-4091-a01d-a44550dce5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:36.958268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 869/1724] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 16:53:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:36.971061 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfe942-c06f-45ab-8228-90bb760ba46b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:36.988112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfe942-c06f-45ab-8228-90bb760ba46b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:36.994453 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a7c94-f32f-41e4-95ac-21951bdfb8bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:36.995271 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a7c94-f32f-41e4-95ac-21951bdfb8bf service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:36.995684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a7c94-f32f-41e4-95ac-21951bdfb8bf service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:36.997186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a7c94-f32f-41e4-95ac-21951bdfb8bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:37.018185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a7c94-f32f-41e4-95ac-21951bdfb8bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:37.021601 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a7c94-f32f-41e4-95ac-21951bdfb8bf service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:37.057598 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 856/1725] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:39.108860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658528af-51d9-44fd-aec2-a4e963312076 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:39.109873 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658528af-51d9-44fd-aec2-a4e963312076 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:39.110419 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658528af-51d9-44fd-aec2-a4e963312076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:39.182140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-658528af-51d9-44fd-aec2-a4e963312076 None None] MFA Rules not processed for user `d5684eb0dd3141f5a25b61aafedbe865`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:39.184926 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-658528af-51d9-44fd-aec2-a4e963312076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:39.218146 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 870/1726] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:53:39.240077 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:41.096506 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd251fe2-794d-4a92-be84-65d84eacdcbe None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:41.097075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd251fe2-794d-4a92-be84-65d84eacdcbe None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:41.102119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd251fe2-794d-4a92-be84-65d84eacdcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:41.153481 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bd251fe2-794d-4a92-be84-65d84eacdcbe None None] MFA Rules not processed for user `89f20368c3a747a49a3aaa556115d169`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:41.155553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bd251fe2-794d-4a92-be84-65d84eacdcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:41.168186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 857/1727] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:41.314187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658528af-51d9-44fd-aec2-a4e963312076 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:41.582897 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658528af-51d9-44fd-aec2-a4e963312076 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:41.590803 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7336ba-2907-4e6c-8f53-eabf1a6d5925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:41.592616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7336ba-2907-4e6c-8f53-eabf1a6d5925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:41.593167 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7336ba-2907-4e6c-8f53-eabf1a6d5925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:41.595456 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7336ba-2907-4e6c-8f53-eabf1a6d5925 admin admin] PATH_INFO: `/v3/users/aacb3b592bb94a8486e7a02c19b057c1` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:41.597493 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7336ba-2907-4e6c-8f53-eabf1a6d5925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aacb3b592bb94a8486e7a02c19b057c1)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:41.604157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7336ba-2907-4e6c-8f53-eabf1a6d5925 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:41.701409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd251fe2-794d-4a92-be84-65d84eacdcbe None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:41.703104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bd251fe2-794d-4a92-be84-65d84eacdcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:41.753291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd251fe2-794d-4a92-be84-65d84eacdcbe None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:41.766603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a9292-ba7b-4fd4-86a1-fdd9fa1c2166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:41.767908 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a9292-ba7b-4fd4-86a1-fdd9fa1c2166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:41.768398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a9292-ba7b-4fd4-86a1-fdd9fa1c2166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:41.768857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a9292-ba7b-4fd4-86a1-fdd9fa1c2166 admin admin] PATH_INFO: `/v3/users/9e7a86972a01482caf212f57ce540321` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:41.770425 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a9292-ba7b-4fd4-86a1-fdd9fa1c2166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e7a86972a01482caf212f57ce540321)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:41.772565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a9292-ba7b-4fd4-86a1-fdd9fa1c2166 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:42.127345 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0d7336ba-2907-4e6c-8f53-eabf1a6d5925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aacb3b592bb94a8486e7a02c19b057c1'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:42.128976 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0d7336ba-2907-4e6c-8f53-eabf1a6d5925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aacb3b592bb94a8486e7a02c19b057c1'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:42.163958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0d7336ba-2907-4e6c-8f53-eabf1a6d5925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aacb3b592bb94a8486e7a02c19b057c1'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:42.248524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dd6a9292-ba7b-4fd4-86a1-fdd9fa1c2166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e7a86972a01482caf212f57ce540321'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:42.307690 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0d7336ba-2907-4e6c-8f53-eabf1a6d5925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aacb3b592bb94a8486e7a02c19b057c1'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:42.308497 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0d7336ba-2907-4e6c-8f53-eabf1a6d5925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aacb3b592bb94a8486e7a02c19b057c1'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:42.347427 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:42.362714 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 871/1728] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:53:41 2022] DELETE /identity/v3/users/aacb3b592bb94a8486e7a02c19b057c1 => generated 0 bytes in 1048 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:42.377643 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3624843-3d41-437b-93ac-8b9045ae4c6d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:42.377931 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3624843-3d41-437b-93ac-8b9045ae4c6d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:42.378208 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3624843-3d41-437b-93ac-8b9045ae4c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:42.436739 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a3624843-3d41-437b-93ac-8b9045ae4c6d None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:42.438135 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a3624843-3d41-437b-93ac-8b9045ae4c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:42.472300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dd6a9292-ba7b-4fd4-86a1-fdd9fa1c2166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e7a86972a01482caf212f57ce540321'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:42.482964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dd6a9292-ba7b-4fd4-86a1-fdd9fa1c2166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e7a86972a01482caf212f57ce540321'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:42.485911 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dd6a9292-ba7b-4fd4-86a1-fdd9fa1c2166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e7a86972a01482caf212f57ce540321'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:42.524076 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dd6a9292-ba7b-4fd4-86a1-fdd9fa1c2166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e7a86972a01482caf212f57ce540321'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:42.532875 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:42.573664 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 858/1729] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:53:41 2022] DELETE /identity/v3/users/9e7a86972a01482caf212f57ce540321 => generated 0 bytes in 873 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:53:42.583641 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e751c-ea17-4c61-80f6-4b9731d36519 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:42.585026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e751c-ea17-4c61-80f6-4b9731d36519 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:42.586674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e751c-ea17-4c61-80f6-4b9731d36519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:42.627941 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 872/1730] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:42.647763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3624843-3d41-437b-93ac-8b9045ae4c6d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:42.649588 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a3624843-3d41-437b-93ac-8b9045ae4c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:42.652234 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-046e751c-ea17-4c61-80f6-4b9731d36519 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:42.653598 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-046e751c-ea17-4c61-80f6-4b9731d36519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:42.790229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3624843-3d41-437b-93ac-8b9045ae4c6d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:42.825853 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 859/1731] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:42.857165 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e751c-ea17-4c61-80f6-4b9731d36519 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:42.858913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-046e751c-ea17-4c61-80f6-4b9731d36519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:42.961217 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e1cb7-26d3-4427-b66a-4db4234f6d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:42.966021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e1cb7-26d3-4427-b66a-4db4234f6d67 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:42.966021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e1cb7-26d3-4427-b66a-4db4234f6d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:42.966021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e1cb7-26d3-4427-b66a-4db4234f6d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:42.997107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e1cb7-26d3-4427-b66a-4db4234f6d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:43.002588 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e1cb7-26d3-4427-b66a-4db4234f6d67 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:43.034168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 873/1732] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:43.056040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e751c-ea17-4c61-80f6-4b9731d36519 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:43.079236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63195f8a-9a76-4549-aed6-7aa147fab917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:43.080119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63195f8a-9a76-4549-aed6-7aa147fab917 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:43.080549 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63195f8a-9a76-4549-aed6-7aa147fab917 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:43.081049 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63195f8a-9a76-4549-aed6-7aa147fab917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:43.092707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63195f8a-9a76-4549-aed6-7aa147fab917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:43.094556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63195f8a-9a76-4549-aed6-7aa147fab917 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:43.134020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 860/1733] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:44.262291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:44.292986 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e1cb7-26d3-4427-b66a-4db4234f6d67 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:44.295164 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e34e1cb7-26d3-4427-b66a-4db4234f6d67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:44.326641 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e1cb7-26d3-4427-b66a-4db4234f6d67 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:44.355143 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3491ad-8719-4d52-8e51-6ac4fe9734a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:44.356413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3491ad-8719-4d52-8e51-6ac4fe9734a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:44.357985 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3491ad-8719-4d52-8e51-6ac4fe9734a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:44.358458 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3491ad-8719-4d52-8e51-6ac4fe9734a9 admin admin] PATH_INFO: `/v3/projects/fc51e8794eed4328a0a5d9a72687bd96` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:44.360937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3491ad-8719-4d52-8e51-6ac4fe9734a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc51e8794eed4328a0a5d9a72687bd96)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:44.363989 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3491ad-8719-4d52-8e51-6ac4fe9734a9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:44.696862 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fc3491ad-8719-4d52-8e51-6ac4fe9734a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc51e8794eed4328a0a5d9a72687bd96', 'request_id': 'req-fc3491ad-8719-4d52-8e51-6ac4fe9734a9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:44.906786 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fc3491ad-8719-4d52-8e51-6ac4fe9734a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc51e8794eed4328a0a5d9a72687bd96', 'request_id': 'req-fc3491ad-8719-4d52-8e51-6ac4fe9734a9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:44.928614 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fc3491ad-8719-4d52-8e51-6ac4fe9734a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc51e8794eed4328a0a5d9a72687bd96', 'request_id': 'req-fc3491ad-8719-4d52-8e51-6ac4fe9734a9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:44.960433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fc3491ad-8719-4d52-8e51-6ac4fe9734a9 admin admin] The token cache is being invalidate because project fc51e8794eed4328a0a5d9a72687bd96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:53:44.961027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fc3491ad-8719-4d52-8e51-6ac4fe9734a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:44.964486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fc3491ad-8719-4d52-8e51-6ac4fe9734a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:44.966920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 874/1734] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:53:44 2022] DELETE /identity/v3/projects/fc51e8794eed4328a0a5d9a72687bd96 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:44.971010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63195f8a-9a76-4549-aed6-7aa147fab917 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:44.982957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63195f8a-9a76-4549-aed6-7aa147fab917 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:45.087780 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd9c3f-70cf-4920-a5f1-8edb2715dac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:45.088829 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd9c3f-70cf-4920-a5f1-8edb2715dac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:45.089384 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd9c3f-70cf-4920-a5f1-8edb2715dac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:45.089842 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd9c3f-70cf-4920-a5f1-8edb2715dac8 admin admin] PATH_INFO: `/v3/users/2c23f20ee7aa47319eade600e080379a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:45.091361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd9c3f-70cf-4920-a5f1-8edb2715dac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c23f20ee7aa47319eade600e080379a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:45.093619 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd9c3f-70cf-4920-a5f1-8edb2715dac8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:45.358470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3491ad-8719-4d52-8e51-6ac4fe9734a9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:45.360042 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fc3491ad-8719-4d52-8e51-6ac4fe9734a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:45.369253 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-45fd9c3f-70cf-4920-a5f1-8edb2715dac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c23f20ee7aa47319eade600e080379a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:45.386396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3491ad-8719-4d52-8e51-6ac4fe9734a9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:45.398535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898e75a-ba93-41e3-b882-463c5bbb5497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:45.398535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898e75a-ba93-41e3-b882-463c5bbb5497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:45.398535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898e75a-ba93-41e3-b882-463c5bbb5497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:45.398535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898e75a-ba93-41e3-b882-463c5bbb5497 admin admin] PATH_INFO: `/v3/projects/0d8ff4576b9d46809257874fbc9dae6c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:45.399031 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898e75a-ba93-41e3-b882-463c5bbb5497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8ff4576b9d46809257874fbc9dae6c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:45.401900 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898e75a-ba93-41e3-b882-463c5bbb5497 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:45.490790 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-45fd9c3f-70cf-4920-a5f1-8edb2715dac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c23f20ee7aa47319eade600e080379a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:45.492607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-45fd9c3f-70cf-4920-a5f1-8edb2715dac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c23f20ee7aa47319eade600e080379a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:45.493459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-45fd9c3f-70cf-4920-a5f1-8edb2715dac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c23f20ee7aa47319eade600e080379a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:45.506307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-45fd9c3f-70cf-4920-a5f1-8edb2715dac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c23f20ee7aa47319eade600e080379a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:45.544673 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 861/1735] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:53:44 2022] DELETE /identity/v3/users/2c23f20ee7aa47319eade600e080379a => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:45.671836 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8898e75a-ba93-41e3-b882-463c5bbb5497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8ff4576b9d46809257874fbc9dae6c', 'request_id': 'req-8898e75a-ba93-41e3-b882-463c5bbb5497'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:45.823157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8898e75a-ba93-41e3-b882-463c5bbb5497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8ff4576b9d46809257874fbc9dae6c', 'request_id': 'req-8898e75a-ba93-41e3-b882-463c5bbb5497'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:45.848778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8898e75a-ba93-41e3-b882-463c5bbb5497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8ff4576b9d46809257874fbc9dae6c', 'request_id': 'req-8898e75a-ba93-41e3-b882-463c5bbb5497'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:45.948083 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8898e75a-ba93-41e3-b882-463c5bbb5497 admin admin] The token cache is being invalidate because project 0d8ff4576b9d46809257874fbc9dae6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:53:45.951982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8898e75a-ba93-41e3-b882-463c5bbb5497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:45.954055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8898e75a-ba93-41e3-b882-463c5bbb5497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:45.968245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 875/1736] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:53:45 2022] DELETE /identity/v3/projects/0d8ff4576b9d46809257874fbc9dae6c => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:53:45.973689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd9c3f-70cf-4920-a5f1-8edb2715dac8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:45.973689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-45fd9c3f-70cf-4920-a5f1-8edb2715dac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:46.299029 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd9c3f-70cf-4920-a5f1-8edb2715dac8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:46.618188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d60e05-89f8-41b8-af4a-04c3c52649e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:46.621797 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d60e05-89f8-41b8-af4a-04c3c52649e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:46.622133 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d60e05-89f8-41b8-af4a-04c3c52649e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:46.622423 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d60e05-89f8-41b8-af4a-04c3c52649e8 admin admin] PATH_INFO: `/v3/users/7404d3b06fd44bf8b3d81b69d474fc2f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:46.628773 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d60e05-89f8-41b8-af4a-04c3c52649e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7404d3b06fd44bf8b3d81b69d474fc2f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:46.631353 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d60e05-89f8-41b8-af4a-04c3c52649e8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:47.114425 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:47.119556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b3d60e05-89f8-41b8-af4a-04c3c52649e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7404d3b06fd44bf8b3d81b69d474fc2f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:47.122667 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898e75a-ba93-41e3-b882-463c5bbb5497 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:47.125108 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8898e75a-ba93-41e3-b882-463c5bbb5497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:47.156890 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898e75a-ba93-41e3-b882-463c5bbb5497 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:47.171931 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe698e8-d588-4fa3-8c5e-f0186098dec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:47.183429 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe698e8-d588-4fa3-8c5e-f0186098dec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:47.183726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe698e8-d588-4fa3-8c5e-f0186098dec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:47.184013 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe698e8-d588-4fa3-8c5e-f0186098dec5 admin admin] PATH_INFO: `/v3/projects/4f988354e3364111bc0bc6b4e3e0a6bb` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:47.189102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe698e8-d588-4fa3-8c5e-f0186098dec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f988354e3364111bc0bc6b4e3e0a6bb)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:47.194364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe698e8-d588-4fa3-8c5e-f0186098dec5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:47.216989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b3d60e05-89f8-41b8-af4a-04c3c52649e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7404d3b06fd44bf8b3d81b69d474fc2f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:47.218522 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b3d60e05-89f8-41b8-af4a-04c3c52649e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7404d3b06fd44bf8b3d81b69d474fc2f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:47.220040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b3d60e05-89f8-41b8-af4a-04c3c52649e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7404d3b06fd44bf8b3d81b69d474fc2f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:47.234412 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b3d60e05-89f8-41b8-af4a-04c3c52649e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7404d3b06fd44bf8b3d81b69d474fc2f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:47.268662 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 862/1737] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:53:45 2022] DELETE /identity/v3/users/7404d3b06fd44bf8b3d81b69d474fc2f => generated 0 bytes in 1299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:47.369691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bbe698e8-d588-4fa3-8c5e-f0186098dec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f988354e3364111bc0bc6b4e3e0a6bb', 'request_id': 'req-bbe698e8-d588-4fa3-8c5e-f0186098dec5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:47.452250 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568c993-855c-4a7f-97ee-866b681cb19f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:47.452545 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568c993-855c-4a7f-97ee-866b681cb19f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:47.452808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568c993-855c-4a7f-97ee-866b681cb19f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:47.454561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 863/1738] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 16:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:53:47.462661 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bbe698e8-d588-4fa3-8c5e-f0186098dec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f988354e3364111bc0bc6b4e3e0a6bb', 'request_id': 'req-bbe698e8-d588-4fa3-8c5e-f0186098dec5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:47.477662 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6261aec-1710-4108-bb61-7a180a9f5729 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:47.480875 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6261aec-1710-4108-bb61-7a180a9f5729 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:47.480875 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6261aec-1710-4108-bb61-7a180a9f5729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:47.496172 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bbe698e8-d588-4fa3-8c5e-f0186098dec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f988354e3364111bc0bc6b4e3e0a6bb', 'request_id': 'req-bbe698e8-d588-4fa3-8c5e-f0186098dec5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:47.537556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bbe698e8-d588-4fa3-8c5e-f0186098dec5 admin admin] The token cache is being invalidate because project 4f988354e3364111bc0bc6b4e3e0a6bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:53:47.538670 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f6261aec-1710-4108-bb61-7a180a9f5729 None None] MFA Rules not processed for user `35c9fa9c29494ff9b1f749974dca2719`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:47.542625 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f6261aec-1710-4108-bb61-7a180a9f5729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:47.552104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bbe698e8-d588-4fa3-8c5e-f0186098dec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:47.553633 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bbe698e8-d588-4fa3-8c5e-f0186098dec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:47.564424 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 876/1739] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:53:47 2022] DELETE /identity/v3/projects/4f988354e3364111bc0bc6b4e3e0a6bb => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:47.588375 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17b0f4-4c40-443e-9627-8ebf9fcbd095 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:47.588608 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17b0f4-4c40-443e-9627-8ebf9fcbd095 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:47.588963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17b0f4-4c40-443e-9627-8ebf9fcbd095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:47.635892 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9f17b0f4-4c40-443e-9627-8ebf9fcbd095 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:47.637543 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9f17b0f4-4c40-443e-9627-8ebf9fcbd095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:47.660300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 864/1740] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 16:53:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:47.858506 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 877/1741] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:47.868369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440ae7c-1b04-457d-8230-ef4a375d5d99 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:47.868859 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440ae7c-1b04-457d-8230-ef4a375d5d99 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:47.869366 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440ae7c-1b04-457d-8230-ef4a375d5d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:47.927226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4440ae7c-1b04-457d-8230-ef4a375d5d99 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:47.929302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4440ae7c-1b04-457d-8230-ef4a375d5d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:47.960653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 865/1742] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:47.965715 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17b0f4-4c40-443e-9627-8ebf9fcbd095 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:47.983911 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17b0f4-4c40-443e-9627-8ebf9fcbd095 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:48.014028 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440ae7c-1b04-457d-8230-ef4a375d5d99 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:48.017395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4440ae7c-1b04-457d-8230-ef4a375d5d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:48.020910 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316b7c4-3e9e-40d7-8b51-3d9db6f24db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:48.027451 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316b7c4-3e9e-40d7-8b51-3d9db6f24db4 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:48.027746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316b7c4-3e9e-40d7-8b51-3d9db6f24db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:48.028024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316b7c4-3e9e-40d7-8b51-3d9db6f24db4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:48.036023 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316b7c4-3e9e-40d7-8b51-3d9db6f24db4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:53:48.040356 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316b7c4-3e9e-40d7-8b51-3d9db6f24db4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:48.046657 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316b7c4-3e9e-40d7-8b51-3d9db6f24db4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:48.054570 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440ae7c-1b04-457d-8230-ef4a375d5d99 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:48.064710 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43e0b6-3ef5-459f-bb8e-f6bbc30fd85d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:48.066684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43e0b6-3ef5-459f-bb8e-f6bbc30fd85d service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:48.067581 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43e0b6-3ef5-459f-bb8e-f6bbc30fd85d service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:48.068198 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43e0b6-3ef5-459f-bb8e-f6bbc30fd85d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:48.092092 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43e0b6-3ef5-459f-bb8e-f6bbc30fd85d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:48.093742 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43e0b6-3ef5-459f-bb8e-f6bbc30fd85d service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:48.102417 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 878/1743] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:53:48.103469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316b7c4-3e9e-40d7-8b51-3d9db6f24db4 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:48.127165 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316b7c4-3e9e-40d7-8b51-3d9db6f24db4 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:48.142454 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bf8e8-30dc-4bdc-8f7a-2ce9032e9624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:48.143490 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bf8e8-30dc-4bdc-8f7a-2ce9032e9624 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:48.143791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bf8e8-30dc-4bdc-8f7a-2ce9032e9624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:48.144101 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bf8e8-30dc-4bdc-8f7a-2ce9032e9624 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:48.144824 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bf8e8-30dc-4bdc-8f7a-2ce9032e9624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:48.147406 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 866/1744] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:53:48.149666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bf8e8-30dc-4bdc-8f7a-2ce9032e9624 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:48.184095 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:48.282654 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 879/1745] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:53:48 2022] POST /identity/v3/projects => generated 393 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:48.283683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43e0b6-3ef5-459f-bb8e-f6bbc30fd85d service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:48.304046 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43e0b6-3ef5-459f-bb8e-f6bbc30fd85d service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:48.521094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b87b1d-60b5-471b-9e6d-310a050288dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:48.521094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b87b1d-60b5-471b-9e6d-310a050288dd admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:48.521094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b87b1d-60b5-471b-9e6d-310a050288dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:48.521094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b87b1d-60b5-471b-9e6d-310a050288dd admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:48.522256 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b87b1d-60b5-471b-9e6d-310a050288dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:48.522256 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b87b1d-60b5-471b-9e6d-310a050288dd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:48.796695 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 867/1746] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:53:48 2022] POST /identity/v3/users => generated 297 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:48.802667 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bf8e8-30dc-4bdc-8f7a-2ce9032e9624 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:48.815485 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bf8e8-30dc-4bdc-8f7a-2ce9032e9624 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:48.821498 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8d052-bd53-4ce5-bd1b-6d2b4a8f32c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:48.822295 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8d052-bd53-4ce5-bd1b-6d2b4a8f32c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:48.822696 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8d052-bd53-4ce5-bd1b-6d2b4a8f32c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:48.822936 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8d052-bd53-4ce5-bd1b-6d2b4a8f32c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:48.823741 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8d052-bd53-4ce5-bd1b-6d2b4a8f32c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:48.825985 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8d052-bd53-4ce5-bd1b-6d2b4a8f32c0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:48.848953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 880/1747] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:48.854393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b87b1d-60b5-471b-9e6d-310a050288dd admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:48.872030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b87b1d-60b5-471b-9e6d-310a050288dd admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:48.879201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6ec43-7fdb-46d7-9920-d09499d3fbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:48.880399 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6ec43-7fdb-46d7-9920-d09499d3fbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:48.880697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6ec43-7fdb-46d7-9920-d09499d3fbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:48.881204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6ec43-7fdb-46d7-9920-d09499d3fbb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:48.882359 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6ec43-7fdb-46d7-9920-d09499d3fbb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:48.884120 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6ec43-7fdb-46d7-9920-d09499d3fbb6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:48.898031 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 868/1748] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:48.902897 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8d052-bd53-4ce5-bd1b-6d2b4a8f32c0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:48.913469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8d052-bd53-4ce5-bd1b-6d2b4a8f32c0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:48.918884 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3da0ac-5dbd-41ef-bcff-e440b590910b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:48.919806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3da0ac-5dbd-41ef-bcff-e440b590910b admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:48.920092 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3da0ac-5dbd-41ef-bcff-e440b590910b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:48.920369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3da0ac-5dbd-41ef-bcff-e440b590910b admin admin] PATH_INFO: `/v3/projects/000b9bb72f984691a09d05a6a73869dc/users/60495c12c795470594bda738c795733c/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:48.938143 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3da0ac-5dbd-41ef-bcff-e440b590910b admin admin] RBAC: Authorizing `identity:create_grant(project_id=000b9bb72f984691a09d05a6a73869dc, user_id=60495c12c795470594bda738c795733c, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:48.940977 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3da0ac-5dbd-41ef-bcff-e440b590910b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:49.165313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 881/1749] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:48 2022] PUT /identity/v3/projects/000b9bb72f984691a09d05a6a73869dc/users/60495c12c795470594bda738c795733c/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:49.165950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6ec43-7fdb-46d7-9920-d09499d3fbb6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:49.165950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a1c6ec43-7fdb-46d7-9920-d09499d3fbb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:49.166409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e78258-688e-4671-a603-5a5bd8f4467c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:49.166409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e78258-688e-4671-a603-5a5bd8f4467c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:49.166409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e78258-688e-4671-a603-5a5bd8f4467c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:49.186170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6ec43-7fdb-46d7-9920-d09499d3fbb6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:49.250503 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-49e78258-688e-4671-a603-5a5bd8f4467c None None] MFA Rules not processed for user `60495c12c795470594bda738c795733c`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:49.251863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-49e78258-688e-4671-a603-5a5bd8f4467c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:49.310948 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873ed78-4a36-4a0f-b7a3-f42d83d9308a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:49.311925 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873ed78-4a36-4a0f-b7a3-f42d83d9308a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:49.312224 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873ed78-4a36-4a0f-b7a3-f42d83d9308a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:49.312480 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873ed78-4a36-4a0f-b7a3-f42d83d9308a admin admin] PATH_INFO: `/v3/projects/f39da86efcef466c86f8906d35fc4a4a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:49.313762 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873ed78-4a36-4a0f-b7a3-f42d83d9308a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f39da86efcef466c86f8906d35fc4a4a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:49.315907 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873ed78-4a36-4a0f-b7a3-f42d83d9308a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:49.354094 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 882/1750] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:49.356231 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e78258-688e-4671-a603-5a5bd8f4467c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:49.376683 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e78258-688e-4671-a603-5a5bd8f4467c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:49.382542 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dcae1-3513-44cc-a03d-7a5c4f994331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:49.383220 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dcae1-3513-44cc-a03d-7a5c4f994331 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:49.383507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dcae1-3513-44cc-a03d-7a5c4f994331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:49.383782 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dcae1-3513-44cc-a03d-7a5c4f994331 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:49.384995 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1dcae1-3513-44cc-a03d-7a5c4f994331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:49.390206 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1dcae1-3513-44cc-a03d-7a5c4f994331 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:49.461468 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4873ed78-4a36-4a0f-b7a3-f42d83d9308a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f39da86efcef466c86f8906d35fc4a4a', 'request_id': 'req-4873ed78-4a36-4a0f-b7a3-f42d83d9308a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:49.469650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4873ed78-4a36-4a0f-b7a3-f42d83d9308a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f39da86efcef466c86f8906d35fc4a4a', 'request_id': 'req-4873ed78-4a36-4a0f-b7a3-f42d83d9308a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:49.477016 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4873ed78-4a36-4a0f-b7a3-f42d83d9308a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f39da86efcef466c86f8906d35fc4a4a', 'request_id': 'req-4873ed78-4a36-4a0f-b7a3-f42d83d9308a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:49.536612 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 883/1751] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:53:49 2022] POST /identity/v3/projects => generated 393 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:53:49.541206 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dcae1-3513-44cc-a03d-7a5c4f994331 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:49.561082 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4873ed78-4a36-4a0f-b7a3-f42d83d9308a admin admin] The token cache is being invalidate because project f39da86efcef466c86f8906d35fc4a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:53:49.562317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4873ed78-4a36-4a0f-b7a3-f42d83d9308a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:49.563382 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4873ed78-4a36-4a0f-b7a3-f42d83d9308a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:49.566324 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 869/1752] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:53:49 2022] DELETE /identity/v3/projects/f39da86efcef466c86f8906d35fc4a4a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:49.573878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363b3bf-47a4-410e-a868-7ceb289b8e73 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:49.574373 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363b3bf-47a4-410e-a868-7ceb289b8e73 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:49.574848 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363b3bf-47a4-410e-a868-7ceb289b8e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:49.604007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4363b3bf-47a4-410e-a868-7ceb289b8e73 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:49.605933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4363b3bf-47a4-410e-a868-7ceb289b8e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:49.625840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dcae1-3513-44cc-a03d-7a5c4f994331 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:49.626097 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 870/1753] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:53:49.632029 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d588f-ee98-43a0-95a1-a1a4524d3f53 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:49.632521 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d588f-ee98-43a0-95a1-a1a4524d3f53 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:49.632699 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23730a79-728d-4ba3-a7df-8422c9ffb6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:49.633243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d588f-ee98-43a0-95a1-a1a4524d3f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:49.633768 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23730a79-728d-4ba3-a7df-8422c9ffb6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:49.634302 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23730a79-728d-4ba3-a7df-8422c9ffb6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:49.635279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23730a79-728d-4ba3-a7df-8422c9ffb6f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:49.636302 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23730a79-728d-4ba3-a7df-8422c9ffb6f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:49.639419 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23730a79-728d-4ba3-a7df-8422c9ffb6f9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:49.655290 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-018d588f-ee98-43a0-95a1-a1a4524d3f53 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:49.657994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-018d588f-ee98-43a0-95a1-a1a4524d3f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:49.673068 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 871/1754] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:53:49.677712 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d588f-ee98-43a0-95a1-a1a4524d3f53 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:49.692421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d588f-ee98-43a0-95a1-a1a4524d3f53 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:49.706131 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed4aee-2977-41bc-8f0c-b7b4f265a303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:49.706963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed4aee-2977-41bc-8f0c-b7b4f265a303 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:49.707401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed4aee-2977-41bc-8f0c-b7b4f265a303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:49.707775 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed4aee-2977-41bc-8f0c-b7b4f265a303 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:49.708635 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed4aee-2977-41bc-8f0c-b7b4f265a303 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:53:49.709041 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed4aee-2977-41bc-8f0c-b7b4f265a303 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:49.711010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed4aee-2977-41bc-8f0c-b7b4f265a303 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:49.727935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 872/1755] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:53:49.732455 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed4aee-2977-41bc-8f0c-b7b4f265a303 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:49.747081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed4aee-2977-41bc-8f0c-b7b4f265a303 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:49.754258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e5e1e-84bd-46d9-a747-6f9f0243fc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:49.756528 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e5e1e-84bd-46d9-a747-6f9f0243fc28 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:49.756528 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e5e1e-84bd-46d9-a747-6f9f0243fc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:49.756528 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e5e1e-84bd-46d9-a747-6f9f0243fc28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:49.757135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e5e1e-84bd-46d9-a747-6f9f0243fc28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:49.759195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e5e1e-84bd-46d9-a747-6f9f0243fc28 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:49.802582 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 884/1756] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:53:49 2022] POST /identity/v3/users => generated 303 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:53:49.802582 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23730a79-728d-4ba3-a7df-8422c9ffb6f9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:49.802582 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-23730a79-728d-4ba3-a7df-8422c9ffb6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:49.809547 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23730a79-728d-4ba3-a7df-8422c9ffb6f9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:49.815487 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08675d44-9b6e-4a57-b095-4ed2e8b53291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:49.816198 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08675d44-9b6e-4a57-b095-4ed2e8b53291 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:49.816485 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08675d44-9b6e-4a57-b095-4ed2e8b53291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:49.816760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08675d44-9b6e-4a57-b095-4ed2e8b53291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:49.817531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08675d44-9b6e-4a57-b095-4ed2e8b53291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:49.819523 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08675d44-9b6e-4a57-b095-4ed2e8b53291 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:49.835400 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 885/1757] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:53:49.836471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08675d44-9b6e-4a57-b095-4ed2e8b53291 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:49.847168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08675d44-9b6e-4a57-b095-4ed2e8b53291 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:49.852151 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0fec5-e424-47a0-8e02-c69f48378c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:49.853059 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0fec5-e424-47a0-8e02-c69f48378c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:49.853372 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0fec5-e424-47a0-8e02-c69f48378c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:49.853655 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0fec5-e424-47a0-8e02-c69f48378c53 admin admin] PATH_INFO: `/v3/projects/27d2a8190ec84a4e8bd5c42df4318700/users/d00bd780eb3d47759fbde93046fa7709/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:49.871155 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0fec5-e424-47a0-8e02-c69f48378c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d2a8190ec84a4e8bd5c42df4318700, user_id=d00bd780eb3d47759fbde93046fa7709, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:49.874549 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0fec5-e424-47a0-8e02-c69f48378c53 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:49.964574 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 873/1758] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:53:49 2022] POST /identity/v3/projects => generated 367 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:53:49.965789 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e5e1e-84bd-46d9-a747-6f9f0243fc28 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:49.989601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 886/1759] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:49 2022] PUT /identity/v3/projects/27d2a8190ec84a4e8bd5c42df4318700/users/d00bd780eb3d47759fbde93046fa7709/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:53:49.996145 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0fec5-e424-47a0-8e02-c69f48378c53 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:50.045937 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e5e1e-84bd-46d9-a747-6f9f0243fc28 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:50.099976 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0fec5-e424-47a0-8e02-c69f48378c53 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:50.105409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08f971-c45b-4357-bc42-4a34e68ff3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:50.111328 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08f971-c45b-4357-bc42-4a34e68ff3fd admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.111328 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08f971-c45b-4357-bc42-4a34e68ff3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.111328 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08f971-c45b-4357-bc42-4a34e68ff3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.111328 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08f971-c45b-4357-bc42-4a34e68ff3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:50.111328 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08f971-c45b-4357-bc42-4a34e68ff3fd admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:50.116129 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bc7fd-3d9c-4d29-8c2b-0fac27062d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:50.116822 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bc7fd-3d9c-4d29-8c2b-0fac27062d11 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.117184 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bc7fd-3d9c-4d29-8c2b-0fac27062d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.117641 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bc7fd-3d9c-4d29-8c2b-0fac27062d11 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.118336 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bc7fd-3d9c-4d29-8c2b-0fac27062d11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:50.120832 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bc7fd-3d9c-4d29-8c2b-0fac27062d11 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:50.122039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 887/1760] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:50.126235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08f971-c45b-4357-bc42-4a34e68ff3fd admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:50.138768 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08f971-c45b-4357-bc42-4a34e68ff3fd admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:50.146273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e27385-ff51-4c67-b1f6-644bec14a4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:50.147375 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e27385-ff51-4c67-b1f6-644bec14a4f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.147665 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e27385-ff51-4c67-b1f6-644bec14a4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.147937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e27385-ff51-4c67-b1f6-644bec14a4f5 admin admin] PATH_INFO: `/v3/projects/27d2a8190ec84a4e8bd5c42df4318700/users/d00bd780eb3d47759fbde93046fa7709/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.151123 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e27385-ff51-4c67-b1f6-644bec14a4f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d2a8190ec84a4e8bd5c42df4318700, user_id=d00bd780eb3d47759fbde93046fa7709, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:50.154363 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e27385-ff51-4c67-b1f6-644bec14a4f5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:50.168154 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 888/1761] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:50 2022] PUT /identity/v3/projects/27d2a8190ec84a4e8bd5c42df4318700/users/d00bd780eb3d47759fbde93046fa7709/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:53:50.180977 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca73ce1-283a-4070-9286-343fd5c61aa5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.181290 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca73ce1-283a-4070-9286-343fd5c61aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.182180 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca73ce1-283a-4070-9286-343fd5c61aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.222064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:50.225671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4ca73ce1-283a-4070-9286-343fd5c61aa5 None None] MFA Rules not processed for user `d00bd780eb3d47759fbde93046fa7709`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:50.227725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4ca73ce1-283a-4070-9286-343fd5c61aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:50.288708 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 874/1762] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:53:49 2022] POST /identity/v3/users => generated 284 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:53:50.293833 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bc7fd-3d9c-4d29-8c2b-0fac27062d11 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:50.308643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bc7fd-3d9c-4d29-8c2b-0fac27062d11 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:50.368192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 889/1763] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:50.385152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca73ce1-283a-4070-9286-343fd5c61aa5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:50.389016 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4ca73ce1-283a-4070-9286-343fd5c61aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:50.433556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fcd8a-53f9-49d6-8c9a-5ae78411fb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:50.434327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fcd8a-53f9-49d6-8c9a-5ae78411fb79 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.435912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fcd8a-53f9-49d6-8c9a-5ae78411fb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.435912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fcd8a-53f9-49d6-8c9a-5ae78411fb79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.435912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fcd8a-53f9-49d6-8c9a-5ae78411fb79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:50.437769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fcd8a-53f9-49d6-8c9a-5ae78411fb79 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:50.452276 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 875/1764] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:50.456314 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fcd8a-53f9-49d6-8c9a-5ae78411fb79 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:50.478922 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fcd8a-53f9-49d6-8c9a-5ae78411fb79 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:50.496108 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4aa7c-682c-4840-9e87-604013c05979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:50.497144 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4aa7c-682c-4840-9e87-604013c05979 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.497412 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4aa7c-682c-4840-9e87-604013c05979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.498680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4aa7c-682c-4840-9e87-604013c05979 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.499511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4aa7c-682c-4840-9e87-604013c05979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:50.505043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4aa7c-682c-4840-9e87-604013c05979 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:50.537354 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 876/1765] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:53:50.537561 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca73ce1-283a-4070-9286-343fd5c61aa5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:50.538235 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4aa7c-682c-4840-9e87-604013c05979 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:50.550485 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4aa7c-682c-4840-9e87-604013c05979 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:50.550709 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cabd9-8ba7-43d0-b8c7-bb31623b26e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:50.553240 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cabd9-8ba7-43d0-b8c7-bb31623b26e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.554361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cabd9-8ba7-43d0-b8c7-bb31623b26e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.555140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cabd9-8ba7-43d0-b8c7-bb31623b26e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.556349 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e460fc-8ba2-49a3-8ce3-80c03f66759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:50.557499 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e460fc-8ba2-49a3-8ce3-80c03f66759e admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.557784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e460fc-8ba2-49a3-8ce3-80c03f66759e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.558064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e460fc-8ba2-49a3-8ce3-80c03f66759e admin admin] PATH_INFO: `/v3/projects/1fc301980e7d4de1bfe333caf035f842/users/7551679e272c447da5e0596015960e8c/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.584492 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261cabd9-8ba7-43d0-b8c7-bb31623b26e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:50.592213 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e460fc-8ba2-49a3-8ce3-80c03f66759e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fc301980e7d4de1bfe333caf035f842, user_id=7551679e272c447da5e0596015960e8c, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:50.597162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261cabd9-8ba7-43d0-b8c7-bb31623b26e9 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:50.600648 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e460fc-8ba2-49a3-8ce3-80c03f66759e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:50.621407 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 890/1766] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:50.695091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cabd9-8ba7-43d0-b8c7-bb31623b26e9 service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:50.700976 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-261cabd9-8ba7-43d0-b8c7-bb31623b26e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:50.712611 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cabd9-8ba7-43d0-b8c7-bb31623b26e9 service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:50.717223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfcdc7-5db5-485e-9d5d-88d18e53ed5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:50.717970 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfcdc7-5db5-485e-9d5d-88d18e53ed5f service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.718255 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfcdc7-5db5-485e-9d5d-88d18e53ed5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.718533 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfcdc7-5db5-485e-9d5d-88d18e53ed5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.720750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1acfcdc7-5db5-485e-9d5d-88d18e53ed5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:50.736263 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 877/1767] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:50 2022] PUT /identity/v3/projects/1fc301980e7d4de1bfe333caf035f842/users/7551679e272c447da5e0596015960e8c/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:50.747013 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b9513-c4d4-44d7-837a-10310d9e29ff None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.747293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b9513-c4d4-44d7-837a-10310d9e29ff None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.747572 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b9513-c4d4-44d7-837a-10310d9e29ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.776862 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-783b9513-c4d4-44d7-837a-10310d9e29ff None None] MFA Rules not processed for user `7551679e272c447da5e0596015960e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:50.778167 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-783b9513-c4d4-44d7-837a-10310d9e29ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:50.788286 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfcdc7-5db5-485e-9d5d-88d18e53ed5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:50.790379 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfcdc7-5db5-485e-9d5d-88d18e53ed5f service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:50.801989 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 891/1768] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:53:50.852159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 878/1769] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:53:50.856787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfcdc7-5db5-485e-9d5d-88d18e53ed5f service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:50.870470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfcdc7-5db5-485e-9d5d-88d18e53ed5f service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:50.985359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906349ef-9dd4-430c-9034-afd2ca69fda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:50.988802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906349ef-9dd4-430c-9034-afd2ca69fda2 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.988802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906349ef-9dd4-430c-9034-afd2ca69fda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.988802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906349ef-9dd4-430c-9034-afd2ca69fda2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.988802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906349ef-9dd4-430c-9034-afd2ca69fda2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:50.990900 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906349ef-9dd4-430c-9034-afd2ca69fda2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:51.131752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 892/1770] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:53:50 2022] POST /identity/v3/projects => generated 367 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:51.135263 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b9513-c4d4-44d7-837a-10310d9e29ff None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:51.148169 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b9513-c4d4-44d7-837a-10310d9e29ff None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:51.207771 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5183fc-8eff-4b52-a644-b9ee62f4a481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:51.208465 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5183fc-8eff-4b52-a644-b9ee62f4a481 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:51.208772 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5183fc-8eff-4b52-a644-b9ee62f4a481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:51.209045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5183fc-8eff-4b52-a644-b9ee62f4a481 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:51.209779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5183fc-8eff-4b52-a644-b9ee62f4a481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:51.211700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5183fc-8eff-4b52-a644-b9ee62f4a481 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:51.325963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 879/1771] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:53:51 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:53:51.330584 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906349ef-9dd4-430c-9034-afd2ca69fda2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:51.340424 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906349ef-9dd4-430c-9034-afd2ca69fda2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:51.345604 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956ae22-aa90-4f2e-849e-62b7ffd96db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:51.346368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956ae22-aa90-4f2e-849e-62b7ffd96db3 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:51.346647 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956ae22-aa90-4f2e-849e-62b7ffd96db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:51.346925 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956ae22-aa90-4f2e-849e-62b7ffd96db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:51.347656 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956ae22-aa90-4f2e-849e-62b7ffd96db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:51.349251 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956ae22-aa90-4f2e-849e-62b7ffd96db3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:51.364575 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 893/1772] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:51.365857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5183fc-8eff-4b52-a644-b9ee62f4a481 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:51.377012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5183fc-8eff-4b52-a644-b9ee62f4a481 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:51.381998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbcbc3-f05e-48c4-a59b-8b6973472a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:51.382892 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbcbc3-f05e-48c4-a59b-8b6973472a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:51.383173 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbcbc3-f05e-48c4-a59b-8b6973472a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:51.383451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbcbc3-f05e-48c4-a59b-8b6973472a53 admin admin] PATH_INFO: `/v3/projects/6977e64977864159aae436dc56ba26ac/users/748380ae149b41c6aff43a1289a27289/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:51.399842 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebbcbc3-f05e-48c4-a59b-8b6973472a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6977e64977864159aae436dc56ba26ac, user_id=748380ae149b41c6aff43a1289a27289, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:51.403254 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebbcbc3-f05e-48c4-a59b-8b6973472a53 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:51.526440 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 880/1773] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:51 2022] PUT /identity/v3/projects/6977e64977864159aae436dc56ba26ac/users/748380ae149b41c6aff43a1289a27289/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:51.532072 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956ae22-aa90-4f2e-849e-62b7ffd96db3 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:51.543170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956ae22-aa90-4f2e-849e-62b7ffd96db3 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:51.606576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b04b5-c021-4166-b2b8-1919fec472a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:51.607282 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b04b5-c021-4166-b2b8-1919fec472a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:51.607566 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b04b5-c021-4166-b2b8-1919fec472a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:51.607838 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b04b5-c021-4166-b2b8-1919fec472a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:51.608611 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b04b5-c021-4166-b2b8-1919fec472a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:51.610247 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b04b5-c021-4166-b2b8-1919fec472a4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:51.626480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 894/1774] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:51.628000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbcbc3-f05e-48c4-a59b-8b6973472a53 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:51.641067 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbcbc3-f05e-48c4-a59b-8b6973472a53 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:51.646283 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd05a6d-152f-48e1-a804-952791b1e9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:51.649306 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd05a6d-152f-48e1-a804-952791b1e9cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:51.649306 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd05a6d-152f-48e1-a804-952791b1e9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:51.649306 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd05a6d-152f-48e1-a804-952791b1e9cf admin admin] PATH_INFO: `/v3/projects/6977e64977864159aae436dc56ba26ac/users/748380ae149b41c6aff43a1289a27289/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:51.650860 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd05a6d-152f-48e1-a804-952791b1e9cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6977e64977864159aae436dc56ba26ac, user_id=748380ae149b41c6aff43a1289a27289, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:51.656319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd05a6d-152f-48e1-a804-952791b1e9cf admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:51.670183 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 881/1775] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:53:51 2022] PUT /identity/v3/projects/6977e64977864159aae436dc56ba26ac/users/748380ae149b41c6aff43a1289a27289/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:51.681860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97582a09-f53a-4089-83ce-b03c3c3c270f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:51.682147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97582a09-f53a-4089-83ce-b03c3c3c270f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:51.683523 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97582a09-f53a-4089-83ce-b03c3c3c270f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:51.790568 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-97582a09-f53a-4089-83ce-b03c3c3c270f None None] MFA Rules not processed for user `748380ae149b41c6aff43a1289a27289`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:51.794245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-97582a09-f53a-4089-83ce-b03c3c3c270f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:51.924374 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 895/1776] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:51 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:51.968567 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd05a6d-152f-48e1-a804-952791b1e9cf admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:52.073499 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd05a6d-152f-48e1-a804-952791b1e9cf admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:52.078086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e84679-3711-411a-9d0e-20b8d4349cce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:52.078901 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e84679-3711-411a-9d0e-20b8d4349cce service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:52.079294 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e84679-3711-411a-9d0e-20b8d4349cce service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:52.079678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e84679-3711-411a-9d0e-20b8d4349cce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:52.085143 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:52.096097 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e84679-3711-411a-9d0e-20b8d4349cce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:52.097838 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e84679-3711-411a-9d0e-20b8d4349cce service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:52.126467 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 882/1777] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:51 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:52.516119 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97582a09-f53a-4089-83ce-b03c3c3c270f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:52.527396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97582a09-f53a-4089-83ce-b03c3c3c270f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:52.533010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bd1ad-fd87-4cde-a8d0-c9314b139b3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:52.534128 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bd1ad-fd87-4cde-a8d0-c9314b139b3a service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:52.534431 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bd1ad-fd87-4cde-a8d0-c9314b139b3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:52.535013 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bd1ad-fd87-4cde-a8d0-c9314b139b3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:52.605719 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bd1ad-fd87-4cde-a8d0-c9314b139b3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:52.607363 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bd1ad-fd87-4cde-a8d0-c9314b139b3a service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:52.618330 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 896/1778] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:53:53.303523 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:55.383053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e84679-3711-411a-9d0e-20b8d4349cce service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:55.387520 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-24e84679-3711-411a-9d0e-20b8d4349cce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:55.611472 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e84679-3711-411a-9d0e-20b8d4349cce service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:55.627055 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a8332-f086-4f0d-800f-5245d35a9e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:55.630051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a8332-f086-4f0d-800f-5245d35a9e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:55.630778 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a8332-f086-4f0d-800f-5245d35a9e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:55.632845 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a8332-f086-4f0d-800f-5245d35a9e52 admin admin] PATH_INFO: `/v3/users/ed707c3fb31b4c3fa804651b8bff298e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:55.636515 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a8332-f086-4f0d-800f-5245d35a9e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed707c3fb31b4c3fa804651b8bff298e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:55.645685 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a8332-f086-4f0d-800f-5245d35a9e52 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:55.940444 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a31a8332-f086-4f0d-800f-5245d35a9e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed707c3fb31b4c3fa804651b8bff298e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:56.124953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a31a8332-f086-4f0d-800f-5245d35a9e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed707c3fb31b4c3fa804651b8bff298e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:56.125917 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a31a8332-f086-4f0d-800f-5245d35a9e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed707c3fb31b4c3fa804651b8bff298e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:56.126869 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a31a8332-f086-4f0d-800f-5245d35a9e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed707c3fb31b4c3fa804651b8bff298e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:56.136183 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a31a8332-f086-4f0d-800f-5245d35a9e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed707c3fb31b4c3fa804651b8bff298e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:56.154256 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 883/1779] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:53:55 2022] DELETE /identity/v3/users/ed707c3fb31b4c3fa804651b8bff298e => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:56.158873 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cd2bc-9754-4fc7-a88c-38bb544f672e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:56.159385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cd2bc-9754-4fc7-a88c-38bb544f672e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:56.159499 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cd2bc-9754-4fc7-a88c-38bb544f672e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:56.184806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c44cd2bc-9754-4fc7-a88c-38bb544f672e None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:56.186965 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c44cd2bc-9754-4fc7-a88c-38bb544f672e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:56.270369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 897/1780] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:56.280630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a8332-f086-4f0d-800f-5245d35a9e52 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:56.282605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a31a8332-f086-4f0d-800f-5245d35a9e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:56.382556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a8332-f086-4f0d-800f-5245d35a9e52 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:56.387649 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570ca5c-6d04-4c06-92d2-dfa900ad8251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:56.388332 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570ca5c-6d04-4c06-92d2-dfa900ad8251 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:56.388978 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570ca5c-6d04-4c06-92d2-dfa900ad8251 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:56.389286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570ca5c-6d04-4c06-92d2-dfa900ad8251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:56.399373 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570ca5c-6d04-4c06-92d2-dfa900ad8251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:56.405634 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570ca5c-6d04-4c06-92d2-dfa900ad8251 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:56.426048 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 884/1781] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:53:56.439255 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:57.086571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cd2bc-9754-4fc7-a88c-38bb544f672e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:57.089324 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c44cd2bc-9754-4fc7-a88c-38bb544f672e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:57.111537 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cd2bc-9754-4fc7-a88c-38bb544f672e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:57.120958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15787736-8395-44ef-8551-1721f2f69be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:57.122969 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15787736-8395-44ef-8551-1721f2f69be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:57.123799 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15787736-8395-44ef-8551-1721f2f69be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:57.129010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15787736-8395-44ef-8551-1721f2f69be9 admin admin] PATH_INFO: `/v3/projects/49d16e13fcbb43d48c8aa17eeeb77721` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:57.133193 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15787736-8395-44ef-8551-1721f2f69be9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d16e13fcbb43d48c8aa17eeeb77721)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:57.138200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15787736-8395-44ef-8551-1721f2f69be9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:57.387308 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-15787736-8395-44ef-8551-1721f2f69be9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d16e13fcbb43d48c8aa17eeeb77721', 'request_id': 'req-15787736-8395-44ef-8551-1721f2f69be9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:57.532258 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-15787736-8395-44ef-8551-1721f2f69be9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d16e13fcbb43d48c8aa17eeeb77721', 'request_id': 'req-15787736-8395-44ef-8551-1721f2f69be9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:57.541880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-15787736-8395-44ef-8551-1721f2f69be9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d16e13fcbb43d48c8aa17eeeb77721', 'request_id': 'req-15787736-8395-44ef-8551-1721f2f69be9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:57.554488 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-15787736-8395-44ef-8551-1721f2f69be9 admin admin] The token cache is being invalidate because project 49d16e13fcbb43d48c8aa17eeeb77721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:53:57.554776 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-15787736-8395-44ef-8551-1721f2f69be9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:57.555668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-15787736-8395-44ef-8551-1721f2f69be9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:57.561002 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 898/1782] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:53:57 2022] DELETE /identity/v3/projects/49d16e13fcbb43d48c8aa17eeeb77721 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:57.562328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570ca5c-6d04-4c06-92d2-dfa900ad8251 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:57.574652 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570ca5c-6d04-4c06-92d2-dfa900ad8251 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:57.658993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ddd62-ddaa-4074-bf74-dc3b3f51201f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:57.661690 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ddd62-ddaa-4074-bf74-dc3b3f51201f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:57.662026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ddd62-ddaa-4074-bf74-dc3b3f51201f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:57.662314 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ddd62-ddaa-4074-bf74-dc3b3f51201f admin admin] PATH_INFO: `/v3/users/0bbf65c082b340fa8c73871f2134b4a2` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:57.664291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ddd62-ddaa-4074-bf74-dc3b3f51201f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bbf65c082b340fa8c73871f2134b4a2)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:57.667736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ddd62-ddaa-4074-bf74-dc3b3f51201f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:57.943374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a11ddd62-ddaa-4074-bf74-dc3b3f51201f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bbf65c082b340fa8c73871f2134b4a2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:58.027724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a11ddd62-ddaa-4074-bf74-dc3b3f51201f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bbf65c082b340fa8c73871f2134b4a2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:58.028593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a11ddd62-ddaa-4074-bf74-dc3b3f51201f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bbf65c082b340fa8c73871f2134b4a2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:58.029348 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a11ddd62-ddaa-4074-bf74-dc3b3f51201f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bbf65c082b340fa8c73871f2134b4a2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:58.039443 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a11ddd62-ddaa-4074-bf74-dc3b3f51201f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bbf65c082b340fa8c73871f2134b4a2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:58.067658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 885/1783] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:53:57 2022] DELETE /identity/v3/users/0bbf65c082b340fa8c73871f2134b4a2 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:58.656351 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15787736-8395-44ef-8551-1721f2f69be9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:58.659546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:58.661748 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-15787736-8395-44ef-8551-1721f2f69be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:58.701974 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15787736-8395-44ef-8551-1721f2f69be9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:58.722900 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ddd62-ddaa-4074-bf74-dc3b3f51201f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:58.730820 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a11ddd62-ddaa-4074-bf74-dc3b3f51201f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:58.914419 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ddd62-ddaa-4074-bf74-dc3b3f51201f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:58.922225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac50bee-e64b-443c-85fc-e9236bffff25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:58.923382 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac50bee-e64b-443c-85fc-e9236bffff25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:58.923669 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac50bee-e64b-443c-85fc-e9236bffff25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:58.925930 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac50bee-e64b-443c-85fc-e9236bffff25 admin admin] PATH_INFO: `/v3/projects/a3edce6120704c86b3b15e2015691ded` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:58.925930 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac50bee-e64b-443c-85fc-e9236bffff25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3edce6120704c86b3b15e2015691ded)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:58.927549 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac50bee-e64b-443c-85fc-e9236bffff25 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:58.965204 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833cd67-f9c3-426e-908b-7f96d6450206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:58.967335 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833cd67-f9c3-426e-908b-7f96d6450206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:58.967862 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833cd67-f9c3-426e-908b-7f96d6450206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:58.968434 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833cd67-f9c3-426e-908b-7f96d6450206 admin admin] PATH_INFO: `/v3/users/60495c12c795470594bda738c795733c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:58.971419 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833cd67-f9c3-426e-908b-7f96d6450206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60495c12c795470594bda738c795733c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:58.978055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833cd67-f9c3-426e-908b-7f96d6450206 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:59.084995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4ac50bee-e64b-443c-85fc-e9236bffff25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3edce6120704c86b3b15e2015691ded', 'request_id': 'req-4ac50bee-e64b-443c-85fc-e9236bffff25'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:59.093651 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4ac50bee-e64b-443c-85fc-e9236bffff25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3edce6120704c86b3b15e2015691ded', 'request_id': 'req-4ac50bee-e64b-443c-85fc-e9236bffff25'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:59.101719 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4ac50bee-e64b-443c-85fc-e9236bffff25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3edce6120704c86b3b15e2015691ded', 'request_id': 'req-4ac50bee-e64b-443c-85fc-e9236bffff25'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:59.248420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4ac50bee-e64b-443c-85fc-e9236bffff25 admin admin] The token cache is being invalidate because project a3edce6120704c86b3b15e2015691ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:53:59.249239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4ac50bee-e64b-443c-85fc-e9236bffff25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:59.250242 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4ac50bee-e64b-443c-85fc-e9236bffff25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:59.252444 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 886/1784] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:53:58 2022] DELETE /identity/v3/projects/a3edce6120704c86b3b15e2015691ded => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:59.263136 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f3621-af5a-4a52-ba34-b7994b498f17 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:59.263665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f3621-af5a-4a52-ba34-b7994b498f17 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:59.264123 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f3621-af5a-4a52-ba34-b7994b498f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:59.307628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-122f3621-af5a-4a52-ba34-b7994b498f17 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:59.309440 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-122f3621-af5a-4a52-ba34-b7994b498f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:59.344816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a833cd67-f9c3-426e-908b-7f96d6450206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60495c12c795470594bda738c795733c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:59.345681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a833cd67-f9c3-426e-908b-7f96d6450206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60495c12c795470594bda738c795733c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:59.361833 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a833cd67-f9c3-426e-908b-7f96d6450206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60495c12c795470594bda738c795733c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:59.409500 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 887/1785] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:59.411423 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c8488-3fe2-42d9-b416-fcfc12b0236f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:59.411706 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c8488-3fe2-42d9-b416-fcfc12b0236f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:59.411981 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c8488-3fe2-42d9-b416-fcfc12b0236f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:59.413379 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 888/1786] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 16:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:53:59.420645 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35bce5-3998-41c2-a14c-aeaf5565a0be None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:59.421021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35bce5-3998-41c2-a14c-aeaf5565a0be None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:59.421410 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35bce5-3998-41c2-a14c-aeaf5565a0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:59.438769 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a833cd67-f9c3-426e-908b-7f96d6450206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60495c12c795470594bda738c795733c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:59.443163 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a833cd67-f9c3-426e-908b-7f96d6450206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60495c12c795470594bda738c795733c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:59.449439 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5f35bce5-3998-41c2-a14c-aeaf5565a0be None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:59.449439 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5f35bce5-3998-41c2-a14c-aeaf5565a0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:59.473998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 889/1787] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:53:59.477931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564d530-d49f-428f-afe1-253899f800a0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:59.477931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564d530-d49f-428f-afe1-253899f800a0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:59.478744 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564d530-d49f-428f-afe1-253899f800a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:59.492203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 899/1788] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:53:58 2022] DELETE /identity/v3/users/60495c12c795470594bda738c795733c => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:59.493776 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833cd67-f9c3-426e-908b-7f96d6450206 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:59.515170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8564d530-d49f-428f-afe1-253899f800a0 None None] MFA Rules not processed for user `35c9fa9c29494ff9b1f749974dca2719`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:59.515434 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8564d530-d49f-428f-afe1-253899f800a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:59.615359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833cd67-f9c3-426e-908b-7f96d6450206 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:59.622316 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbb7dd-54cc-495c-ae2b-25691d3df3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:59.623137 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbb7dd-54cc-495c-ae2b-25691d3df3bd admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:59.623476 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbb7dd-54cc-495c-ae2b-25691d3df3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:59.623762 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbb7dd-54cc-495c-ae2b-25691d3df3bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:59.625203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbb7dd-54cc-495c-ae2b-25691d3df3bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:53:59.625570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbb7dd-54cc-495c-ae2b-25691d3df3bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:59.627315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbb7dd-54cc-495c-ae2b-25691d3df3bd admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:59.632877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 890/1789] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 16:53:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:59.634576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e3b59-ad5c-4126-94bc-ab395006761d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:59.635097 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e3b59-ad5c-4126-94bc-ab395006761d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:59.635518 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e3b59-ad5c-4126-94bc-ab395006761d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:59.659081 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 900/1790] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:53:59.659081 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbb7dd-54cc-495c-ae2b-25691d3df3bd admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:59.668291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b75e3b59-ad5c-4126-94bc-ab395006761d None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:59.671481 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b75e3b59-ad5c-4126-94bc-ab395006761d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:59.672524 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbb7dd-54cc-495c-ae2b-25691d3df3bd admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:59.677922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecd1db-9154-4fd6-82dd-107c39050fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:59.678623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecd1db-9154-4fd6-82dd-107c39050fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:59.679041 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecd1db-9154-4fd6-82dd-107c39050fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:59.679315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecd1db-9154-4fd6-82dd-107c39050fe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:59.680496 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ecd1db-9154-4fd6-82dd-107c39050fe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:59.682136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ecd1db-9154-4fd6-82dd-107c39050fe0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:59.685920 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 891/1791] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:59.690442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e3b59-ad5c-4126-94bc-ab395006761d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:59.692674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b75e3b59-ad5c-4126-94bc-ab395006761d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:59.722477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e3b59-ad5c-4126-94bc-ab395006761d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:59.733816 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06d758-3605-4bf5-b349-4276de113ec5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:59.735057 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06d758-3605-4bf5-b349-4276de113ec5 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:59.735563 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06d758-3605-4bf5-b349-4276de113ec5 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:59.737075 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06d758-3605-4bf5-b349-4276de113ec5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:59.755387 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06d758-3605-4bf5-b349-4276de113ec5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:59.760175 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06d758-3605-4bf5-b349-4276de113ec5 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:59.788878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 892/1792] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:59.792895 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06d758-3605-4bf5-b349-4276de113ec5 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:59.795524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7f06d758-3605-4bf5-b349-4276de113ec5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:59.801175 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 901/1793] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:53:59 2022] POST /identity/v3/projects => generated 365 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:59.808020 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecd1db-9154-4fd6-82dd-107c39050fe0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:59.947583 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:59.968845 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06d758-3605-4bf5-b349-4276de113ec5 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:00.002007 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecd1db-9154-4fd6-82dd-107c39050fe0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:00.009846 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f4750-854f-4332-b992-2d92512bc2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:00.011122 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f4750-854f-4332-b992-2d92512bc2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:00.011600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f4750-854f-4332-b992-2d92512bc2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:00.012093 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f4750-854f-4332-b992-2d92512bc2a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:00.013807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f4750-854f-4332-b992-2d92512bc2a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:00.016180 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f4750-854f-4332-b992-2d92512bc2a6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:00.107337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3fd8f-7ee7-4dc7-90f4-7421d924f445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:00.109599 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3fd8f-7ee7-4dc7-90f4-7421d924f445 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:00.110529 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3fd8f-7ee7-4dc7-90f4-7421d924f445 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:00.111454 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3fd8f-7ee7-4dc7-90f4-7421d924f445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:00.123442 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 902/1794] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:53:59 2022] POST /identity/v3/users => generated 283 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:54:00.127335 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f4750-854f-4332-b992-2d92512bc2a6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:00.135128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3fd8f-7ee7-4dc7-90f4-7421d924f445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:00.146835 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3fd8f-7ee7-4dc7-90f4-7421d924f445 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:00.154247 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f4750-854f-4332-b992-2d92512bc2a6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:00.160009 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 893/1795] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:53:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:00.166881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79371d-b73a-4212-a189-946b82d36860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:00.167768 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79371d-b73a-4212-a189-946b82d36860 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:00.168056 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79371d-b73a-4212-a189-946b82d36860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:00.168521 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79371d-b73a-4212-a189-946b82d36860 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:00.169329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79371d-b73a-4212-a189-946b82d36860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:00.171422 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79371d-b73a-4212-a189-946b82d36860 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:00.188881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 903/1796] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:00.192882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3fd8f-7ee7-4dc7-90f4-7421d924f445 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:00.208091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3fd8f-7ee7-4dc7-90f4-7421d924f445 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:00.221345 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4dda2-3790-4d75-98f6-4f3893889c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:00.222405 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4dda2-3790-4d75-98f6-4f3893889c4d admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:00.222915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4dda2-3790-4d75-98f6-4f3893889c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:00.223238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4dda2-3790-4d75-98f6-4f3893889c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:00.224499 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a4dda2-3790-4d75-98f6-4f3893889c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:00.227930 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a4dda2-3790-4d75-98f6-4f3893889c4d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:00.249854 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 894/1797] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:54:00.254984 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79371d-b73a-4212-a189-946b82d36860 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:00.269152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79371d-b73a-4212-a189-946b82d36860 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:00.275744 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fae05c-51cf-485b-9455-6b5dc0547ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:00.277814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fae05c-51cf-485b-9455-6b5dc0547ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:00.278062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fae05c-51cf-485b-9455-6b5dc0547ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:00.278334 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fae05c-51cf-485b-9455-6b5dc0547ea0 admin admin] PATH_INFO: `/v3/projects/d90d0c7518e244b1b81401000646c61e/users/ef8e816182d948669afd46bb6a4f8bc4/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:00.310812 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fae05c-51cf-485b-9455-6b5dc0547ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90d0c7518e244b1b81401000646c61e, user_id=ef8e816182d948669afd46bb6a4f8bc4, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:00.313974 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fae05c-51cf-485b-9455-6b5dc0547ea0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:00.432970 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 904/1798] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:54:00 2022] PUT /identity/v3/projects/d90d0c7518e244b1b81401000646c61e/users/ef8e816182d948669afd46bb6a4f8bc4/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:00.443481 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7521ba-7eb6-48a8-8f3d-b1558a30bbb8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:00.443842 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7521ba-7eb6-48a8-8f3d-b1558a30bbb8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:00.444190 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7521ba-7eb6-48a8-8f3d-b1558a30bbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:00.530628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4a7521ba-7eb6-48a8-8f3d-b1558a30bbb8 None None] MFA Rules not processed for user `ef8e816182d948669afd46bb6a4f8bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:00.532245 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4a7521ba-7eb6-48a8-8f3d-b1558a30bbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:00.749392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 895/1799] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:00.754165 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fae05c-51cf-485b-9455-6b5dc0547ea0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:00.872674 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fae05c-51cf-485b-9455-6b5dc0547ea0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:00.886377 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f684b7-5816-44ee-9cf7-0823afd560b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:00.888083 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f684b7-5816-44ee-9cf7-0823afd560b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:00.888820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f684b7-5816-44ee-9cf7-0823afd560b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:00.890026 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f684b7-5816-44ee-9cf7-0823afd560b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:00.892293 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f684b7-5816-44ee-9cf7-0823afd560b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:00.897687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f684b7-5816-44ee-9cf7-0823afd560b2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:01.046336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 905/1800] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:54:00 2022] POST /identity/v3/projects => generated 365 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:01.050985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7521ba-7eb6-48a8-8f3d-b1558a30bbb8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:01.063077 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7521ba-7eb6-48a8-8f3d-b1558a30bbb8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:01.156997 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2860d-3441-4728-8d27-92460bde60e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:01.158129 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2860d-3441-4728-8d27-92460bde60e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:01.158420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2860d-3441-4728-8d27-92460bde60e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:01.158698 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2860d-3441-4728-8d27-92460bde60e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:01.161228 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2860d-3441-4728-8d27-92460bde60e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:01.163751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2860d-3441-4728-8d27-92460bde60e4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:01.313628 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f684b7-5816-44ee-9cf7-0823afd560b2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:01.316357 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-87f684b7-5816-44ee-9cf7-0823afd560b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:01.331856 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 896/1801] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:54:01 2022] POST /identity/v3/users => generated 289 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:01.339941 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f684b7-5816-44ee-9cf7-0823afd560b2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:01.343422 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2860d-3441-4728-8d27-92460bde60e4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:01.346111 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2994b6-31a7-4f79-9101-8ce37ebb0f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:01.347550 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2994b6-31a7-4f79-9101-8ce37ebb0f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:01.348085 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2994b6-31a7-4f79-9101-8ce37ebb0f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:01.348797 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2994b6-31a7-4f79-9101-8ce37ebb0f0a admin admin] PATH_INFO: `/v3/projects/000b9bb72f984691a09d05a6a73869dc` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:01.351046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2994b6-31a7-4f79-9101-8ce37ebb0f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=000b9bb72f984691a09d05a6a73869dc)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:01.353951 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2994b6-31a7-4f79-9101-8ce37ebb0f0a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:01.375720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2860d-3441-4728-8d27-92460bde60e4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:01.404476 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a3e3f-31b0-40f9-a4fc-fd58ebc28741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:01.405032 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a3e3f-31b0-40f9-a4fc-fd58ebc28741 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:01.405394 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a3e3f-31b0-40f9-a4fc-fd58ebc28741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:01.405640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a3e3f-31b0-40f9-a4fc-fd58ebc28741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:01.409593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a3e3f-31b0-40f9-a4fc-fd58ebc28741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:01.409593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a3e3f-31b0-40f9-a4fc-fd58ebc28741 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:01.434278 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 897/1802] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:54:01.435935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a3e3f-31b0-40f9-a4fc-fd58ebc28741 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:01.449977 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a3e3f-31b0-40f9-a4fc-fd58ebc28741 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:01.460591 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc40a57-9e4a-4949-9b1f-267170e4dcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:01.461547 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc40a57-9e4a-4949-9b1f-267170e4dcbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:01.461839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc40a57-9e4a-4949-9b1f-267170e4dcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:01.462091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc40a57-9e4a-4949-9b1f-267170e4dcbb admin admin] PATH_INFO: `/v3/projects/7c9ee7780cdc4e99967cfd05ef397071/users/2bde5dd41dbd4650b67a35843e69069b/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:01.488819 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc40a57-9e4a-4949-9b1f-267170e4dcbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9ee7780cdc4e99967cfd05ef397071, user_id=2bde5dd41dbd4650b67a35843e69069b, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:01.491800 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc40a57-9e4a-4949-9b1f-267170e4dcbb admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:01.618131 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 898/1803] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:54:01 2022] PUT /identity/v3/projects/7c9ee7780cdc4e99967cfd05ef397071/users/2bde5dd41dbd4650b67a35843e69069b/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:01.624405 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc40a57-9e4a-4949-9b1f-267170e4dcbb admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:01.628951 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fe2994b6-31a7-4f79-9101-8ce37ebb0f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '000b9bb72f984691a09d05a6a73869dc', 'request_id': 'req-fe2994b6-31a7-4f79-9101-8ce37ebb0f0a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:01.718910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc40a57-9e4a-4949-9b1f-267170e4dcbb admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:01.747478 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fe2994b6-31a7-4f79-9101-8ce37ebb0f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '000b9bb72f984691a09d05a6a73869dc', 'request_id': 'req-fe2994b6-31a7-4f79-9101-8ce37ebb0f0a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:01.754979 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fe2994b6-31a7-4f79-9101-8ce37ebb0f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '000b9bb72f984691a09d05a6a73869dc', 'request_id': 'req-fe2994b6-31a7-4f79-9101-8ce37ebb0f0a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:01.766944 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fe2994b6-31a7-4f79-9101-8ce37ebb0f0a admin admin] The token cache is being invalidate because project 000b9bb72f984691a09d05a6a73869dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:01.767259 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fe2994b6-31a7-4f79-9101-8ce37ebb0f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:01.767949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fe2994b6-31a7-4f79-9101-8ce37ebb0f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:01.769701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 906/1804] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:54:01 2022] DELETE /identity/v3/projects/000b9bb72f984691a09d05a6a73869dc => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:01.774295 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2994b6-31a7-4f79-9101-8ce37ebb0f0a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:01.776804 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fe2994b6-31a7-4f79-9101-8ce37ebb0f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:01.783077 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db587026-1c16-4347-a376-fd5ba4dc0323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:01.783077 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db587026-1c16-4347-a376-fd5ba4dc0323 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:01.783702 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db587026-1c16-4347-a376-fd5ba4dc0323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:01.783702 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db587026-1c16-4347-a376-fd5ba4dc0323 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:01.790456 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db587026-1c16-4347-a376-fd5ba4dc0323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:01.790456 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db587026-1c16-4347-a376-fd5ba4dc0323 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:01.795837 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2994b6-31a7-4f79-9101-8ce37ebb0f0a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:01.803881 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 899/1805] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:54:01.804039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8c845-f66c-4ff9-8420-0f541179e42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:01.804039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8c845-f66c-4ff9-8420-0f541179e42b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:01.804039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8c845-f66c-4ff9-8420-0f541179e42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:01.805231 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8c845-f66c-4ff9-8420-0f541179e42b admin admin] PATH_INFO: `/v3/users/d00bd780eb3d47759fbde93046fa7709` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:01.805393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db587026-1c16-4347-a376-fd5ba4dc0323 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:01.807430 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8c845-f66c-4ff9-8420-0f541179e42b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d00bd780eb3d47759fbde93046fa7709)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:01.807605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-db587026-1c16-4347-a376-fd5ba4dc0323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:01.810189 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8c845-f66c-4ff9-8420-0f541179e42b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:01.825801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db587026-1c16-4347-a376-fd5ba4dc0323 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:01.834913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263546e-57d4-4890-b25b-1c18a9f52352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:01.836749 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263546e-57d4-4890-b25b-1c18a9f52352 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:01.836982 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263546e-57d4-4890-b25b-1c18a9f52352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:01.837399 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263546e-57d4-4890-b25b-1c18a9f52352 admin admin] PATH_INFO: `/v3/projects/7c9ee7780cdc4e99967cfd05ef397071/users/2bde5dd41dbd4650b67a35843e69069b/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:01.839706 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263546e-57d4-4890-b25b-1c18a9f52352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9ee7780cdc4e99967cfd05ef397071, user_id=2bde5dd41dbd4650b67a35843e69069b, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:01.842738 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263546e-57d4-4890-b25b-1c18a9f52352 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:01.856865 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 900/1806] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:54:01 2022] PUT /identity/v3/projects/7c9ee7780cdc4e99967cfd05ef397071/users/2bde5dd41dbd4650b67a35843e69069b/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:01.868248 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6b059-813c-406c-8b25-b529fbe5ac0d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:01.869154 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6b059-813c-406c-8b25-b529fbe5ac0d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:01.869514 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6b059-813c-406c-8b25-b529fbe5ac0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:01.899598 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6ee6b059-813c-406c-8b25-b529fbe5ac0d None None] MFA Rules not processed for user `2bde5dd41dbd4650b67a35843e69069b`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:01.900865 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6ee6b059-813c-406c-8b25-b529fbe5ac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:01.996515 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 901/1807] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:01 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:54:02.010117 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6b059-813c-406c-8b25-b529fbe5ac0d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:02.012063 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6ee6b059-813c-406c-8b25-b529fbe5ac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:02.097071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9ab8c845-f66c-4ff9-8420-0f541179e42b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd00bd780eb3d47759fbde93046fa7709'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:02.097831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9ab8c845-f66c-4ff9-8420-0f541179e42b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd00bd780eb3d47759fbde93046fa7709'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:02.105098 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6b059-813c-406c-8b25-b529fbe5ac0d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:02.113765 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0035e-33cf-490b-93d6-434560bcca4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:02.115022 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0035e-33cf-490b-93d6-434560bcca4e service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:02.115627 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0035e-33cf-490b-93d6-434560bcca4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:02.116325 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0035e-33cf-490b-93d6-434560bcca4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:02.116484 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9ab8c845-f66c-4ff9-8420-0f541179e42b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd00bd780eb3d47759fbde93046fa7709'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:02.131201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0035e-33cf-490b-93d6-434560bcca4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:02.132655 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0035e-33cf-490b-93d6-434560bcca4e service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:02.143968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 902/1808] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:54:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:54:02.260026 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9ab8c845-f66c-4ff9-8420-0f541179e42b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd00bd780eb3d47759fbde93046fa7709'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:02.260662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9ab8c845-f66c-4ff9-8420-0f541179e42b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd00bd780eb3d47759fbde93046fa7709'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:02.280029 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 907/1809] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:54:01 2022] DELETE /identity/v3/users/d00bd780eb3d47759fbde93046fa7709 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:54:02.517946 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0035e-33cf-490b-93d6-434560bcca4e service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:02.522026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-62e0035e-33cf-490b-93d6-434560bcca4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:02.536865 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0035e-33cf-490b-93d6-434560bcca4e service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:02.625312 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848d2c2-8ae7-4f84-948c-6c7491faaa50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:02.625312 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848d2c2-8ae7-4f84-948c-6c7491faaa50 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:02.625312 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848d2c2-8ae7-4f84-948c-6c7491faaa50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:02.625312 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848d2c2-8ae7-4f84-948c-6c7491faaa50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:02.625824 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b848d2c2-8ae7-4f84-948c-6c7491faaa50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:02.724159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848d2c2-8ae7-4f84-948c-6c7491faaa50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:02.725670 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848d2c2-8ae7-4f84-948c-6c7491faaa50 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:02.746171 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 903/1810] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:54:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:02.832427 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8c845-f66c-4ff9-8420-0f541179e42b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:02.834889 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9ab8c845-f66c-4ff9-8420-0f541179e42b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:02.870195 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:03.022881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8c845-f66c-4ff9-8420-0f541179e42b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:03.030085 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c3ace-8067-41b8-879c-b0b5cc955fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:03.031071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c3ace-8067-41b8-879c-b0b5cc955fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:03.031363 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c3ace-8067-41b8-879c-b0b5cc955fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:03.031641 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c3ace-8067-41b8-879c-b0b5cc955fa2 admin admin] PATH_INFO: `/v3/projects/27d2a8190ec84a4e8bd5c42df4318700` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:03.033012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c3ace-8067-41b8-879c-b0b5cc955fa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d2a8190ec84a4e8bd5c42df4318700)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:03.035078 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c3ace-8067-41b8-879c-b0b5cc955fa2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:03.203931 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-715c3ace-8067-41b8-879c-b0b5cc955fa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d2a8190ec84a4e8bd5c42df4318700', 'request_id': 'req-715c3ace-8067-41b8-879c-b0b5cc955fa2'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:03.319532 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-715c3ace-8067-41b8-879c-b0b5cc955fa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d2a8190ec84a4e8bd5c42df4318700', 'request_id': 'req-715c3ace-8067-41b8-879c-b0b5cc955fa2'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:03.333646 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-715c3ace-8067-41b8-879c-b0b5cc955fa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d2a8190ec84a4e8bd5c42df4318700', 'request_id': 'req-715c3ace-8067-41b8-879c-b0b5cc955fa2'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:03.345191 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:03.370711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-715c3ace-8067-41b8-879c-b0b5cc955fa2 admin admin] The token cache is being invalidate because project 27d2a8190ec84a4e8bd5c42df4318700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:03.371518 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-715c3ace-8067-41b8-879c-b0b5cc955fa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:03.375154 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-715c3ace-8067-41b8-879c-b0b5cc955fa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:03.389139 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 908/1811] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:54:02 2022] DELETE /identity/v3/projects/27d2a8190ec84a4e8bd5c42df4318700 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:03.390157 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848d2c2-8ae7-4f84-948c-6c7491faaa50 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:03.393070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b848d2c2-8ae7-4f84-948c-6c7491faaa50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:03.397650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841e146-cf50-4372-a3b4-caeec3b14fb8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:03.397932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841e146-cf50-4372-a3b4-caeec3b14fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:03.398593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841e146-cf50-4372-a3b4-caeec3b14fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:03.417332 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848d2c2-8ae7-4f84-948c-6c7491faaa50 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:03.439425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3841e146-cf50-4372-a3b4-caeec3b14fb8 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:03.441028 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3841e146-cf50-4372-a3b4-caeec3b14fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:03.513446 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c2b1a-dd2a-4ce9-be9e-5c1a152ee468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:03.514389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c2b1a-dd2a-4ce9-be9e-5c1a152ee468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:03.514819 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c2b1a-dd2a-4ce9-be9e-5c1a152ee468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:03.515092 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c2b1a-dd2a-4ce9-be9e-5c1a152ee468 admin admin] PATH_INFO: `/v3/users/7551679e272c447da5e0596015960e8c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:03.517315 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c2b1a-dd2a-4ce9-be9e-5c1a152ee468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7551679e272c447da5e0596015960e8c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:03.518511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c2b1a-dd2a-4ce9-be9e-5c1a152ee468 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:03.560388 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 909/1812] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:03.569632 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296b69c-2288-4053-ac5f-0f9366963c07 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:03.569924 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296b69c-2288-4053-ac5f-0f9366963c07 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:03.570346 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296b69c-2288-4053-ac5f-0f9366963c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:03.596271 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7296b69c-2288-4053-ac5f-0f9366963c07 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:03.597698 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7296b69c-2288-4053-ac5f-0f9366963c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:03.608321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 910/1813] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:03.611609 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296b69c-2288-4053-ac5f-0f9366963c07 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:03.625893 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296b69c-2288-4053-ac5f-0f9366963c07 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:03.631372 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb6b04-6adb-4f70-8867-2230d23d926e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:03.632407 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb6b04-6adb-4f70-8867-2230d23d926e admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:03.632692 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb6b04-6adb-4f70-8867-2230d23d926e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:03.632960 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb6b04-6adb-4f70-8867-2230d23d926e admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:03.633811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb6b04-6adb-4f70-8867-2230d23d926e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:54:03.634235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb6b04-6adb-4f70-8867-2230d23d926e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:03.636448 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb6b04-6adb-4f70-8867-2230d23d926e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:03.650625 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 911/1814] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:54:03.656511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb6b04-6adb-4f70-8867-2230d23d926e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:03.667711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb6b04-6adb-4f70-8867-2230d23d926e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:03.672442 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d252db8-d946-44a7-9fd7-7e4f08a8039c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:03.673124 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d252db8-d946-44a7-9fd7-7e4f08a8039c admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:03.673445 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d252db8-d946-44a7-9fd7-7e4f08a8039c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:03.673716 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d252db8-d946-44a7-9fd7-7e4f08a8039c admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:03.674398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d252db8-d946-44a7-9fd7-7e4f08a8039c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:03.676338 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d252db8-d946-44a7-9fd7-7e4f08a8039c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:03.780520 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f9c2b1a-dd2a-4ce9-be9e-5c1a152ee468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7551679e272c447da5e0596015960e8c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:03.814025 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 912/1815] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:54:03 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:03.819884 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d252db8-d946-44a7-9fd7-7e4f08a8039c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:03.896880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d252db8-d946-44a7-9fd7-7e4f08a8039c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:03.902498 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95368a-7dd0-4dc0-b9c9-1309ec7671d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:03.903242 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95368a-7dd0-4dc0-b9c9-1309ec7671d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:03.903484 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95368a-7dd0-4dc0-b9c9-1309ec7671d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:03.903782 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95368a-7dd0-4dc0-b9c9-1309ec7671d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:03.904832 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95368a-7dd0-4dc0-b9c9-1309ec7671d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:03.907235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95368a-7dd0-4dc0-b9c9-1309ec7671d0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:04.074757 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 913/1816] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:54:03 2022] POST /identity/v3/users => generated 291 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:04.079061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95368a-7dd0-4dc0-b9c9-1309ec7671d0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:04.093580 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95368a-7dd0-4dc0-b9c9-1309ec7671d0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:04.096939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f9c2b1a-dd2a-4ce9-be9e-5c1a152ee468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7551679e272c447da5e0596015960e8c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:04.098182 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f9c2b1a-dd2a-4ce9-be9e-5c1a152ee468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7551679e272c447da5e0596015960e8c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:04.099842 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f9c2b1a-dd2a-4ce9-be9e-5c1a152ee468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7551679e272c447da5e0596015960e8c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:04.106215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498c3cc-032f-410e-a9cc-4a4987257309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:04.107417 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498c3cc-032f-410e-a9cc-4a4987257309 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:04.107923 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498c3cc-032f-410e-a9cc-4a4987257309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:04.108414 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498c3cc-032f-410e-a9cc-4a4987257309 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:04.109846 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498c3cc-032f-410e-a9cc-4a4987257309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:04.110792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f9c2b1a-dd2a-4ce9-be9e-5c1a152ee468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7551679e272c447da5e0596015960e8c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:04.113039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498c3cc-032f-410e-a9cc-4a4987257309 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:04.133812 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 914/1817] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:04.134875 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 904/1818] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:54:03 2022] DELETE /identity/v3/users/7551679e272c447da5e0596015960e8c => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:54:04.137488 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eb7a8-e3b0-48ba-97db-378184f1cf49 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:04.137686 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498c3cc-032f-410e-a9cc-4a4987257309 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:04.137847 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eb7a8-e3b0-48ba-97db-378184f1cf49 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:04.138135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eb7a8-e3b0-48ba-97db-378184f1cf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:04.139583 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2498c3cc-032f-410e-a9cc-4a4987257309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:04.155963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498c3cc-032f-410e-a9cc-4a4987257309 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:04.164395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ab9eb7a8-e3b0-48ba-97db-378184f1cf49 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:04.166231 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ab9eb7a8-e3b0-48ba-97db-378184f1cf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:04.265323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 905/1819] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:04.273175 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843db07-2018-45d2-b609-1f9f822930e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:04.274026 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843db07-2018-45d2-b609-1f9f822930e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:04.274390 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843db07-2018-45d2-b609-1f9f822930e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:04.274742 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843db07-2018-45d2-b609-1f9f822930e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:04.276310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843db07-2018-45d2-b609-1f9f822930e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:04.278344 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9eb7a8-e3b0-48ba-97db-378184f1cf49 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:04.279916 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843db07-2018-45d2-b609-1f9f822930e7 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:04.282907 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ab9eb7a8-e3b0-48ba-97db-378184f1cf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:04.295851 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 915/1820] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:04.302531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843db07-2018-45d2-b609-1f9f822930e7 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:04.316349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843db07-2018-45d2-b609-1f9f822930e7 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:04.323074 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6294a1-7d4f-4f78-9021-d46741101533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:04.323988 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6294a1-7d4f-4f78-9021-d46741101533 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:04.324268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6294a1-7d4f-4f78-9021-d46741101533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:04.324551 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6294a1-7d4f-4f78-9021-d46741101533 admin admin] PATH_INFO: `/v3/projects/8436f3201ede4d0881579824327f8ceb/users/0ebc4d99f43347489fb1e38414020468/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:04.348940 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6294a1-7d4f-4f78-9021-d46741101533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8436f3201ede4d0881579824327f8ceb, user_id=0ebc4d99f43347489fb1e38414020468, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:04.351565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6294a1-7d4f-4f78-9021-d46741101533 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:04.376308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9eb7a8-e3b0-48ba-97db-378184f1cf49 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:04.380284 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced604b7-f50c-4080-827c-819edd646006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:04.380952 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced604b7-f50c-4080-827c-819edd646006 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:04.381455 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced604b7-f50c-4080-827c-819edd646006 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:04.381825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced604b7-f50c-4080-827c-819edd646006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:04.394027 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced604b7-f50c-4080-827c-819edd646006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:04.395527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced604b7-f50c-4080-827c-819edd646006 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:04.410386 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 906/1821] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:54:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:54:04.453444 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 916/1822] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:54:04 2022] PUT /identity/v3/projects/8436f3201ede4d0881579824327f8ceb/users/0ebc4d99f43347489fb1e38414020468/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:04.465706 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643aac1b-9f85-4425-9684-c74f996d3a63 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:04.466286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643aac1b-9f85-4425-9684-c74f996d3a63 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:04.466712 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643aac1b-9f85-4425-9684-c74f996d3a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:04.514251 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-643aac1b-9f85-4425-9684-c74f996d3a63 None None] MFA Rules not processed for user `0ebc4d99f43347489fb1e38414020468`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:04.516636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-643aac1b-9f85-4425-9684-c74f996d3a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:04.653066 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6294a1-7d4f-4f78-9021-d46741101533 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:04.654279 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 907/1823] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:04.816385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6294a1-7d4f-4f78-9021-d46741101533 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:04.832481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b0f12-1205-42fc-8da2-b7aadbeb039b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:04.834023 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b0f12-1205-42fc-8da2-b7aadbeb039b admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:04.834502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b0f12-1205-42fc-8da2-b7aadbeb039b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:04.836194 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b0f12-1205-42fc-8da2-b7aadbeb039b admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:04.836815 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b0f12-1205-42fc-8da2-b7aadbeb039b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:04.839357 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b0f12-1205-42fc-8da2-b7aadbeb039b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:04.989556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 917/1824] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:54:04 2022] POST /identity/v3/projects => generated 379 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:04.990725 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643aac1b-9f85-4425-9684-c74f996d3a63 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:05.005577 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643aac1b-9f85-4425-9684-c74f996d3a63 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:05.006837 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b0f12-1205-42fc-8da2-b7aadbeb039b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:05.013452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-060b0f12-1205-42fc-8da2-b7aadbeb039b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:05.098521 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb836149-88ae-4a12-a050-5e575486cf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:05.099576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb836149-88ae-4a12-a050-5e575486cf80 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:05.099968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb836149-88ae-4a12-a050-5e575486cf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:05.100426 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb836149-88ae-4a12-a050-5e575486cf80 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:05.105939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb836149-88ae-4a12-a050-5e575486cf80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:05.109433 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb836149-88ae-4a12-a050-5e575486cf80 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:05.179971 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b0f12-1205-42fc-8da2-b7aadbeb039b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:05.194490 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042f96b-6aeb-42dc-8b7e-14ffd72d586b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:05.195732 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042f96b-6aeb-42dc-8b7e-14ffd72d586b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:05.197530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042f96b-6aeb-42dc-8b7e-14ffd72d586b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:05.197530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042f96b-6aeb-42dc-8b7e-14ffd72d586b admin admin] PATH_INFO: `/v3/projects/1fc301980e7d4de1bfe333caf035f842` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:05.203411 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042f96b-6aeb-42dc-8b7e-14ffd72d586b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fc301980e7d4de1bfe333caf035f842)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:05.203411 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042f96b-6aeb-42dc-8b7e-14ffd72d586b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:05.226569 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:05.252421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 908/1825] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:54:04 2022] POST /identity/v3/users => generated 296 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:05.253039 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb836149-88ae-4a12-a050-5e575486cf80 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:05.266747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb836149-88ae-4a12-a050-5e575486cf80 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:05.274735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543212a-8e23-48e1-b31c-2439a3c5638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:05.276498 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543212a-8e23-48e1-b31c-2439a3c5638f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:05.277978 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543212a-8e23-48e1-b31c-2439a3c5638f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:05.277978 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543212a-8e23-48e1-b31c-2439a3c5638f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:05.278325 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543212a-8e23-48e1-b31c-2439a3c5638f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:05.280359 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543212a-8e23-48e1-b31c-2439a3c5638f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:05.298723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 909/1826] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:05.303845 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543212a-8e23-48e1-b31c-2439a3c5638f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:05.316992 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543212a-8e23-48e1-b31c-2439a3c5638f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:05.322718 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c5a5f-9f67-4841-82c4-41a6449f0af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:05.323626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c5a5f-9f67-4841-82c4-41a6449f0af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:05.323903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c5a5f-9f67-4841-82c4-41a6449f0af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:05.324179 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c5a5f-9f67-4841-82c4-41a6449f0af5 admin admin] PATH_INFO: `/v3/projects/d2f61cacc3ee4d20a2f13222f0bb226d/users/38dc9c794adf45baad1299359c6dd337/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:05.358615 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c5a5f-9f67-4841-82c4-41a6449f0af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f61cacc3ee4d20a2f13222f0bb226d, user_id=38dc9c794adf45baad1299359c6dd337, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:05.361551 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c5a5f-9f67-4841-82c4-41a6449f0af5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:05.374258 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2042f96b-6aeb-42dc-8b7e-14ffd72d586b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fc301980e7d4de1bfe333caf035f842', 'request_id': 'req-2042f96b-6aeb-42dc-8b7e-14ffd72d586b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:05.508068 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2042f96b-6aeb-42dc-8b7e-14ffd72d586b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fc301980e7d4de1bfe333caf035f842', 'request_id': 'req-2042f96b-6aeb-42dc-8b7e-14ffd72d586b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:05.519337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 910/1827] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:54:05 2022] PUT /identity/v3/projects/d2f61cacc3ee4d20a2f13222f0bb226d/users/38dc9c794adf45baad1299359c6dd337/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:54:05.524358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c5a5f-9f67-4841-82c4-41a6449f0af5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:05.524552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2042f96b-6aeb-42dc-8b7e-14ffd72d586b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fc301980e7d4de1bfe333caf035f842', 'request_id': 'req-2042f96b-6aeb-42dc-8b7e-14ffd72d586b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:05.540153 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2042f96b-6aeb-42dc-8b7e-14ffd72d586b admin admin] The token cache is being invalidate because project 1fc301980e7d4de1bfe333caf035f842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:05.540153 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2042f96b-6aeb-42dc-8b7e-14ffd72d586b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:05.540153 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2042f96b-6aeb-42dc-8b7e-14ffd72d586b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:05.543434 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 918/1828] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:54:05 2022] DELETE /identity/v3/projects/1fc301980e7d4de1bfe333caf035f842 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:05.548914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042f96b-6aeb-42dc-8b7e-14ffd72d586b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:05.551827 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2042f96b-6aeb-42dc-8b7e-14ffd72d586b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:05.560948 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:05.669226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c5a5f-9f67-4841-82c4-41a6449f0af5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:05.675944 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8f49f-f3e8-4ad8-b275-11073c3d2f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:05.677441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8f49f-f3e8-4ad8-b275-11073c3d2f86 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:05.685421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8f49f-f3e8-4ad8-b275-11073c3d2f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:05.686775 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8f49f-f3e8-4ad8-b275-11073c3d2f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:05.688930 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8f49f-f3e8-4ad8-b275-11073c3d2f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:05.691239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8f49f-f3e8-4ad8-b275-11073c3d2f86 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:05.706636 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042f96b-6aeb-42dc-8b7e-14ffd72d586b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:05.707204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 911/1829] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:05.713801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c776472-1129-4d48-ba4e-0686abf8384f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:05.714449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8f49f-f3e8-4ad8-b275-11073c3d2f86 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:05.715832 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c776472-1129-4d48-ba4e-0686abf8384f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:05.716238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c776472-1129-4d48-ba4e-0686abf8384f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:05.716838 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2af8f49f-f3e8-4ad8-b275-11073c3d2f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:05.717303 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c776472-1129-4d48-ba4e-0686abf8384f admin admin] PATH_INFO: `/v3/users/748380ae149b41c6aff43a1289a27289` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:05.718951 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c776472-1129-4d48-ba4e-0686abf8384f admin admin] RBAC: Authorizing `identity:delete_user(user_id=748380ae149b41c6aff43a1289a27289)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:05.722013 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c776472-1129-4d48-ba4e-0686abf8384f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:05.739493 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8f49f-f3e8-4ad8-b275-11073c3d2f86 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:05.751499 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28f26e-f939-4147-bf81-08caee70239c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:05.752749 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28f26e-f939-4147-bf81-08caee70239c admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:05.753503 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28f26e-f939-4147-bf81-08caee70239c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:05.754026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28f26e-f939-4147-bf81-08caee70239c admin admin] PATH_INFO: `/v3/projects/d2f61cacc3ee4d20a2f13222f0bb226d/users/38dc9c794adf45baad1299359c6dd337/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:05.758892 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28f26e-f939-4147-bf81-08caee70239c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f61cacc3ee4d20a2f13222f0bb226d, user_id=38dc9c794adf45baad1299359c6dd337, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:05.763104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28f26e-f939-4147-bf81-08caee70239c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:05.778446 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 912/1830] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:54:05 2022] PUT /identity/v3/projects/d2f61cacc3ee4d20a2f13222f0bb226d/users/38dc9c794adf45baad1299359c6dd337/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:05.789292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7e107-c980-4ddf-80ad-469036a79a9c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:05.789597 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7e107-c980-4ddf-80ad-469036a79a9c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:05.789882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7e107-c980-4ddf-80ad-469036a79a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:05.821616 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6df7e107-c980-4ddf-80ad-469036a79a9c None None] MFA Rules not processed for user `38dc9c794adf45baad1299359c6dd337`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:05.823814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6df7e107-c980-4ddf-80ad-469036a79a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:05.915019 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 913/1831] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:05.936333 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7e107-c980-4ddf-80ad-469036a79a9c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:05.938203 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6df7e107-c980-4ddf-80ad-469036a79a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:06.042345 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7e107-c980-4ddf-80ad-469036a79a9c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:06.049851 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b0703-e1fe-462d-95ee-d191e88cca48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:06.055083 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8c776472-1129-4d48-ba4e-0686abf8384f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '748380ae149b41c6aff43a1289a27289'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:06.055785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b0703-e1fe-462d-95ee-d191e88cca48 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:06.055932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8c776472-1129-4d48-ba4e-0686abf8384f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '748380ae149b41c6aff43a1289a27289'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:06.056140 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b0703-e1fe-462d-95ee-d191e88cca48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:06.056140 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b0703-e1fe-462d-95ee-d191e88cca48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:06.062974 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8c776472-1129-4d48-ba4e-0686abf8384f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '748380ae149b41c6aff43a1289a27289'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:06.066729 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b0703-e1fe-462d-95ee-d191e88cca48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:06.068288 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b0703-e1fe-462d-95ee-d191e88cca48 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:06.085709 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 914/1832] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:54:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:54:06.164913 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8c776472-1129-4d48-ba4e-0686abf8384f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '748380ae149b41c6aff43a1289a27289'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:06.166268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8c776472-1129-4d48-ba4e-0686abf8384f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '748380ae149b41c6aff43a1289a27289'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:06.192375 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 919/1833] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:54:05 2022] DELETE /identity/v3/users/748380ae149b41c6aff43a1289a27289 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:54:06.887523 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b0703-e1fe-462d-95ee-d191e88cca48 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:06.904047 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c776472-1129-4d48-ba4e-0686abf8384f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:06.906500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8c776472-1129-4d48-ba4e-0686abf8384f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:06.985126 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b0703-e1fe-462d-95ee-d191e88cca48 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:07.012942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c776472-1129-4d48-ba4e-0686abf8384f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:07.019437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaec90c-69aa-40e6-bcf8-1dbf9e27408a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:07.020535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaec90c-69aa-40e6-bcf8-1dbf9e27408a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:07.020911 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaec90c-69aa-40e6-bcf8-1dbf9e27408a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:07.021330 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaec90c-69aa-40e6-bcf8-1dbf9e27408a admin admin] PATH_INFO: `/v3/users/0ebc4d99f43347489fb1e38414020468` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:07.023356 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaec90c-69aa-40e6-bcf8-1dbf9e27408a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ebc4d99f43347489fb1e38414020468)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:07.026502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaec90c-69aa-40e6-bcf8-1dbf9e27408a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:07.064341 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183aa52-ec69-4cd2-ac0d-40b8f17f6256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:07.066800 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183aa52-ec69-4cd2-ac0d-40b8f17f6256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:07.067603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183aa52-ec69-4cd2-ac0d-40b8f17f6256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:07.068575 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183aa52-ec69-4cd2-ac0d-40b8f17f6256 admin admin] PATH_INFO: `/v3/projects/6977e64977864159aae436dc56ba26ac` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:07.083524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183aa52-ec69-4cd2-ac0d-40b8f17f6256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6977e64977864159aae436dc56ba26ac)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:07.087964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183aa52-ec69-4cd2-ac0d-40b8f17f6256 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:07.303765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-eeaec90c-69aa-40e6-bcf8-1dbf9e27408a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ebc4d99f43347489fb1e38414020468'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:07.306137 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-eeaec90c-69aa-40e6-bcf8-1dbf9e27408a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ebc4d99f43347489fb1e38414020468'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:07.314098 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f183aa52-ec69-4cd2-ac0d-40b8f17f6256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6977e64977864159aae436dc56ba26ac', 'request_id': 'req-f183aa52-ec69-4cd2-ac0d-40b8f17f6256'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:07.318883 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-eeaec90c-69aa-40e6-bcf8-1dbf9e27408a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ebc4d99f43347489fb1e38414020468'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:07.326999 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f183aa52-ec69-4cd2-ac0d-40b8f17f6256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6977e64977864159aae436dc56ba26ac', 'request_id': 'req-f183aa52-ec69-4cd2-ac0d-40b8f17f6256'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:07.336647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f183aa52-ec69-4cd2-ac0d-40b8f17f6256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6977e64977864159aae436dc56ba26ac', 'request_id': 'req-f183aa52-ec69-4cd2-ac0d-40b8f17f6256'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:07.417305 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-eeaec90c-69aa-40e6-bcf8-1dbf9e27408a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ebc4d99f43347489fb1e38414020468'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:07.419365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-eeaec90c-69aa-40e6-bcf8-1dbf9e27408a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ebc4d99f43347489fb1e38414020468'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:07.463647 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 920/1834] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:54:06 2022] DELETE /identity/v3/users/0ebc4d99f43347489fb1e38414020468 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:54:07.470152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b545-3cff-4cfc-b79b-68777bd7abe2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:07.470618 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b545-3cff-4cfc-b79b-68777bd7abe2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:07.471075 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b545-3cff-4cfc-b79b-68777bd7abe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:07.504077 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b134b545-3cff-4cfc-b79b-68777bd7abe2 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:07.506249 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b134b545-3cff-4cfc-b79b-68777bd7abe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:07.519408 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f183aa52-ec69-4cd2-ac0d-40b8f17f6256 admin admin] The token cache is being invalidate because project 6977e64977864159aae436dc56ba26ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:07.519909 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f183aa52-ec69-4cd2-ac0d-40b8f17f6256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:07.523344 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f183aa52-ec69-4cd2-ac0d-40b8f17f6256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:07.524711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 915/1835] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:54:06 2022] DELETE /identity/v3/projects/6977e64977864159aae436dc56ba26ac => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:07.533802 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2961086-5c3f-42a6-93d0-fd6ca5d8d20c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:07.534229 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2961086-5c3f-42a6-93d0-fd6ca5d8d20c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:07.534625 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2961086-5c3f-42a6-93d0-fd6ca5d8d20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:07.572598 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b2961086-5c3f-42a6-93d0-fd6ca5d8d20c None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:07.574223 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b2961086-5c3f-42a6-93d0-fd6ca5d8d20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:07.632997 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 921/1836] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:54:07.643685 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134b545-3cff-4cfc-b79b-68777bd7abe2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:07.646077 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b134b545-3cff-4cfc-b79b-68777bd7abe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:07.670709 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 916/1837] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:07.683983 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948d5ce-3b49-46c2-a97c-b6a2c6367fe1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:07.684362 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948d5ce-3b49-46c2-a97c-b6a2c6367fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:07.684824 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948d5ce-3b49-46c2-a97c-b6a2c6367fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:07.723930 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8948d5ce-3b49-46c2-a97c-b6a2c6367fe1 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:07.725174 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8948d5ce-3b49-46c2-a97c-b6a2c6367fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:07.740376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 917/1838] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:54:07.744602 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134b545-3cff-4cfc-b79b-68777bd7abe2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:07.747496 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948d5ce-3b49-46c2-a97c-b6a2c6367fe1 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:07.750920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49b401-77d9-4bd4-ac77-99e48d140c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:07.752232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49b401-77d9-4bd4-ac77-99e48d140c6c service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:07.752455 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49b401-77d9-4bd4-ac77-99e48d140c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:07.752907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49b401-77d9-4bd4-ac77-99e48d140c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:07.763781 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948d5ce-3b49-46c2-a97c-b6a2c6367fe1 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:07.767416 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49b401-77d9-4bd4-ac77-99e48d140c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:07.769000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49b401-77d9-4bd4-ac77-99e48d140c6c service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:07.773139 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f62403-a4c9-44ec-9c77-0ab83769cd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:07.773941 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f62403-a4c9-44ec-9c77-0ab83769cd14 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:07.774229 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f62403-a4c9-44ec-9c77-0ab83769cd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:07.774542 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f62403-a4c9-44ec-9c77-0ab83769cd14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:07.775817 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f62403-a4c9-44ec-9c77-0ab83769cd14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:54:07.776145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f62403-a4c9-44ec-9c77-0ab83769cd14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:07.777920 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f62403-a4c9-44ec-9c77-0ab83769cd14 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:07.786425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 922/1839] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:54:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:07.797298 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 918/1840] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:54:07.801782 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49b401-77d9-4bd4-ac77-99e48d140c6c service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:07.812820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49b401-77d9-4bd4-ac77-99e48d140c6c service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:07.818876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa1220-ae3a-44de-bc50-a66609827e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:07.819765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa1220-ae3a-44de-bc50-a66609827e42 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:07.824013 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa1220-ae3a-44de-bc50-a66609827e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:07.824013 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa1220-ae3a-44de-bc50-a66609827e42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:07.824013 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa1220-ae3a-44de-bc50-a66609827e42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:07.835121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa1220-ae3a-44de-bc50-a66609827e42 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:08.089068 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 923/1841] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:54:07 2022] POST /identity/v3/projects => generated 377 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:08.090417 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f62403-a4c9-44ec-9c77-0ab83769cd14 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:08.104678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f62403-a4c9-44ec-9c77-0ab83769cd14 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:08.119052 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:08.255097 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdae6e-7c37-4631-8544-a56d7cfaeaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:08.256560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdae6e-7c37-4631-8544-a56d7cfaeaac admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:08.257044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdae6e-7c37-4631-8544-a56d7cfaeaac admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:08.260134 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdae6e-7c37-4631-8544-a56d7cfaeaac admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:08.261118 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdae6e-7c37-4631-8544-a56d7cfaeaac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:08.265116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdae6e-7c37-4631-8544-a56d7cfaeaac admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:08.321151 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:08.390010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 919/1842] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:54:08 2022] POST /identity/v3/users => generated 289 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:08.394968 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa1220-ae3a-44de-bc50-a66609827e42 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:08.415853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa1220-ae3a-44de-bc50-a66609827e42 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:08.422605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589de84b-4fd8-42a6-977e-beb16ff9efb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:08.424370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589de84b-4fd8-42a6-977e-beb16ff9efb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:08.424370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589de84b-4fd8-42a6-977e-beb16ff9efb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:08.424370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589de84b-4fd8-42a6-977e-beb16ff9efb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:08.425670 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589de84b-4fd8-42a6-977e-beb16ff9efb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:08.427352 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589de84b-4fd8-42a6-977e-beb16ff9efb1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:08.442522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 924/1843] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:54:08.449370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdae6e-7c37-4631-8544-a56d7cfaeaac admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:08.461570 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdae6e-7c37-4631-8544-a56d7cfaeaac admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:08.474791 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5afde5-87b1-4137-97c9-37b3d9001092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:08.475657 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5afde5-87b1-4137-97c9-37b3d9001092 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:08.476665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5afde5-87b1-4137-97c9-37b3d9001092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:08.477117 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5afde5-87b1-4137-97c9-37b3d9001092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:08.478444 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5afde5-87b1-4137-97c9-37b3d9001092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:08.480693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5afde5-87b1-4137-97c9-37b3d9001092 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:08.494334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 920/1844] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:54:08.499249 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589de84b-4fd8-42a6-977e-beb16ff9efb1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:08.519291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589de84b-4fd8-42a6-977e-beb16ff9efb1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:08.525922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e881ee-4971-480c-95d4-8a3351f73a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:08.526857 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e881ee-4971-480c-95d4-8a3351f73a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:08.527223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e881ee-4971-480c-95d4-8a3351f73a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:08.527507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e881ee-4971-480c-95d4-8a3351f73a84 admin admin] PATH_INFO: `/v3/projects/230c21e2ca9344f69a667f924b984102/users/ff8823568ae744809ad012062b47fda7/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:08.543946 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e881ee-4971-480c-95d4-8a3351f73a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=230c21e2ca9344f69a667f924b984102, user_id=ff8823568ae744809ad012062b47fda7, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:08.546682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e881ee-4971-480c-95d4-8a3351f73a84 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:08.637755 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5afde5-87b1-4137-97c9-37b3d9001092 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:08.639614 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6b5afde5-87b1-4137-97c9-37b3d9001092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:08.654851 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5afde5-87b1-4137-97c9-37b3d9001092 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:08.660332 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e451074-503c-43d6-8ae5-d7d14f616bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:08.661553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e451074-503c-43d6-8ae5-d7d14f616bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:08.661907 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e451074-503c-43d6-8ae5-d7d14f616bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:08.662251 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e451074-503c-43d6-8ae5-d7d14f616bf3 admin admin] PATH_INFO: `/v3/projects/8436f3201ede4d0881579824327f8ceb` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:08.663812 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e451074-503c-43d6-8ae5-d7d14f616bf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8436f3201ede4d0881579824327f8ceb)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:08.674958 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e451074-503c-43d6-8ae5-d7d14f616bf3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:08.712489 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 925/1845] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:54:08 2022] PUT /identity/v3/projects/230c21e2ca9344f69a667f924b984102/users/ff8823568ae744809ad012062b47fda7/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:08.734905 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cb477-ac54-40e4-82be-fa1c56ae9f69 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:08.735943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cb477-ac54-40e4-82be-fa1c56ae9f69 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:08.736565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cb477-ac54-40e4-82be-fa1c56ae9f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:08.794323 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-038cb477-ac54-40e4-82be-fa1c56ae9f69 None None] MFA Rules not processed for user `ff8823568ae744809ad012062b47fda7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:08.799236 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-038cb477-ac54-40e4-82be-fa1c56ae9f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:08.897499 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 926/1846] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:08.914546 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cb477-ac54-40e4-82be-fa1c56ae9f69 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:08.916544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-038cb477-ac54-40e4-82be-fa1c56ae9f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:08.930828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9e451074-503c-43d6-8ae5-d7d14f616bf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8436f3201ede4d0881579824327f8ceb', 'request_id': 'req-9e451074-503c-43d6-8ae5-d7d14f616bf3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:08.943039 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9e451074-503c-43d6-8ae5-d7d14f616bf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8436f3201ede4d0881579824327f8ceb', 'request_id': 'req-9e451074-503c-43d6-8ae5-d7d14f616bf3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:08.957757 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9e451074-503c-43d6-8ae5-d7d14f616bf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8436f3201ede4d0881579824327f8ceb', 'request_id': 'req-9e451074-503c-43d6-8ae5-d7d14f616bf3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:09.006774 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cb477-ac54-40e4-82be-fa1c56ae9f69 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:09.077920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31381d9e-9cf0-44a0-aa74-15615edce3bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:09.078749 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31381d9e-9cf0-44a0-aa74-15615edce3bf service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:09.079194 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31381d9e-9cf0-44a0-aa74-15615edce3bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:09.079561 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31381d9e-9cf0-44a0-aa74-15615edce3bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:09.115330 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9e451074-503c-43d6-8ae5-d7d14f616bf3 admin admin] The token cache is being invalidate because project 8436f3201ede4d0881579824327f8ceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:09.115826 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9e451074-503c-43d6-8ae5-d7d14f616bf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:09.116358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9e451074-503c-43d6-8ae5-d7d14f616bf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:09.122009 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 921/1847] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:54:08 2022] DELETE /identity/v3/projects/8436f3201ede4d0881579824327f8ceb => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:54:09.123546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e451074-503c-43d6-8ae5-d7d14f616bf3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:09.125307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9e451074-503c-43d6-8ae5-d7d14f616bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:09.158477 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31381d9e-9cf0-44a0-aa74-15615edce3bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:09.159912 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31381d9e-9cf0-44a0-aa74-15615edce3bf service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:09.170857 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 927/1848] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:54:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:54:09.204379 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e451074-503c-43d6-8ae5-d7d14f616bf3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:09.217317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273e0af-7981-4e2d-86ce-99aa031a47cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:09.218010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273e0af-7981-4e2d-86ce-99aa031a47cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:09.218493 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273e0af-7981-4e2d-86ce-99aa031a47cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:09.218919 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273e0af-7981-4e2d-86ce-99aa031a47cf admin admin] PATH_INFO: `/v3/users/38dc9c794adf45baad1299359c6dd337` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:09.220958 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273e0af-7981-4e2d-86ce-99aa031a47cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=38dc9c794adf45baad1299359c6dd337)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:09.223245 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273e0af-7981-4e2d-86ce-99aa031a47cf admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:09.482564 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a273e0af-7981-4e2d-86ce-99aa031a47cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38dc9c794adf45baad1299359c6dd337'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:09.588589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a273e0af-7981-4e2d-86ce-99aa031a47cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38dc9c794adf45baad1299359c6dd337'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:09.589554 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a273e0af-7981-4e2d-86ce-99aa031a47cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38dc9c794adf45baad1299359c6dd337'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:09.591391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a273e0af-7981-4e2d-86ce-99aa031a47cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38dc9c794adf45baad1299359c6dd337'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:09.600584 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a273e0af-7981-4e2d-86ce-99aa031a47cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38dc9c794adf45baad1299359c6dd337'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:09.624779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 922/1849] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:54:09 2022] DELETE /identity/v3/users/38dc9c794adf45baad1299359c6dd337 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:10.264872 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31381d9e-9cf0-44a0-aa74-15615edce3bf service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:10.276794 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31381d9e-9cf0-44a0-aa74-15615edce3bf service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:10.366554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63c298-b788-41e6-84a8-8076783ae826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:10.367465 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63c298-b788-41e6-84a8-8076783ae826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:10.367765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63c298-b788-41e6-84a8-8076783ae826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:10.368033 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63c298-b788-41e6-84a8-8076783ae826 admin admin] PATH_INFO: `/v3/projects/d2f61cacc3ee4d20a2f13222f0bb226d` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:10.369974 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63c298-b788-41e6-84a8-8076783ae826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f61cacc3ee4d20a2f13222f0bb226d)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:10.371906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63c298-b788-41e6-84a8-8076783ae826 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:10.494382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2a63c298-b788-41e6-84a8-8076783ae826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f61cacc3ee4d20a2f13222f0bb226d', 'request_id': 'req-2a63c298-b788-41e6-84a8-8076783ae826'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:10.608904 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2a63c298-b788-41e6-84a8-8076783ae826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f61cacc3ee4d20a2f13222f0bb226d', 'request_id': 'req-2a63c298-b788-41e6-84a8-8076783ae826'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:10.617334 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2a63c298-b788-41e6-84a8-8076783ae826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f61cacc3ee4d20a2f13222f0bb226d', 'request_id': 'req-2a63c298-b788-41e6-84a8-8076783ae826'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:10.636743 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2a63c298-b788-41e6-84a8-8076783ae826 admin admin] The token cache is being invalidate because project d2f61cacc3ee4d20a2f13222f0bb226d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:10.637231 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2a63c298-b788-41e6-84a8-8076783ae826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:10.638256 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2a63c298-b788-41e6-84a8-8076783ae826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:10.640237 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 928/1850] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:54:10 2022] DELETE /identity/v3/projects/d2f61cacc3ee4d20a2f13222f0bb226d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:10.645457 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c8037-a047-44e3-a395-e8d38ec4d6bc None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:10.646060 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c8037-a047-44e3-a395-e8d38ec4d6bc None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:10.646060 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c8037-a047-44e3-a395-e8d38ec4d6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:10.666274 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b53c8037-a047-44e3-a395-e8d38ec4d6bc None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:10.667497 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b53c8037-a047-44e3-a395-e8d38ec4d6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:10.744642 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 923/1851] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:10.752765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb48851-dff5-40ce-9c60-d616d40ccb6b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:10.753119 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb48851-dff5-40ce-9c60-d616d40ccb6b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:10.764117 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb48851-dff5-40ce-9c60-d616d40ccb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:10.774881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6bb48851-dff5-40ce-9c60-d616d40ccb6b None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:10.776718 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6bb48851-dff5-40ce-9c60-d616d40ccb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:10.787337 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 929/1852] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:10.790553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c8037-a047-44e3-a395-e8d38ec4d6bc None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:10.801704 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c8037-a047-44e3-a395-e8d38ec4d6bc None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:10.808732 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155df0f-5eae-4ba6-9541-ca07d896daf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:10.809484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155df0f-5eae-4ba6-9541-ca07d896daf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:10.809769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155df0f-5eae-4ba6-9541-ca07d896daf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:10.810044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155df0f-5eae-4ba6-9541-ca07d896daf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:10.810898 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155df0f-5eae-4ba6-9541-ca07d896daf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:54:10.811204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155df0f-5eae-4ba6-9541-ca07d896daf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:10.812853 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155df0f-5eae-4ba6-9541-ca07d896daf8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:10.829578 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 924/1853] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:54:10.830956 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb48851-dff5-40ce-9c60-d616d40ccb6b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:10.840814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb48851-dff5-40ce-9c60-d616d40ccb6b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:10.853991 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae90df-cc32-470a-b0fb-e3e954fc2262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:10.854790 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae90df-cc32-470a-b0fb-e3e954fc2262 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:10.855073 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae90df-cc32-470a-b0fb-e3e954fc2262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:10.855350 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae90df-cc32-470a-b0fb-e3e954fc2262 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:10.859632 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae90df-cc32-470a-b0fb-e3e954fc2262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:10.859632 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae90df-cc32-470a-b0fb-e3e954fc2262 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:10.953638 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 930/1854] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:54:10 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:10.957766 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155df0f-5eae-4ba6-9541-ca07d896daf8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:10.968971 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155df0f-5eae-4ba6-9541-ca07d896daf8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:11.027822 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:11.029603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994fcce-4dcc-48a9-8d6b-1602cb5f9fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:11.030333 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994fcce-4dcc-48a9-8d6b-1602cb5f9fda admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:11.030608 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994fcce-4dcc-48a9-8d6b-1602cb5f9fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:11.030901 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994fcce-4dcc-48a9-8d6b-1602cb5f9fda admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:11.031697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994fcce-4dcc-48a9-8d6b-1602cb5f9fda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:11.033689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994fcce-4dcc-48a9-8d6b-1602cb5f9fda admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:11.121064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 925/1855] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:54:10 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:54:11.121064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:11.124794 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae90df-cc32-470a-b0fb-e3e954fc2262 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:11.144843 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae90df-cc32-470a-b0fb-e3e954fc2262 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:11.151387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83a11a-4840-4be9-aba6-2b9fb770a18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:11.153720 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83a11a-4840-4be9-aba6-2b9fb770a18b admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:11.153720 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83a11a-4840-4be9-aba6-2b9fb770a18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:11.154585 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83a11a-4840-4be9-aba6-2b9fb770a18b admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:11.155493 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83a11a-4840-4be9-aba6-2b9fb770a18b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:11.157441 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83a11a-4840-4be9-aba6-2b9fb770a18b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:11.178372 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 931/1856] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:11.185251 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994fcce-4dcc-48a9-8d6b-1602cb5f9fda admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:11.196381 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994fcce-4dcc-48a9-8d6b-1602cb5f9fda admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:11.201618 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e0712-ad74-4a9f-86d5-48a869088fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:11.202297 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e0712-ad74-4a9f-86d5-48a869088fac admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:11.202587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e0712-ad74-4a9f-86d5-48a869088fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:11.203099 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e0712-ad74-4a9f-86d5-48a869088fac admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:11.203836 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e0712-ad74-4a9f-86d5-48a869088fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:11.206906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e0712-ad74-4a9f-86d5-48a869088fac admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:11.217241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 926/1857] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:11.221967 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83a11a-4840-4be9-aba6-2b9fb770a18b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:11.234797 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83a11a-4840-4be9-aba6-2b9fb770a18b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:11.240398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671afd91-fe04-4e19-a138-0eb393a7b420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:11.241427 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671afd91-fe04-4e19-a138-0eb393a7b420 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:11.241720 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671afd91-fe04-4e19-a138-0eb393a7b420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:11.241996 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671afd91-fe04-4e19-a138-0eb393a7b420 admin admin] PATH_INFO: `/v3/projects/321c663b369341c68eb58dd87d75bd18/users/03aad2eeeb6044e49d7b23d0c80e5bc5/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:11.261747 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671afd91-fe04-4e19-a138-0eb393a7b420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=321c663b369341c68eb58dd87d75bd18, user_id=03aad2eeeb6044e49d7b23d0c80e5bc5, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:11.264434 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671afd91-fe04-4e19-a138-0eb393a7b420 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:11.365252 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 932/1858] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:54:11 2022] PUT /identity/v3/projects/321c663b369341c68eb58dd87d75bd18/users/03aad2eeeb6044e49d7b23d0c80e5bc5/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:11.371356 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd997b-8fb0-4783-8ab3-ffa852c63493 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:11.373997 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd997b-8fb0-4783-8ab3-ffa852c63493 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:11.373997 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd997b-8fb0-4783-8ab3-ffa852c63493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:11.391533 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e4fd997b-8fb0-4783-8ab3-ffa852c63493 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:11.392748 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e4fd997b-8fb0-4783-8ab3-ffa852c63493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:11.453850 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 927/1859] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:11.464165 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671afd91-fe04-4e19-a138-0eb393a7b420 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:11.466018 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-671afd91-fe04-4e19-a138-0eb393a7b420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:11.528295 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671afd91-fe04-4e19-a138-0eb393a7b420 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:11.532390 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a2a8c-dff0-4bf6-86ae-43ef803912ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:11.533058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a2a8c-dff0-4bf6-86ae-43ef803912ea service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:11.533367 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a2a8c-dff0-4bf6-86ae-43ef803912ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:11.533640 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a2a8c-dff0-4bf6-86ae-43ef803912ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:11.543861 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a2a8c-dff0-4bf6-86ae-43ef803912ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:11.545225 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a2a8c-dff0-4bf6-86ae-43ef803912ea service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:11.555253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 933/1860] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:54:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:11.816566 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:12.479086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:12.840823 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:12.968876 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1b194-8247-4e87-9eb8-4e8132a73447 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:12.969316 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1b194-8247-4e87-9eb8-4e8132a73447 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:12.969673 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1b194-8247-4e87-9eb8-4e8132a73447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:13.008801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-00e1b194-8247-4e87-9eb8-4e8132a73447 None None] MFA Rules not processed for user `03aad2eeeb6044e49d7b23d0c80e5bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:13.011337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-00e1b194-8247-4e87-9eb8-4e8132a73447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:13.100653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:13.107815 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 928/1861] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:13.113544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a2a8c-dff0-4bf6-86ae-43ef803912ea service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:13.125872 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a2a8c-dff0-4bf6-86ae-43ef803912ea service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:13.131133 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2b000-0013-46ac-b3fa-5c3b684ba8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:13.131820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2b000-0013-46ac-b3fa-5c3b684ba8c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:13.132107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2b000-0013-46ac-b3fa-5c3b684ba8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:13.132387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2b000-0013-46ac-b3fa-5c3b684ba8c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:13.133278 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2b000-0013-46ac-b3fa-5c3b684ba8c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:13.135915 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2b000-0013-46ac-b3fa-5c3b684ba8c5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:13.239077 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 934/1862] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:54:13 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:13.243034 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1b194-8247-4e87-9eb8-4e8132a73447 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:13.256122 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1b194-8247-4e87-9eb8-4e8132a73447 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:13.337625 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25de3f5-984b-48a0-bf16-2453af7310af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:13.338230 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25de3f5-984b-48a0-bf16-2453af7310af admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:13.338511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25de3f5-984b-48a0-bf16-2453af7310af admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:13.338784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25de3f5-984b-48a0-bf16-2453af7310af admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:13.339533 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25de3f5-984b-48a0-bf16-2453af7310af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:13.341512 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25de3f5-984b-48a0-bf16-2453af7310af admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:13.444915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 929/1863] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:54:13 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:54:13.449060 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2b000-0013-46ac-b3fa-5c3b684ba8c5 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:13.460164 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2b000-0013-46ac-b3fa-5c3b684ba8c5 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:13.465409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8239267-9531-48d1-9056-bf4549cea0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:13.466146 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8239267-9531-48d1-9056-bf4549cea0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:13.466428 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8239267-9531-48d1-9056-bf4549cea0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:13.466862 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8239267-9531-48d1-9056-bf4549cea0f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:13.467602 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8239267-9531-48d1-9056-bf4549cea0f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:13.469292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8239267-9531-48d1-9056-bf4549cea0f0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:13.481861 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 935/1864] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:13.486493 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25de3f5-984b-48a0-bf16-2453af7310af admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:13.495804 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:13.499862 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25de3f5-984b-48a0-bf16-2453af7310af admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:13.508004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2bcdf2-ec27-4392-b82d-b45f85d743a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:13.508914 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bcdf2-ec27-4392-b82d-b45f85d743a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:13.509199 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bcdf2-ec27-4392-b82d-b45f85d743a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:13.509512 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bcdf2-ec27-4392-b82d-b45f85d743a9 admin admin] PATH_INFO: `/v3/projects/eb962cc38f54499d8e2128d551657185/users/6095575c8d994029b9864fc1fd9578a4/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:13.529945 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2bcdf2-ec27-4392-b82d-b45f85d743a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb962cc38f54499d8e2128d551657185, user_id=6095575c8d994029b9864fc1fd9578a4, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:13.532703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2bcdf2-ec27-4392-b82d-b45f85d743a9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:13.642817 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 930/1865] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:54:13 2022] PUT /identity/v3/projects/eb962cc38f54499d8e2128d551657185/users/6095575c8d994029b9864fc1fd9578a4/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:54:13.649290 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8239267-9531-48d1-9056-bf4549cea0f0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:13.673720 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8239267-9531-48d1-9056-bf4549cea0f0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:13.755734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564be75-630a-4275-9c9c-a3b71139de37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:13.756242 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564be75-630a-4275-9c9c-a3b71139de37 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:13.756827 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564be75-630a-4275-9c9c-a3b71139de37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:13.757775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564be75-630a-4275-9c9c-a3b71139de37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:13.759464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564be75-630a-4275-9c9c-a3b71139de37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:13.763215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564be75-630a-4275-9c9c-a3b71139de37 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:13.782076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 936/1866] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:13.783680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2bcdf2-ec27-4392-b82d-b45f85d743a9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:13.811418 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2bcdf2-ec27-4392-b82d-b45f85d743a9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:13.819927 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f40070-d57d-4018-b88d-65414c44580f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:13.820963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f40070-d57d-4018-b88d-65414c44580f admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:13.821392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f40070-d57d-4018-b88d-65414c44580f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:13.821769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f40070-d57d-4018-b88d-65414c44580f admin admin] PATH_INFO: `/v3/projects/eb962cc38f54499d8e2128d551657185/users/6095575c8d994029b9864fc1fd9578a4/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:13.824441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f40070-d57d-4018-b88d-65414c44580f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb962cc38f54499d8e2128d551657185, user_id=6095575c8d994029b9864fc1fd9578a4, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:13.827919 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f40070-d57d-4018-b88d-65414c44580f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:13.851965 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 931/1867] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:54:13 2022] PUT /identity/v3/projects/eb962cc38f54499d8e2128d551657185/users/6095575c8d994029b9864fc1fd9578a4/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:14.178031 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:14.336405 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:15.367302 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd914a0-7611-44ef-8109-99f113ba75d6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:15.367755 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd914a0-7611-44ef-8109-99f113ba75d6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:15.370527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd914a0-7611-44ef-8109-99f113ba75d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:15.400737 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-cbd914a0-7611-44ef-8109-99f113ba75d6 None None] MFA Rules not processed for user `6095575c8d994029b9864fc1fd9578a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:15.402025 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cbd914a0-7611-44ef-8109-99f113ba75d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:15.444862 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:15.504053 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 937/1868] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:15 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:15.518707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f40070-d57d-4018-b88d-65414c44580f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:15.521152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-24f40070-d57d-4018-b88d-65414c44580f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:15.556841 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:15.608736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f40070-d57d-4018-b88d-65414c44580f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:15.612749 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecb3e4-ae7c-44c6-b755-85bd51ee3b2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:15.613456 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecb3e4-ae7c-44c6-b755-85bd51ee3b2a service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:15.614481 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecb3e4-ae7c-44c6-b755-85bd51ee3b2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:15.614775 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecb3e4-ae7c-44c6-b755-85bd51ee3b2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:15.694500 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ecb3e4-ae7c-44c6-b755-85bd51ee3b2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:15.696061 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ecb3e4-ae7c-44c6-b755-85bd51ee3b2a service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:15.707314 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 932/1869] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:54:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:54:16.740966 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:16.896503 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:17.330739 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:17.429908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:17.479398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:17.729280 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:18.255020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:INSERT=3,keystone:SELECT=82,keystone:DELETE=15 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:18.404824 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:18.986100 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:19.604972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd914a0-7611-44ef-8109-99f113ba75d6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:19.614706 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd914a0-7611-44ef-8109-99f113ba75d6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:19.619022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0811bb-08dc-41a4-b262-33c519646324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:19.619717 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0811bb-08dc-41a4-b262-33c519646324 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:19.619989 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0811bb-08dc-41a4-b262-33c519646324 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:19.620255 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0811bb-08dc-41a4-b262-33c519646324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:19.631280 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0811bb-08dc-41a4-b262-33c519646324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:19.632724 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0811bb-08dc-41a4-b262-33c519646324 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:19.646047 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 938/1870] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:54:19 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:54:20.761779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:29.640048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=60 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:31.873043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=33 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:32.864212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecb3e4-ae7c-44c6-b755-85bd51ee3b2a service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:32.865945 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-91ecb3e4-ae7c-44c6-b755-85bd51ee3b2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:33.057666 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecb3e4-ae7c-44c6-b755-85bd51ee3b2a service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:33.062465 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130860c-a707-45e1-a6d3-aa9aab898af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:33.063369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130860c-a707-45e1-a6d3-aa9aab898af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:33.063682 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130860c-a707-45e1-a6d3-aa9aab898af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:33.063962 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130860c-a707-45e1-a6d3-aa9aab898af1 admin admin] PATH_INFO: `/v3/users/ef8e816182d948669afd46bb6a4f8bc4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:33.065182 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130860c-a707-45e1-a6d3-aa9aab898af1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef8e816182d948669afd46bb6a4f8bc4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:33.071913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130860c-a707-45e1-a6d3-aa9aab898af1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:33.393998 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f130860c-a707-45e1-a6d3-aa9aab898af1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef8e816182d948669afd46bb6a4f8bc4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:33.489718 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f130860c-a707-45e1-a6d3-aa9aab898af1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef8e816182d948669afd46bb6a4f8bc4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:33.490539 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f130860c-a707-45e1-a6d3-aa9aab898af1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef8e816182d948669afd46bb6a4f8bc4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:33.491618 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f130860c-a707-45e1-a6d3-aa9aab898af1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef8e816182d948669afd46bb6a4f8bc4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:33.519422 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f130860c-a707-45e1-a6d3-aa9aab898af1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef8e816182d948669afd46bb6a4f8bc4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:33.558773 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 933/1871] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:54:32 2022] DELETE /identity/v3/users/ef8e816182d948669afd46bb6a4f8bc4 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:33.567985 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979d02f-e5f1-43be-a41d-775c8c1a91f3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:33.568632 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979d02f-e5f1-43be-a41d-775c8c1a91f3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:33.568632 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979d02f-e5f1-43be-a41d-775c8c1a91f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:33.602283 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7979d02f-e5f1-43be-a41d-775c8c1a91f3 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:33.603630 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7979d02f-e5f1-43be-a41d-775c8c1a91f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:33.698424 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 939/1872] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:33.709096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130860c-a707-45e1-a6d3-aa9aab898af1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:33.710766 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f130860c-a707-45e1-a6d3-aa9aab898af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:33.738338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:33.851726 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130860c-a707-45e1-a6d3-aa9aab898af1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:33.856288 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84d475-569e-4ec0-9a67-204a6253a088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:33.857149 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84d475-569e-4ec0-9a67-204a6253a088 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:33.857306 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84d475-569e-4ec0-9a67-204a6253a088 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:33.857546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84d475-569e-4ec0-9a67-204a6253a088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:33.868924 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84d475-569e-4ec0-9a67-204a6253a088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:33.870362 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84d475-569e-4ec0-9a67-204a6253a088 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:33.881161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 934/1873] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:54:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:34.404682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979d02f-e5f1-43be-a41d-775c8c1a91f3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:34.410842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7979d02f-e5f1-43be-a41d-775c8c1a91f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:34.434136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979d02f-e5f1-43be-a41d-775c8c1a91f3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:34.441839 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1403f-1b39-4743-8c51-3b3248fac553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:34.443361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1403f-1b39-4743-8c51-3b3248fac553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:34.443912 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1403f-1b39-4743-8c51-3b3248fac553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:34.444328 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1403f-1b39-4743-8c51-3b3248fac553 admin admin] PATH_INFO: `/v3/projects/d90d0c7518e244b1b81401000646c61e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:34.448157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1403f-1b39-4743-8c51-3b3248fac553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d90d0c7518e244b1b81401000646c61e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:34.450576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1403f-1b39-4743-8c51-3b3248fac553 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:34.598658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9ce1403f-1b39-4743-8c51-3b3248fac553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd90d0c7518e244b1b81401000646c61e', 'request_id': 'req-9ce1403f-1b39-4743-8c51-3b3248fac553'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:34.695581 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9ce1403f-1b39-4743-8c51-3b3248fac553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd90d0c7518e244b1b81401000646c61e', 'request_id': 'req-9ce1403f-1b39-4743-8c51-3b3248fac553'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:34.705324 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9ce1403f-1b39-4743-8c51-3b3248fac553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd90d0c7518e244b1b81401000646c61e', 'request_id': 'req-9ce1403f-1b39-4743-8c51-3b3248fac553'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:34.721839 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9ce1403f-1b39-4743-8c51-3b3248fac553 admin admin] The token cache is being invalidate because project d90d0c7518e244b1b81401000646c61e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:34.723172 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9ce1403f-1b39-4743-8c51-3b3248fac553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:34.723958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9ce1403f-1b39-4743-8c51-3b3248fac553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:34.726889 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 940/1874] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:54:34 2022] DELETE /identity/v3/projects/d90d0c7518e244b1b81401000646c61e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:34.731742 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84d475-569e-4ec0-9a67-204a6253a088 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:34.746304 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84d475-569e-4ec0-9a67-204a6253a088 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:34.860771 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446fd57-13b5-455d-8297-04561a020825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:34.861640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446fd57-13b5-455d-8297-04561a020825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:34.861923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446fd57-13b5-455d-8297-04561a020825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:34.862201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446fd57-13b5-455d-8297-04561a020825 admin admin] PATH_INFO: `/v3/users/2bde5dd41dbd4650b67a35843e69069b` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:34.863467 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446fd57-13b5-455d-8297-04561a020825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bde5dd41dbd4650b67a35843e69069b)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:34.865620 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446fd57-13b5-455d-8297-04561a020825 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:35.073678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1446fd57-13b5-455d-8297-04561a020825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bde5dd41dbd4650b67a35843e69069b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:35.153224 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1446fd57-13b5-455d-8297-04561a020825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bde5dd41dbd4650b67a35843e69069b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:35.154248 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1446fd57-13b5-455d-8297-04561a020825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bde5dd41dbd4650b67a35843e69069b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:35.155472 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1446fd57-13b5-455d-8297-04561a020825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bde5dd41dbd4650b67a35843e69069b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:35.165813 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1446fd57-13b5-455d-8297-04561a020825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bde5dd41dbd4650b67a35843e69069b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:35.186645 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 935/1875] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:54:34 2022] DELETE /identity/v3/users/2bde5dd41dbd4650b67a35843e69069b => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:35.687157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1403f-1b39-4743-8c51-3b3248fac553 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:35.690170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9ce1403f-1b39-4743-8c51-3b3248fac553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:35.726409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1403f-1b39-4743-8c51-3b3248fac553 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:35.793307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec48675-4034-4066-886a-40a872a8ca2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:35.794299 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec48675-4034-4066-886a-40a872a8ca2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:35.794516 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec48675-4034-4066-886a-40a872a8ca2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:35.794766 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec48675-4034-4066-886a-40a872a8ca2c admin admin] PATH_INFO: `/v3/projects/7c9ee7780cdc4e99967cfd05ef397071` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:35.796037 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec48675-4034-4066-886a-40a872a8ca2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c9ee7780cdc4e99967cfd05ef397071)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:35.798254 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec48675-4034-4066-886a-40a872a8ca2c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:35.827794 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:35.924584 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4ec48675-4034-4066-886a-40a872a8ca2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c9ee7780cdc4e99967cfd05ef397071', 'request_id': 'req-4ec48675-4034-4066-886a-40a872a8ca2c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:36.010470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4ec48675-4034-4066-886a-40a872a8ca2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c9ee7780cdc4e99967cfd05ef397071', 'request_id': 'req-4ec48675-4034-4066-886a-40a872a8ca2c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:36.019798 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4ec48675-4034-4066-886a-40a872a8ca2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c9ee7780cdc4e99967cfd05ef397071', 'request_id': 'req-4ec48675-4034-4066-886a-40a872a8ca2c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:36.032139 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4ec48675-4034-4066-886a-40a872a8ca2c admin admin] The token cache is being invalidate because project 7c9ee7780cdc4e99967cfd05ef397071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:36.032483 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4ec48675-4034-4066-886a-40a872a8ca2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:36.033078 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4ec48675-4034-4066-886a-40a872a8ca2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:36.034651 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 941/1876] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:54:35 2022] DELETE /identity/v3/projects/7c9ee7780cdc4e99967cfd05ef397071 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:36.041473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3cb47-bd64-44a0-8178-c830df576a4e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:36.042030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3cb47-bd64-44a0-8178-c830df576a4e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:36.042422 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3cb47-bd64-44a0-8178-c830df576a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:36.049320 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:36.103851 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-18f3cb47-bd64-44a0-8178-c830df576a4e None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:36.105079 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-18f3cb47-bd64-44a0-8178-c830df576a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:36.197124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 936/1877] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:54:36.205828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602a268-d1c4-456c-9c5c-f28b31eafe4e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:36.206328 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602a268-d1c4-456c-9c5c-f28b31eafe4e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:36.206758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602a268-d1c4-456c-9c5c-f28b31eafe4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:36.231170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d602a268-d1c4-456c-9c5c-f28b31eafe4e None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:36.232391 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d602a268-d1c4-456c-9c5c-f28b31eafe4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:36.242778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 942/1878] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:36.248819 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3cb47-bd64-44a0-8178-c830df576a4e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:36.264669 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3cb47-bd64-44a0-8178-c830df576a4e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:36.268043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4dbe7-5421-48cf-aabe-075ed8c2b4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:36.268938 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4dbe7-5421-48cf-aabe-075ed8c2b4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:36.269376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4dbe7-5421-48cf-aabe-075ed8c2b4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:36.269760 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4dbe7-5421-48cf-aabe-075ed8c2b4c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:36.270763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4dbe7-5421-48cf-aabe-075ed8c2b4c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:54:36.271318 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4dbe7-5421-48cf-aabe-075ed8c2b4c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:36.273489 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4dbe7-5421-48cf-aabe-075ed8c2b4c9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:36.293771 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 937/1879] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:54:36.295717 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602a268-d1c4-456c-9c5c-f28b31eafe4e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:36.308004 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602a268-d1c4-456c-9c5c-f28b31eafe4e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:36.313140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228fcaa-5fc2-401d-922c-bdeb69729d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:36.316274 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228fcaa-5fc2-401d-922c-bdeb69729d60 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:36.316274 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228fcaa-5fc2-401d-922c-bdeb69729d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:36.316274 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228fcaa-5fc2-401d-922c-bdeb69729d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:36.316274 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228fcaa-5fc2-401d-922c-bdeb69729d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:36.317217 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228fcaa-5fc2-401d-922c-bdeb69729d60 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:36.432811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 943/1880] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:54:36 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:36.434062 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4dbe7-5421-48cf-aabe-075ed8c2b4c9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:36.444825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4dbe7-5421-48cf-aabe-075ed8c2b4c9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:36.512170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60471e83-1da4-4110-be9c-26d49b64226e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:36.512859 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60471e83-1da4-4110-be9c-26d49b64226e admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:36.513142 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60471e83-1da4-4110-be9c-26d49b64226e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:36.513469 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60471e83-1da4-4110-be9c-26d49b64226e admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:36.514220 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60471e83-1da4-4110-be9c-26d49b64226e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:36.516148 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60471e83-1da4-4110-be9c-26d49b64226e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:36.623250 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 938/1881] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:54:36 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:54:36.627517 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228fcaa-5fc2-401d-922c-bdeb69729d60 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:36.639371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228fcaa-5fc2-401d-922c-bdeb69729d60 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:36.644619 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a192b1-3795-46a8-a3ef-53e28dce0980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:36.645344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a192b1-3795-46a8-a3ef-53e28dce0980 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:36.645633 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a192b1-3795-46a8-a3ef-53e28dce0980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:36.645915 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a192b1-3795-46a8-a3ef-53e28dce0980 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:36.646659 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a192b1-3795-46a8-a3ef-53e28dce0980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:36.649062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a192b1-3795-46a8-a3ef-53e28dce0980 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:36.667073 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 944/1882] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:36.667285 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60471e83-1da4-4110-be9c-26d49b64226e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:36.684953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60471e83-1da4-4110-be9c-26d49b64226e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:36.699300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac914a1a-8488-49bd-9028-c63ec678d4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:36.702137 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac914a1a-8488-49bd-9028-c63ec678d4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:36.702137 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac914a1a-8488-49bd-9028-c63ec678d4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:36.702137 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac914a1a-8488-49bd-9028-c63ec678d4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:36.702137 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac914a1a-8488-49bd-9028-c63ec678d4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:36.703330 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac914a1a-8488-49bd-9028-c63ec678d4d3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:36.716215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 939/1883] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:36.720844 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a192b1-3795-46a8-a3ef-53e28dce0980 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:36.731950 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a192b1-3795-46a8-a3ef-53e28dce0980 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:36.737590 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db694d-af1e-43dc-b1a0-984f5101d847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:36.739058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db694d-af1e-43dc-b1a0-984f5101d847 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:36.741780 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db694d-af1e-43dc-b1a0-984f5101d847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:36.741780 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db694d-af1e-43dc-b1a0-984f5101d847 admin admin] PATH_INFO: `/v3/projects/32e515d09bde410a9fc2fbc01bb16b78/users/fc85d3d6232a47f5b54c872284361eba/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:36.766091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db694d-af1e-43dc-b1a0-984f5101d847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e515d09bde410a9fc2fbc01bb16b78, user_id=fc85d3d6232a47f5b54c872284361eba, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:36.768844 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db694d-af1e-43dc-b1a0-984f5101d847 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:36.913895 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 945/1884] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:54:36 2022] PUT /identity/v3/projects/32e515d09bde410a9fc2fbc01bb16b78/users/fc85d3d6232a47f5b54c872284361eba/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:36.925460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e3498-5771-4172-bf11-53348e6ab4e0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:36.925748 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e3498-5771-4172-bf11-53348e6ab4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:36.926029 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e3498-5771-4172-bf11-53348e6ab4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:36.954485 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fb9e3498-5771-4172-bf11-53348e6ab4e0 None None] MFA Rules not processed for user `fc85d3d6232a47f5b54c872284361eba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:36.955694 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fb9e3498-5771-4172-bf11-53348e6ab4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:37.005180 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:37.028223 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 940/1885] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:37.032905 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db694d-af1e-43dc-b1a0-984f5101d847 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:37.103604 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db694d-af1e-43dc-b1a0-984f5101d847 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:37.109044 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d5805-16e2-4f92-8ad9-07ee6af565b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:37.109887 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d5805-16e2-4f92-8ad9-07ee6af565b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:37.114525 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d5805-16e2-4f92-8ad9-07ee6af565b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:37.114525 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d5805-16e2-4f92-8ad9-07ee6af565b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:37.114525 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d5805-16e2-4f92-8ad9-07ee6af565b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:37.114525 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d5805-16e2-4f92-8ad9-07ee6af565b4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:37.260053 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 946/1886] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:54:37 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:37.264958 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e3498-5771-4172-bf11-53348e6ab4e0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:37.279994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e3498-5771-4172-bf11-53348e6ab4e0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:37.362955 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595f8f0-0bbb-45aa-b3b6-b81ff7418c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:37.363923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595f8f0-0bbb-45aa-b3b6-b81ff7418c5a admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:37.363923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595f8f0-0bbb-45aa-b3b6-b81ff7418c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:37.364212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595f8f0-0bbb-45aa-b3b6-b81ff7418c5a admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:37.364997 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595f8f0-0bbb-45aa-b3b6-b81ff7418c5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:37.366933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595f8f0-0bbb-45aa-b3b6-b81ff7418c5a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:37.493510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 941/1887] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:54:37 2022] POST /identity/v3/users => generated 295 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:37.498316 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d5805-16e2-4f92-8ad9-07ee6af565b4 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:37.510343 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d5805-16e2-4f92-8ad9-07ee6af565b4 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:37.516671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243da255-0365-48ef-91b5-b0f66fdfefe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:37.517562 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243da255-0365-48ef-91b5-b0f66fdfefe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:37.517894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243da255-0365-48ef-91b5-b0f66fdfefe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:37.518218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243da255-0365-48ef-91b5-b0f66fdfefe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:37.519070 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243da255-0365-48ef-91b5-b0f66fdfefe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:37.520862 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243da255-0365-48ef-91b5-b0f66fdfefe4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:37.537070 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 947/1888] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:37.544622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595f8f0-0bbb-45aa-b3b6-b81ff7418c5a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:37.560132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595f8f0-0bbb-45aa-b3b6-b81ff7418c5a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:37.565949 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3a683-f24e-4699-8e24-b983551f6673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:37.567128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3a683-f24e-4699-8e24-b983551f6673 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:37.567528 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3a683-f24e-4699-8e24-b983551f6673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:37.567934 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3a683-f24e-4699-8e24-b983551f6673 admin admin] PATH_INFO: `/v3/projects/b0f527c32b4346f69be1761f710f139c/users/05c38dbd8f104704be43e35379861bc0/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:37.593831 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3a683-f24e-4699-8e24-b983551f6673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f527c32b4346f69be1761f710f139c, user_id=05c38dbd8f104704be43e35379861bc0, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:37.599584 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3a683-f24e-4699-8e24-b983551f6673 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:37.692433 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 942/1889] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:54:37 2022] PUT /identity/v3/projects/b0f527c32b4346f69be1761f710f139c/users/05c38dbd8f104704be43e35379861bc0/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:37.694982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243da255-0365-48ef-91b5-b0f66fdfefe4 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:37.712689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243da255-0365-48ef-91b5-b0f66fdfefe4 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:37.736043 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:37.807425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496eed34-b118-4ad9-8b1f-ab36bd9f449f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:37.809672 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eed34-b118-4ad9-8b1f-ab36bd9f449f admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:37.809672 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eed34-b118-4ad9-8b1f-ab36bd9f449f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:37.810257 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eed34-b118-4ad9-8b1f-ab36bd9f449f admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:37.811058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496eed34-b118-4ad9-8b1f-ab36bd9f449f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:37.815084 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496eed34-b118-4ad9-8b1f-ab36bd9f449f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:37.833498 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 948/1890] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:37.835414 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3a683-f24e-4699-8e24-b983551f6673 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:37.860026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3a683-f24e-4699-8e24-b983551f6673 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:37.866330 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0eb2f-f134-4d63-9de4-3caceb4038db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:37.866330 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0eb2f-f134-4d63-9de4-3caceb4038db admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:37.866330 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0eb2f-f134-4d63-9de4-3caceb4038db admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:37.866330 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0eb2f-f134-4d63-9de4-3caceb4038db admin admin] PATH_INFO: `/v3/projects/b0f527c32b4346f69be1761f710f139c/users/05c38dbd8f104704be43e35379861bc0/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:37.869319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0eb2f-f134-4d63-9de4-3caceb4038db admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f527c32b4346f69be1761f710f139c, user_id=05c38dbd8f104704be43e35379861bc0, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:37.872481 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0eb2f-f134-4d63-9de4-3caceb4038db admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:37.888262 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 943/1891] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:54:37 2022] PUT /identity/v3/projects/b0f527c32b4346f69be1761f710f139c/users/05c38dbd8f104704be43e35379861bc0/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:37.899256 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1cd6e-12f7-4b64-bb29-114d96a4465d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:37.900807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1cd6e-12f7-4b64-bb29-114d96a4465d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:37.900807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1cd6e-12f7-4b64-bb29-114d96a4465d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:37.930069 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-eea1cd6e-12f7-4b64-bb29-114d96a4465d None None] MFA Rules not processed for user `05c38dbd8f104704be43e35379861bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:37.931955 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-eea1cd6e-12f7-4b64-bb29-114d96a4465d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:38.043434 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 949/1892] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:38.062429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0eb2f-f134-4d63-9de4-3caceb4038db admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:38.065040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-61f0eb2f-f134-4d63-9de4-3caceb4038db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:38.132307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0eb2f-f134-4d63-9de4-3caceb4038db admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:38.137602 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca3bd0-adc2-4078-b9ee-371cc053e9cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:38.138294 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca3bd0-adc2-4078-b9ee-371cc053e9cc service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:38.138588 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca3bd0-adc2-4078-b9ee-371cc053e9cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:38.139518 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca3bd0-adc2-4078-b9ee-371cc053e9cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:38.213208 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:38.221037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca3bd0-adc2-4078-b9ee-371cc053e9cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:38.222546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca3bd0-adc2-4078-b9ee-371cc053e9cc service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:38.233880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 944/1893] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:54:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:54:48.040992 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=55 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:48.433033 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:52.685510 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1cd6e-12f7-4b64-bb29-114d96a4465d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:52.687958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-eea1cd6e-12f7-4b64-bb29-114d96a4465d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:52.705090 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1cd6e-12f7-4b64-bb29-114d96a4465d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:52.710998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a41190-10e9-4e6c-84b0-73b5e0ecac4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:52.715650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a41190-10e9-4e6c-84b0-73b5e0ecac4b service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:52.715650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a41190-10e9-4e6c-84b0-73b5e0ecac4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:52.715650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a41190-10e9-4e6c-84b0-73b5e0ecac4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:52.726736 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a41190-10e9-4e6c-84b0-73b5e0ecac4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:52.728741 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a41190-10e9-4e6c-84b0-73b5e0ecac4b service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:52.740200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 950/1894] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:54:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:54.861114 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca3bd0-adc2-4078-b9ee-371cc053e9cc service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:54.862687 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8fca3bd0-adc2-4078-b9ee-371cc053e9cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:54.930766 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca3bd0-adc2-4078-b9ee-371cc053e9cc service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:54.936988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7ef4c-b86d-4e66-9acd-0de9c3411a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:54.938002 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7ef4c-b86d-4e66-9acd-0de9c3411a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:54.938287 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7ef4c-b86d-4e66-9acd-0de9c3411a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:54.938558 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7ef4c-b86d-4e66-9acd-0de9c3411a82 admin admin] PATH_INFO: `/v3/users/b8f3a5ad4ad0492e98a051930d63b6e0` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:54.939786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7ef4c-b86d-4e66-9acd-0de9c3411a82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8f3a5ad4ad0492e98a051930d63b6e0)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:54.941742 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7ef4c-b86d-4e66-9acd-0de9c3411a82 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:55.105039 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7df7ef4c-b86d-4e66-9acd-0de9c3411a82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8f3a5ad4ad0492e98a051930d63b6e0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:55.169798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7df7ef4c-b86d-4e66-9acd-0de9c3411a82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8f3a5ad4ad0492e98a051930d63b6e0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:55.170420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7df7ef4c-b86d-4e66-9acd-0de9c3411a82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8f3a5ad4ad0492e98a051930d63b6e0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:55.171023 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7df7ef4c-b86d-4e66-9acd-0de9c3411a82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8f3a5ad4ad0492e98a051930d63b6e0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:55.178606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7df7ef4c-b86d-4e66-9acd-0de9c3411a82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8f3a5ad4ad0492e98a051930d63b6e0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:55.197832 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 945/1895] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:54:54 2022] DELETE /identity/v3/users/b8f3a5ad4ad0492e98a051930d63b6e0 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:55.202380 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8a3d4-7f7d-4783-998f-7d80facf51d8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:55.202884 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8a3d4-7f7d-4783-998f-7d80facf51d8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:55.202974 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8a3d4-7f7d-4783-998f-7d80facf51d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:55.221624 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-bce8a3d4-7f7d-4783-998f-7d80facf51d8 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:55.223077 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bce8a3d4-7f7d-4783-998f-7d80facf51d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:55.288090 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 951/1896] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:55.298064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7ef4c-b86d-4e66-9acd-0de9c3411a82 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:55.299489 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7df7ef4c-b86d-4e66-9acd-0de9c3411a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:55.360966 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7ef4c-b86d-4e66-9acd-0de9c3411a82 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:55.364898 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac7806-3082-4ff6-a13b-04d38d23a623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:55.365621 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac7806-3082-4ff6-a13b-04d38d23a623 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:55.365903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac7806-3082-4ff6-a13b-04d38d23a623 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:55.366173 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac7806-3082-4ff6-a13b-04d38d23a623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:55.378091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac7806-3082-4ff6-a13b-04d38d23a623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:55.379593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac7806-3082-4ff6-a13b-04d38d23a623 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:55.391902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 946/1897] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:54:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:55.962223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8a3d4-7f7d-4783-998f-7d80facf51d8 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:55.963750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bce8a3d4-7f7d-4783-998f-7d80facf51d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:55.979141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8a3d4-7f7d-4783-998f-7d80facf51d8 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:55.984063 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce56cc-a9c3-47f5-892d-e1ea56f622e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:55.986870 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce56cc-a9c3-47f5-892d-e1ea56f622e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:55.986870 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce56cc-a9c3-47f5-892d-e1ea56f622e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:55.986870 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce56cc-a9c3-47f5-892d-e1ea56f622e0 admin admin] PATH_INFO: `/v3/projects/b9e9f7da0b1c4ed9aee58d936cd30d4d` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:55.986870 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce56cc-a9c3-47f5-892d-e1ea56f622e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9e9f7da0b1c4ed9aee58d936cd30d4d)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:55.988769 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce56cc-a9c3-47f5-892d-e1ea56f622e0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:56.131320 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bfce56cc-a9c3-47f5-892d-e1ea56f622e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9e9f7da0b1c4ed9aee58d936cd30d4d', 'request_id': 'req-bfce56cc-a9c3-47f5-892d-e1ea56f622e0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:56.197607 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bfce56cc-a9c3-47f5-892d-e1ea56f622e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9e9f7da0b1c4ed9aee58d936cd30d4d', 'request_id': 'req-bfce56cc-a9c3-47f5-892d-e1ea56f622e0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:56.206631 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bfce56cc-a9c3-47f5-892d-e1ea56f622e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9e9f7da0b1c4ed9aee58d936cd30d4d', 'request_id': 'req-bfce56cc-a9c3-47f5-892d-e1ea56f622e0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:56.217865 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bfce56cc-a9c3-47f5-892d-e1ea56f622e0 admin admin] The token cache is being invalidate because project b9e9f7da0b1c4ed9aee58d936cd30d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:56.218296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bfce56cc-a9c3-47f5-892d-e1ea56f622e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:56.218956 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bfce56cc-a9c3-47f5-892d-e1ea56f622e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:56.220814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 952/1898] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:54:55 2022] DELETE /identity/v3/projects/b9e9f7da0b1c4ed9aee58d936cd30d4d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:54:56.225458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac7806-3082-4ff6-a13b-04d38d23a623 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:56.239930 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac7806-3082-4ff6-a13b-04d38d23a623 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:56.262384 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:56.312065 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77cfeb-cb87-42af-b429-ebb6c15f7c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:56.312967 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77cfeb-cb87-42af-b429-ebb6c15f7c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:56.313248 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77cfeb-cb87-42af-b429-ebb6c15f7c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:56.313628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77cfeb-cb87-42af-b429-ebb6c15f7c20 admin admin] PATH_INFO: `/v3/users/24268ad4ac404f93ba0a099936dc52aa` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:56.314872 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77cfeb-cb87-42af-b429-ebb6c15f7c20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24268ad4ac404f93ba0a099936dc52aa)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:56.316874 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77cfeb-cb87-42af-b429-ebb6c15f7c20 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:56.522628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0e77cfeb-cb87-42af-b429-ebb6c15f7c20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24268ad4ac404f93ba0a099936dc52aa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:56.614424 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0e77cfeb-cb87-42af-b429-ebb6c15f7c20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24268ad4ac404f93ba0a099936dc52aa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:56.615076 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0e77cfeb-cb87-42af-b429-ebb6c15f7c20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24268ad4ac404f93ba0a099936dc52aa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:56.615683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0e77cfeb-cb87-42af-b429-ebb6c15f7c20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24268ad4ac404f93ba0a099936dc52aa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:56.626220 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0e77cfeb-cb87-42af-b429-ebb6c15f7c20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24268ad4ac404f93ba0a099936dc52aa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:56.645301 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 947/1899] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:54:56 2022] DELETE /identity/v3/users/24268ad4ac404f93ba0a099936dc52aa => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:57.116399 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce56cc-a9c3-47f5-892d-e1ea56f622e0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:57.121148 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bfce56cc-a9c3-47f5-892d-e1ea56f622e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:57.139950 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce56cc-a9c3-47f5-892d-e1ea56f622e0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:57.232340 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2134613-f316-4bdf-9707-148e0d37df08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:57.233243 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2134613-f316-4bdf-9707-148e0d37df08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:57.233528 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2134613-f316-4bdf-9707-148e0d37df08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:57.233797 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2134613-f316-4bdf-9707-148e0d37df08 admin admin] PATH_INFO: `/v3/projects/fef0b12542dc4358aec0968bd61f3331` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:57.235226 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2134613-f316-4bdf-9707-148e0d37df08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fef0b12542dc4358aec0968bd61f3331)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:57.237244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2134613-f316-4bdf-9707-148e0d37df08 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:57.251432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:57.361482 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e2134613-f316-4bdf-9707-148e0d37df08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fef0b12542dc4358aec0968bd61f3331', 'request_id': 'req-e2134613-f316-4bdf-9707-148e0d37df08'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:57.450011 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e2134613-f316-4bdf-9707-148e0d37df08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fef0b12542dc4358aec0968bd61f3331', 'request_id': 'req-e2134613-f316-4bdf-9707-148e0d37df08'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:57.457513 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e2134613-f316-4bdf-9707-148e0d37df08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fef0b12542dc4358aec0968bd61f3331', 'request_id': 'req-e2134613-f316-4bdf-9707-148e0d37df08'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:57.468692 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e2134613-f316-4bdf-9707-148e0d37df08 admin admin] The token cache is being invalidate because project fef0b12542dc4358aec0968bd61f3331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:57.468981 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e2134613-f316-4bdf-9707-148e0d37df08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:57.469645 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e2134613-f316-4bdf-9707-148e0d37df08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:57.471613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 953/1900] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:54:57 2022] DELETE /identity/v3/projects/fef0b12542dc4358aec0968bd61f3331 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:57.476860 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca58c7-3059-4ab4-8723-482ddeb2b221 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:57.478429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca58c7-3059-4ab4-8723-482ddeb2b221 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:57.478429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca58c7-3059-4ab4-8723-482ddeb2b221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:57.510804 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1eca58c7-3059-4ab4-8723-482ddeb2b221 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:57.512010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1eca58c7-3059-4ab4-8723-482ddeb2b221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:57.576414 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 948/1901] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:57.585089 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ab313-b4be-4bfb-a9a3-d3da2d54e17e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:57.585492 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ab313-b4be-4bfb-a9a3-d3da2d54e17e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:57.585778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ab313-b4be-4bfb-a9a3-d3da2d54e17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:57.607500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-234ab313-b4be-4bfb-a9a3-d3da2d54e17e None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:57.608797 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-234ab313-b4be-4bfb-a9a3-d3da2d54e17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:57.617307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 954/1902] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:57.621427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca58c7-3059-4ab4-8723-482ddeb2b221 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:57.637152 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca58c7-3059-4ab4-8723-482ddeb2b221 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:57.645801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec9d2f-57e9-4cb0-84bc-a5327dbea0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:57.646498 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec9d2f-57e9-4cb0-84bc-a5327dbea0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:57.649513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec9d2f-57e9-4cb0-84bc-a5327dbea0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:57.649513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec9d2f-57e9-4cb0-84bc-a5327dbea0d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:57.649513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec9d2f-57e9-4cb0-84bc-a5327dbea0d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:54:57.649513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec9d2f-57e9-4cb0-84bc-a5327dbea0d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:57.651405 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec9d2f-57e9-4cb0-84bc-a5327dbea0d3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:57.667476 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 949/1903] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:54:57.668672 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ab313-b4be-4bfb-a9a3-d3da2d54e17e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:57.679300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ab313-b4be-4bfb-a9a3-d3da2d54e17e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:57.685168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecaae8-4e88-47d7-9379-9b6aefe7a4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:57.685884 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecaae8-4e88-47d7-9379-9b6aefe7a4aa admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:57.686165 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecaae8-4e88-47d7-9379-9b6aefe7a4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:57.686428 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecaae8-4e88-47d7-9379-9b6aefe7a4aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:57.687157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecaae8-4e88-47d7-9379-9b6aefe7a4aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:57.689133 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecaae8-4e88-47d7-9379-9b6aefe7a4aa admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:57.806406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 955/1904] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:54:57 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:57.810962 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec9d2f-57e9-4cb0-84bc-a5327dbea0d3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:57.822092 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec9d2f-57e9-4cb0-84bc-a5327dbea0d3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:57.841576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:57.892286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6743641-d2ac-4cc8-b971-34ba4f961ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:57.892885 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6743641-d2ac-4cc8-b971-34ba4f961ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:57.893169 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6743641-d2ac-4cc8-b971-34ba4f961ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:57.893479 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6743641-d2ac-4cc8-b971-34ba4f961ba0 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:57.894237 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6743641-d2ac-4cc8-b971-34ba4f961ba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:57.896335 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6743641-d2ac-4cc8-b971-34ba4f961ba0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:58.049254 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 950/1905] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:54:57 2022] POST /identity/v3/users => generated 294 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:54:58.053765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecaae8-4e88-47d7-9379-9b6aefe7a4aa admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:58.079933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecaae8-4e88-47d7-9379-9b6aefe7a4aa admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:58.096392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1194e4-3ffe-4226-8e64-c70202780bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:58.097115 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1194e4-3ffe-4226-8e64-c70202780bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:58.097695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1194e4-3ffe-4226-8e64-c70202780bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:58.097836 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1194e4-3ffe-4226-8e64-c70202780bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:58.099476 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1194e4-3ffe-4226-8e64-c70202780bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:58.101774 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1194e4-3ffe-4226-8e64-c70202780bd6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:58.119709 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 956/1906] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:54:58.125021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6743641-d2ac-4cc8-b971-34ba4f961ba0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:58.140630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6743641-d2ac-4cc8-b971-34ba4f961ba0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:58.147123 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061bdbe2-65ee-4390-b558-a781ea04e124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:58.147743 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bdbe2-65ee-4390-b558-a781ea04e124 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:58.148034 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bdbe2-65ee-4390-b558-a781ea04e124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:58.148307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bdbe2-65ee-4390-b558-a781ea04e124 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:58.149385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061bdbe2-65ee-4390-b558-a781ea04e124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:58.151020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061bdbe2-65ee-4390-b558-a781ea04e124 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:58.166501 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 951/1907] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:58.174431 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1194e4-3ffe-4226-8e64-c70202780bd6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:58.187006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1194e4-3ffe-4226-8e64-c70202780bd6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:58.192619 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b2c0f-bb04-4b26-8678-d75c09066310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:58.193605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b2c0f-bb04-4b26-8678-d75c09066310 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:58.193882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b2c0f-bb04-4b26-8678-d75c09066310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:58.194155 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b2c0f-bb04-4b26-8678-d75c09066310 admin admin] PATH_INFO: `/v3/projects/33e4b0e8cfe047a6b81b95f02657a953/users/1c9eb85695884cc19e16fde0efbf63ef/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:58.215108 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b2c0f-bb04-4b26-8678-d75c09066310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e4b0e8cfe047a6b81b95f02657a953, user_id=1c9eb85695884cc19e16fde0efbf63ef, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:58.219249 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b2c0f-bb04-4b26-8678-d75c09066310 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:58.341520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 957/1908] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:54:58 2022] PUT /identity/v3/projects/33e4b0e8cfe047a6b81b95f02657a953/users/1c9eb85695884cc19e16fde0efbf63ef/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:58.359794 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b90ce-7923-43a6-839f-8c8e730260c3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:58.360087 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b90ce-7923-43a6-839f-8c8e730260c3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:58.360377 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b90ce-7923-43a6-839f-8c8e730260c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:58.365225 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b2c0f-bb04-4b26-8678-d75c09066310 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:58.367205 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4a7b2c0f-bb04-4b26-8678-d75c09066310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:58.391337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0c7b90ce-7923-43a6-839f-8c8e730260c3 None None] MFA Rules not processed for user `1c9eb85695884cc19e16fde0efbf63ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:58.393077 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0c7b90ce-7923-43a6-839f-8c8e730260c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:58.447512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b2c0f-bb04-4b26-8678-d75c09066310 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:58.452695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f4802-b724-4b25-85ab-2ff6412d1785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:58.453629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f4802-b724-4b25-85ab-2ff6412d1785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:58.453911 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f4802-b724-4b25-85ab-2ff6412d1785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:58.454187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f4802-b724-4b25-85ab-2ff6412d1785 admin admin] PATH_INFO: `/v3/users/ff8823568ae744809ad012062b47fda7` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:58.455459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f4802-b724-4b25-85ab-2ff6412d1785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff8823568ae744809ad012062b47fda7)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:58.457445 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f4802-b724-4b25-85ab-2ff6412d1785 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:58.466563 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 952/1909] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:58.471370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b90ce-7923-43a6-839f-8c8e730260c3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:58.483477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b90ce-7923-43a6-839f-8c8e730260c3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:58.488330 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeeb14b-3926-44e2-8950-685a6633ed39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:58.489031 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeeb14b-3926-44e2-8950-685a6633ed39 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:58.489344 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeeb14b-3926-44e2-8950-685a6633ed39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:58.489620 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeeb14b-3926-44e2-8950-685a6633ed39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:58.490309 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeeb14b-3926-44e2-8950-685a6633ed39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:58.492213 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeeb14b-3926-44e2-8950-685a6633ed39 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:58.640706 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 953/1910] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:54:58 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:54:58.642480 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeeb14b-3926-44e2-8950-685a6633ed39 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:58.688350 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:58.695767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9e6f4802-b724-4b25-85ab-2ff6412d1785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff8823568ae744809ad012062b47fda7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:58.697079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9e6f4802-b724-4b25-85ab-2ff6412d1785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff8823568ae744809ad012062b47fda7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:58.712396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9e6f4802-b724-4b25-85ab-2ff6412d1785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff8823568ae744809ad012062b47fda7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:58.751415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeeb14b-3926-44e2-8950-685a6633ed39 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:58.757966 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9794d-5758-4645-9d5b-2385ac2eac0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:58.758675 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9794d-5758-4645-9d5b-2385ac2eac0c admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:58.758954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9794d-5758-4645-9d5b-2385ac2eac0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:58.759221 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9794d-5758-4645-9d5b-2385ac2eac0c admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:58.759903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9794d-5758-4645-9d5b-2385ac2eac0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:58.761886 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9794d-5758-4645-9d5b-2385ac2eac0c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:58.772866 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:58.821412 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9e6f4802-b724-4b25-85ab-2ff6412d1785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff8823568ae744809ad012062b47fda7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:58.822054 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9e6f4802-b724-4b25-85ab-2ff6412d1785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff8823568ae744809ad012062b47fda7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:58.847893 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 958/1911] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:54:58 2022] DELETE /identity/v3/users/ff8823568ae744809ad012062b47fda7 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:54:58.853532 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d8e6d-6519-46a9-bb8a-c6a58bae3248 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:58.853943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d8e6d-6519-46a9-bb8a-c6a58bae3248 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:58.854356 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d8e6d-6519-46a9-bb8a-c6a58bae3248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:58.874012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ab5d8e6d-6519-46a9-bb8a-c6a58bae3248 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:58.875404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ab5d8e6d-6519-46a9-bb8a-c6a58bae3248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:58.887303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 954/1912] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:54:58 2022] POST /identity/v3/users => generated 299 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:54:58.890924 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9794d-5758-4645-9d5b-2385ac2eac0c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:58.892819 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-76f9794d-5758-4645-9d5b-2385ac2eac0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:58.906800 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9794d-5758-4645-9d5b-2385ac2eac0c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:58.962205 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 959/1913] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:58.971982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d8e6d-6519-46a9-bb8a-c6a58bae3248 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:58.973395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ab5d8e6d-6519-46a9-bb8a-c6a58bae3248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:58.978160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05db38-2ce0-4af6-91de-7a98e7d149e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:58.978984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05db38-2ce0-4af6-91de-7a98e7d149e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:58.979122 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05db38-2ce0-4af6-91de-7a98e7d149e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:58.979412 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05db38-2ce0-4af6-91de-7a98e7d149e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:58.980140 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05db38-2ce0-4af6-91de-7a98e7d149e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:58.981801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05db38-2ce0-4af6-91de-7a98e7d149e0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:58.992365 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 955/1914] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:58.997029 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05db38-2ce0-4af6-91de-7a98e7d149e0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:59.007943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05db38-2ce0-4af6-91de-7a98e7d149e0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:59.013692 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcba82-675c-42a6-845a-a611951908ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:59.014686 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcba82-675c-42a6-845a-a611951908ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:59.015025 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcba82-675c-42a6-845a-a611951908ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:59.015423 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcba82-675c-42a6-845a-a611951908ff admin admin] PATH_INFO: `/v3/projects/8092d8ccd70540c88ed74923256994c6/users/0e1de0498f1b42ea90ec57812b1ac3d4/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:59.031539 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcba82-675c-42a6-845a-a611951908ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8092d8ccd70540c88ed74923256994c6, user_id=0e1de0498f1b42ea90ec57812b1ac3d4, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:59.034289 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcba82-675c-42a6-845a-a611951908ff admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:59.035141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d8e6d-6519-46a9-bb8a-c6a58bae3248 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:59.038982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea96883-9d64-4db5-b8fe-ee219769269f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:59.039679 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea96883-9d64-4db5-b8fe-ee219769269f service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:59.039957 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea96883-9d64-4db5-b8fe-ee219769269f service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:59.040229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea96883-9d64-4db5-b8fe-ee219769269f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:59.050157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea96883-9d64-4db5-b8fe-ee219769269f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:59.055593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea96883-9d64-4db5-b8fe-ee219769269f service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:59.063917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 960/1915] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:54:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:54:59.118828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 956/1916] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:54:58 2022] PUT /identity/v3/projects/8092d8ccd70540c88ed74923256994c6/users/0e1de0498f1b42ea90ec57812b1ac3d4/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:54:59.119878 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea96883-9d64-4db5-b8fe-ee219769269f service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:59.136256 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea96883-9d64-4db5-b8fe-ee219769269f service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:59.249918 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4fa0a-d3a1-48aa-8ca5-5e8ce965de83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:59.259792 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4fa0a-d3a1-48aa-8ca5-5e8ce965de83 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:59.259792 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4fa0a-d3a1-48aa-8ca5-5e8ce965de83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:59.259792 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4fa0a-d3a1-48aa-8ca5-5e8ce965de83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:59.259792 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4fa0a-d3a1-48aa-8ca5-5e8ce965de83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:59.259792 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4fa0a-d3a1-48aa-8ca5-5e8ce965de83 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:59.259792 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:59.275476 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 961/1917] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:54:59.278777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcba82-675c-42a6-845a-a611951908ff admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:59.294427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcba82-675c-42a6-845a-a611951908ff admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:59.311956 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e2a13-8dca-40e4-81cd-b27a0133082b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:59.325408 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e2a13-8dca-40e4-81cd-b27a0133082b admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:59.332445 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e2a13-8dca-40e4-81cd-b27a0133082b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:59.332445 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e2a13-8dca-40e4-81cd-b27a0133082b admin admin] PATH_INFO: `/v3/projects/8092d8ccd70540c88ed74923256994c6/users/0e1de0498f1b42ea90ec57812b1ac3d4/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:59.332445 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e2a13-8dca-40e4-81cd-b27a0133082b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8092d8ccd70540c88ed74923256994c6, user_id=0e1de0498f1b42ea90ec57812b1ac3d4, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:59.333080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e2a13-8dca-40e4-81cd-b27a0133082b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:59.358383 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 957/1918] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:54:59 2022] PUT /identity/v3/projects/8092d8ccd70540c88ed74923256994c6/users/0e1de0498f1b42ea90ec57812b1ac3d4/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:59.386762 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283cc2b-1fe8-429c-ac75-97f1e0dcc3b3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:59.386762 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283cc2b-1fe8-429c-ac75-97f1e0dcc3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:59.386762 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283cc2b-1fe8-429c-ac75-97f1e0dcc3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:59.409301 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a283cc2b-1fe8-429c-ac75-97f1e0dcc3b3 None None] MFA Rules not processed for user `0e1de0498f1b42ea90ec57812b1ac3d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:59.409845 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a283cc2b-1fe8-429c-ac75-97f1e0dcc3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:59.527124 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 962/1919] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:54:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:59.571932 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e2a13-8dca-40e4-81cd-b27a0133082b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:59.577942 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-633e2a13-8dca-40e4-81cd-b27a0133082b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:59.645022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb64cd-5554-40ee-a175-2bc8de9c5f30 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:59.645357 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb64cd-5554-40ee-a175-2bc8de9c5f30 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:59.646700 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb64cd-5554-40ee-a175-2bc8de9c5f30 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:59.647381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 963/1920] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 16:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 16:54:59.656394 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8f0d4-4aaf-4029-b105-310ede81eb2b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:59.656394 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8f0d4-4aaf-4029-b105-310ede81eb2b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:59.656394 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8f0d4-4aaf-4029-b105-310ede81eb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:59.676502 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e2a13-8dca-40e4-81cd-b27a0133082b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:59.682996 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc7209-fd5a-462a-ae03-baedf7ed1e10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:59.683777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc7209-fd5a-462a-ae03-baedf7ed1e10 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:59.684066 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc7209-fd5a-462a-ae03-baedf7ed1e10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:59.684338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc7209-fd5a-462a-ae03-baedf7ed1e10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:59.704717 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc7209-fd5a-462a-ae03-baedf7ed1e10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:59.706234 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc7209-fd5a-462a-ae03-baedf7ed1e10 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:59.729532 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 958/1921] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:54:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:59.730907 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc7209-fd5a-462a-ae03-baedf7ed1e10 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:59.734203 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ecfc7209-fd5a-462a-ae03-baedf7ed1e10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:59.754706 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-bab8f0d4-4aaf-4029-b105-310ede81eb2b None None] MFA Rules not processed for user `beeefb9b8d394407a5e7a32f5a00ffad`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:59.756736 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bab8f0d4-4aaf-4029-b105-310ede81eb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:59.862737 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:59.869113 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc7209-fd5a-462a-ae03-baedf7ed1e10 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:59.878240 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4884d34-d6dd-420e-a524-d947b98394a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:59.878240 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4884d34-d6dd-420e-a524-d947b98394a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:59.878240 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4884d34-d6dd-420e-a524-d947b98394a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:59.878774 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4884d34-d6dd-420e-a524-d947b98394a9 admin admin] PATH_INFO: `/v3/projects/230c21e2ca9344f69a667f924b984102` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:59.880156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4884d34-d6dd-420e-a524-d947b98394a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=230c21e2ca9344f69a667f924b984102)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:59.882416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4884d34-d6dd-420e-a524-d947b98394a9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:59.912424 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 964/1922] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 16:54:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:54:59.933998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8f0d4-4aaf-4029-b105-310ede81eb2b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:59.933998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bab8f0d4-4aaf-4029-b105-310ede81eb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:59.949167 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8f0d4-4aaf-4029-b105-310ede81eb2b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:59.955525 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f2ea1-6e58-4140-a102-d198bd7feb98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beeefb9b8d394407a5e7a32f5a00ffad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:59.957009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f2ea1-6e58-4140-a102-d198bd7feb98 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:59.957339 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f2ea1-6e58-4140-a102-d198bd7feb98 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:59.957634 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f2ea1-6e58-4140-a102-d198bd7feb98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:59.972478 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f2ea1-6e58-4140-a102-d198bd7feb98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:59.979145 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f2ea1-6e58-4140-a102-d198bd7feb98 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:59.985190 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 965/1923] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:54:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:00.091174 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b4884d34-d6dd-420e-a524-d947b98394a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '230c21e2ca9344f69a667f924b984102', 'request_id': 'req-b4884d34-d6dd-420e-a524-d947b98394a9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:00.097792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b4884d34-d6dd-420e-a524-d947b98394a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '230c21e2ca9344f69a667f924b984102', 'request_id': 'req-b4884d34-d6dd-420e-a524-d947b98394a9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:00.105313 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b4884d34-d6dd-420e-a524-d947b98394a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '230c21e2ca9344f69a667f924b984102', 'request_id': 'req-b4884d34-d6dd-420e-a524-d947b98394a9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:00.244431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b4884d34-d6dd-420e-a524-d947b98394a9 admin admin] The token cache is being invalidate because project 230c21e2ca9344f69a667f924b984102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:55:00.244986 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b4884d34-d6dd-420e-a524-d947b98394a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:00.247695 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b4884d34-d6dd-420e-a524-d947b98394a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:00.252404 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 959/1924] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:54:59 2022] DELETE /identity/v3/projects/230c21e2ca9344f69a667f924b984102 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:00.257863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04165b7f-d0dc-41f6-98c7-40f299f1f24a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:00.258303 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04165b7f-d0dc-41f6-98c7-40f299f1f24a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:00.259222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04165b7f-d0dc-41f6-98c7-40f299f1f24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:00.288840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-04165b7f-d0dc-41f6-98c7-40f299f1f24a None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:00.291059 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-04165b7f-d0dc-41f6-98c7-40f299f1f24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:00.372321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 966/1925] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:55:00.382689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee4dc1-899b-47d6-915d-271917831cc7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:00.387367 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee4dc1-899b-47d6-915d-271917831cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:00.387367 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee4dc1-899b-47d6-915d-271917831cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:00.406433 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1dee4dc1-899b-47d6-915d-271917831cc7 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:00.407667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1dee4dc1-899b-47d6-915d-271917831cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:00.417085 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 960/1926] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:00.421798 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04165b7f-d0dc-41f6-98c7-40f299f1f24a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:00.434519 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04165b7f-d0dc-41f6-98c7-40f299f1f24a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:00.440421 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ce728-02e6-4cd9-99f5-ec04004f1f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:00.441115 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ce728-02e6-4cd9-99f5-ec04004f1f7a admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:00.441443 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ce728-02e6-4cd9-99f5-ec04004f1f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:00.441718 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ce728-02e6-4cd9-99f5-ec04004f1f7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:00.442539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ce728-02e6-4cd9-99f5-ec04004f1f7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:55:00.442830 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ce728-02e6-4cd9-99f5-ec04004f1f7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:00.444488 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ce728-02e6-4cd9-99f5-ec04004f1f7a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:00.457921 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 967/1927] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:55:00.463019 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee4dc1-899b-47d6-915d-271917831cc7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:00.474341 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee4dc1-899b-47d6-915d-271917831cc7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:00.481927 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a8de5-cbf0-45bd-bbfc-a44f6396241d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:00.482585 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a8de5-cbf0-45bd-bbfc-a44f6396241d admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:00.482880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a8de5-cbf0-45bd-bbfc-a44f6396241d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:00.483333 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a8de5-cbf0-45bd-bbfc-a44f6396241d admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:00.484138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a8de5-cbf0-45bd-bbfc-a44f6396241d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:00.487442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a8de5-cbf0-45bd-bbfc-a44f6396241d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:00.618635 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 961/1928] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:55:00 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:55:00.622867 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ce728-02e6-4cd9-99f5-ec04004f1f7a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:00.636247 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ce728-02e6-4cd9-99f5-ec04004f1f7a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:00.720342 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a8de5-cbf0-45bd-bbfc-a44f6396241d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:00.722258 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1aca7-c8c5-40cd-be6c-d129a90b5269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:00.725370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1aca7-c8c5-40cd-be6c-d129a90b5269 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:00.725370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1aca7-c8c5-40cd-be6c-d129a90b5269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:00.725370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1aca7-c8c5-40cd-be6c-d129a90b5269 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:00.725809 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-351a8de5-cbf0-45bd-bbfc-a44f6396241d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:00.725902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1aca7-c8c5-40cd-be6c-d129a90b5269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:00.727119 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1aca7-c8c5-40cd-be6c-d129a90b5269 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:00.743917 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a8de5-cbf0-45bd-bbfc-a44f6396241d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:00.750478 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557bdd2-53ac-4348-b081-c549b937b215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:00.751444 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557bdd2-53ac-4348-b081-c549b937b215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:00.751969 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557bdd2-53ac-4348-b081-c549b937b215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:00.752308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557bdd2-53ac-4348-b081-c549b937b215 admin admin] PATH_INFO: `/v3/users/03aad2eeeb6044e49d7b23d0c80e5bc5` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:00.753712 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557bdd2-53ac-4348-b081-c549b937b215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03aad2eeeb6044e49d7b23d0c80e5bc5)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:00.760250 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557bdd2-53ac-4348-b081-c549b937b215 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:00.850219 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 968/1929] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:55:00 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:00.854307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1aca7-c8c5-40cd-be6c-d129a90b5269 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:00.864596 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1aca7-c8c5-40cd-be6c-d129a90b5269 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:00.870092 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd12333-8966-49d0-a7cc-61f7a32e44ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:00.870789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd12333-8966-49d0-a7cc-61f7a32e44ff admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:00.871077 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd12333-8966-49d0-a7cc-61f7a32e44ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:00.871366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd12333-8966-49d0-a7cc-61f7a32e44ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:00.872111 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd12333-8966-49d0-a7cc-61f7a32e44ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:00.873821 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd12333-8966-49d0-a7cc-61f7a32e44ff admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:00.887982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 969/1930] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:55:00.891158 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd12333-8966-49d0-a7cc-61f7a32e44ff admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:00.904577 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd12333-8966-49d0-a7cc-61f7a32e44ff admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:00.910680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70f560-6f5c-41c8-804c-6b18ab90841f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:00.911410 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70f560-6f5c-41c8-804c-6b18ab90841f admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:00.911692 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70f560-6f5c-41c8-804c-6b18ab90841f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:00.911970 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70f560-6f5c-41c8-804c-6b18ab90841f admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:00.912696 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70f560-6f5c-41c8-804c-6b18ab90841f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:00.914401 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70f560-6f5c-41c8-804c-6b18ab90841f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:00.926231 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 970/1931] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:55:00.930553 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70f560-6f5c-41c8-804c-6b18ab90841f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:00.947279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70f560-6f5c-41c8-804c-6b18ab90841f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:00.952569 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b59e23-31d7-406d-a62f-cb7f4c857620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:00.953586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b59e23-31d7-406d-a62f-cb7f4c857620 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:00.953874 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b59e23-31d7-406d-a62f-cb7f4c857620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:00.954174 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b59e23-31d7-406d-a62f-cb7f4c857620 admin admin] PATH_INFO: `/v3/projects/0a36b0f6f3e3476282ab10ceedb68255/users/3820967699fd430a8e16c2c8f339888e/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:00.983735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0557bdd2-53ac-4348-b081-c549b937b215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03aad2eeeb6044e49d7b23d0c80e5bc5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:00.990978 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b59e23-31d7-406d-a62f-cb7f4c857620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a36b0f6f3e3476282ab10ceedb68255, user_id=3820967699fd430a8e16c2c8f339888e, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:00.995368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b59e23-31d7-406d-a62f-cb7f4c857620 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:01.014881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:01.038392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0557bdd2-53ac-4348-b081-c549b937b215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03aad2eeeb6044e49d7b23d0c80e5bc5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:01.039166 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0557bdd2-53ac-4348-b081-c549b937b215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03aad2eeeb6044e49d7b23d0c80e5bc5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:01.039866 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0557bdd2-53ac-4348-b081-c549b937b215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03aad2eeeb6044e49d7b23d0c80e5bc5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:01.054268 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0557bdd2-53ac-4348-b081-c549b937b215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03aad2eeeb6044e49d7b23d0c80e5bc5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:01.082786 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 971/1932] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:00 2022] PUT /identity/v3/projects/0a36b0f6f3e3476282ab10ceedb68255/users/3820967699fd430a8e16c2c8f339888e/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:55:01.084760 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 962/1933] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:55:00 2022] DELETE /identity/v3/users/03aad2eeeb6044e49d7b23d0c80e5bc5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:01.095333 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a2e31-6455-4d2a-b745-8bf63cbaa4c2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:01.095867 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a2e31-6455-4d2a-b745-8bf63cbaa4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:01.096144 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a2e31-6455-4d2a-b745-8bf63cbaa4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:01.132938 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-828a2e31-6455-4d2a-b745-8bf63cbaa4c2 None None] MFA Rules not processed for user `3820967699fd430a8e16c2c8f339888e`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:01.135012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-828a2e31-6455-4d2a-b745-8bf63cbaa4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:01.165647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557bdd2-53ac-4348-b081-c549b937b215 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:01.168006 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0557bdd2-53ac-4348-b081-c549b937b215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:01.233820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 972/1934] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:01.235398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a2e31-6455-4d2a-b745-8bf63cbaa4c2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:01.237597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-828a2e31-6455-4d2a-b745-8bf63cbaa4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:01.254255 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:01.308277 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557bdd2-53ac-4348-b081-c549b937b215 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:01.324800 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f991de-0825-49f0-9990-5b1d715caf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:01.324800 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f991de-0825-49f0-9990-5b1d715caf75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:01.324800 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f991de-0825-49f0-9990-5b1d715caf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:01.324800 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f991de-0825-49f0-9990-5b1d715caf75 admin admin] PATH_INFO: `/v3/users/1c9eb85695884cc19e16fde0efbf63ef` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:01.325219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f991de-0825-49f0-9990-5b1d715caf75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c9eb85695884cc19e16fde0efbf63ef)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:01.325219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f991de-0825-49f0-9990-5b1d715caf75 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:01.348190 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a2e31-6455-4d2a-b745-8bf63cbaa4c2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:01.355779 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5f3b9-d0a3-4dc7-adcf-acc573cbe1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:01.357298 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5f3b9-d0a3-4dc7-adcf-acc573cbe1df admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:01.357864 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5f3b9-d0a3-4dc7-adcf-acc573cbe1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:01.358313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5f3b9-d0a3-4dc7-adcf-acc573cbe1df admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:01.359710 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5f3b9-d0a3-4dc7-adcf-acc573cbe1df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:01.363025 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5f3b9-d0a3-4dc7-adcf-acc573cbe1df admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:01.551068 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 973/1935] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:55:01 2022] POST /identity/v3/projects => generated 385 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:01.557079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5f3b9-d0a3-4dc7-adcf-acc573cbe1df admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:01.559405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4fd5f3b9-d0a3-4dc7-adcf-acc573cbe1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:01.643086 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5f3b9-d0a3-4dc7-adcf-acc573cbe1df admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:01.646692 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:01.651910 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb0878-47a0-436c-9afd-69905a6cc0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:01.652814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb0878-47a0-436c-9afd-69905a6cc0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:01.653100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb0878-47a0-436c-9afd-69905a6cc0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:01.653434 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb0878-47a0-436c-9afd-69905a6cc0ce admin admin] PATH_INFO: `/v3/projects/321c663b369341c68eb58dd87d75bd18` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:01.656062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb0878-47a0-436c-9afd-69905a6cc0ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=321c663b369341c68eb58dd87d75bd18)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:01.658319 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb0878-47a0-436c-9afd-69905a6cc0ce admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:01.662573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-64f991de-0825-49f0-9990-5b1d715caf75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c9eb85695884cc19e16fde0efbf63ef'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:01.748668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-64f991de-0825-49f0-9990-5b1d715caf75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c9eb85695884cc19e16fde0efbf63ef'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:01.750554 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-64f991de-0825-49f0-9990-5b1d715caf75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c9eb85695884cc19e16fde0efbf63ef'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:01.751340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-64f991de-0825-49f0-9990-5b1d715caf75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c9eb85695884cc19e16fde0efbf63ef'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:01.768437 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-64f991de-0825-49f0-9990-5b1d715caf75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c9eb85695884cc19e16fde0efbf63ef'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:01.788485 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bbcb0878-47a0-436c-9afd-69905a6cc0ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '321c663b369341c68eb58dd87d75bd18', 'request_id': 'req-bbcb0878-47a0-436c-9afd-69905a6cc0ce'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:01.790918 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 963/1936] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:55:01 2022] DELETE /identity/v3/users/1c9eb85695884cc19e16fde0efbf63ef => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:01.797167 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f991de-0825-49f0-9990-5b1d715caf75 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:01.797167 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-64f991de-0825-49f0-9990-5b1d715caf75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:01.870314 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f991de-0825-49f0-9990-5b1d715caf75 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:01.875216 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a02abb-1c7e-4142-a0a0-9c4717e06a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:01.875900 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a02abb-1c7e-4142-a0a0-9c4717e06a67 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:01.876241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a02abb-1c7e-4142-a0a0-9c4717e06a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:01.876583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a02abb-1c7e-4142-a0a0-9c4717e06a67 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:01.879024 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a02abb-1c7e-4142-a0a0-9c4717e06a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:01.880992 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a02abb-1c7e-4142-a0a0-9c4717e06a67 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:01.951637 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bbcb0878-47a0-436c-9afd-69905a6cc0ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '321c663b369341c68eb58dd87d75bd18', 'request_id': 'req-bbcb0878-47a0-436c-9afd-69905a6cc0ce'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:01.959387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bbcb0878-47a0-436c-9afd-69905a6cc0ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '321c663b369341c68eb58dd87d75bd18', 'request_id': 'req-bbcb0878-47a0-436c-9afd-69905a6cc0ce'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:01.974674 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bbcb0878-47a0-436c-9afd-69905a6cc0ce admin admin] The token cache is being invalidate because project 321c663b369341c68eb58dd87d75bd18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:55:01.974968 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bbcb0878-47a0-436c-9afd-69905a6cc0ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:01.975611 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bbcb0878-47a0-436c-9afd-69905a6cc0ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:01.977789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 974/1937] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:55:01 2022] DELETE /identity/v3/projects/321c663b369341c68eb58dd87d75bd18 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:55:01.979048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f4bcb-c2a5-4810-8895-7c507fc83877 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:01.979349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f4bcb-c2a5-4810-8895-7c507fc83877 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:01.979614 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f4bcb-c2a5-4810-8895-7c507fc83877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:02.004329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e20f4bcb-c2a5-4810-8895-7c507fc83877 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:02.005612 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e20f4bcb-c2a5-4810-8895-7c507fc83877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:02.014427 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 975/1938] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:02.015594 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f4bcb-c2a5-4810-8895-7c507fc83877 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:02.017119 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e20f4bcb-c2a5-4810-8895-7c507fc83877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:02.033369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f4bcb-c2a5-4810-8895-7c507fc83877 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:02.038112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c2814-f6a3-4ad1-900f-0a8fc4d7db8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:02.038998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c2814-f6a3-4ad1-900f-0a8fc4d7db8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:02.039916 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c2814-f6a3-4ad1-900f-0a8fc4d7db8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:02.040213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c2814-f6a3-4ad1-900f-0a8fc4d7db8b admin admin] PATH_INFO: `/v3/users/e17514d68a274a0dbe606bb8db60c747` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:02.041720 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c2814-f6a3-4ad1-900f-0a8fc4d7db8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e17514d68a274a0dbe606bb8db60c747)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:02.044207 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c2814-f6a3-4ad1-900f-0a8fc4d7db8b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:02.066092 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 964/1939] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:55:01 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:02.066092 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a02abb-1c7e-4142-a0a0-9c4717e06a67 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:02.066092 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d8a02abb-1c7e-4142-a0a0-9c4717e06a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:02.090125 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a02abb-1c7e-4142-a0a0-9c4717e06a67 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:02.097445 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa28012-e0ba-4551-b37b-f8523b6dc152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:02.098347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa28012-e0ba-4551-b37b-f8523b6dc152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:02.098630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa28012-e0ba-4551-b37b-f8523b6dc152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:02.098911 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa28012-e0ba-4551-b37b-f8523b6dc152 admin admin] PATH_INFO: `/v3/users/6095575c8d994029b9864fc1fd9578a4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:02.100275 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa28012-e0ba-4551-b37b-f8523b6dc152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6095575c8d994029b9864fc1fd9578a4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:02.103660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa28012-e0ba-4551-b37b-f8523b6dc152 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:02.285568 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a18c2814-f6a3-4ad1-900f-0a8fc4d7db8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e17514d68a274a0dbe606bb8db60c747'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:02.286675 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a18c2814-f6a3-4ad1-900f-0a8fc4d7db8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e17514d68a274a0dbe606bb8db60c747'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:02.300941 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a18c2814-f6a3-4ad1-900f-0a8fc4d7db8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e17514d68a274a0dbe606bb8db60c747'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:02.380779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-caa28012-e0ba-4551-b37b-f8523b6dc152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6095575c8d994029b9864fc1fd9578a4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:02.381654 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a18c2814-f6a3-4ad1-900f-0a8fc4d7db8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e17514d68a274a0dbe606bb8db60c747'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:02.391486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a18c2814-f6a3-4ad1-900f-0a8fc4d7db8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e17514d68a274a0dbe606bb8db60c747'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:02.418689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 976/1940] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:55:02 2022] DELETE /identity/v3/users/e17514d68a274a0dbe606bb8db60c747 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:02.420218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c2814-f6a3-4ad1-900f-0a8fc4d7db8b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:02.422239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a18c2814-f6a3-4ad1-900f-0a8fc4d7db8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:02.492607 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c2814-f6a3-4ad1-900f-0a8fc4d7db8b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:02.496563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c0492-3891-48a2-be94-6232b5435674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:02.497245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c0492-3891-48a2-be94-6232b5435674 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:02.497688 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c0492-3891-48a2-be94-6232b5435674 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:02.497969 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c0492-3891-48a2-be94-6232b5435674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:02.499800 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fc8c0492-3891-48a2-be94-6232b5435674 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:02.553157 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-caa28012-e0ba-4551-b37b-f8523b6dc152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6095575c8d994029b9864fc1fd9578a4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:02.553901 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-caa28012-e0ba-4551-b37b-f8523b6dc152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6095575c8d994029b9864fc1fd9578a4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:02.555691 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-caa28012-e0ba-4551-b37b-f8523b6dc152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6095575c8d994029b9864fc1fd9578a4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:02.568924 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-caa28012-e0ba-4551-b37b-f8523b6dc152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6095575c8d994029b9864fc1fd9578a4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:02.586321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c0492-3891-48a2-be94-6232b5435674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:02.588521 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c0492-3891-48a2-be94-6232b5435674 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:02.599024 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 965/1941] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:55:02 2022] DELETE /identity/v3/users/6095575c8d994029b9864fc1fd9578a4 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:02.601186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa28012-e0ba-4551-b37b-f8523b6dc152 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:02.604288 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 977/1942] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:02.604690 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-caa28012-e0ba-4551-b37b-f8523b6dc152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:02.723057 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa28012-e0ba-4551-b37b-f8523b6dc152 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:02.731280 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af2637-0270-4b45-b8a1-460d26abc656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:02.731995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af2637-0270-4b45-b8a1-460d26abc656 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:02.732284 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af2637-0270-4b45-b8a1-460d26abc656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:02.732572 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af2637-0270-4b45-b8a1-460d26abc656 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:02.733353 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af2637-0270-4b45-b8a1-460d26abc656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:02.735885 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af2637-0270-4b45-b8a1-460d26abc656 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:02.738438 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:02.753769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 966/1943] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:02.760115 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c0492-3891-48a2-be94-6232b5435674 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:02.762679 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fc8c0492-3891-48a2-be94-6232b5435674 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:02.779259 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c0492-3891-48a2-be94-6232b5435674 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:02.785749 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc1b36-7c49-4f2d-8ef4-df970ce8c88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:02.786502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc1b36-7c49-4f2d-8ef4-df970ce8c88e admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:02.786788 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc1b36-7c49-4f2d-8ef4-df970ce8c88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:02.787176 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc1b36-7c49-4f2d-8ef4-df970ce8c88e admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:02.787812 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc1b36-7c49-4f2d-8ef4-df970ce8c88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:02.790126 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc1b36-7c49-4f2d-8ef4-df970ce8c88e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:02.802887 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 978/1944] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:02.809203 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af2637-0270-4b45-b8a1-460d26abc656 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:02.825836 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af2637-0270-4b45-b8a1-460d26abc656 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:02.833703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb531209-f9d1-4f6a-804f-476fce431e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:02.835141 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb531209-f9d1-4f6a-804f-476fce431e84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:02.835589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb531209-f9d1-4f6a-804f-476fce431e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:02.836029 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb531209-f9d1-4f6a-804f-476fce431e84 admin admin] PATH_INFO: `/v3/projects/ad7161875dc846e090aabceee818d6ea/users/c9a0c542d76b4dee9ce07e5adea2ee43/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:02.859861 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb531209-f9d1-4f6a-804f-476fce431e84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad7161875dc846e090aabceee818d6ea, user_id=c9a0c542d76b4dee9ce07e5adea2ee43, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:02.862780 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb531209-f9d1-4f6a-804f-476fce431e84 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:02.993713 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=81,keystone:DELETE=15,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:03.037094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 967/1945] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:02 2022] PUT /identity/v3/projects/ad7161875dc846e090aabceee818d6ea/users/c9a0c542d76b4dee9ce07e5adea2ee43/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:55:03.053453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc1b36-7c49-4f2d-8ef4-df970ce8c88e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:03.061216 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-53bc1b36-7c49-4f2d-8ef4-df970ce8c88e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:03.066479 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb531209-f9d1-4f6a-804f-476fce431e84 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:03.097906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc1b36-7c49-4f2d-8ef4-df970ce8c88e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:03.125221 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-eb531209-f9d1-4f6a-804f-476fce431e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:03.220093 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ac513-811c-4e4e-b355-5604a044c3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:03.221570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ac513-811c-4e4e-b355-5604a044c3a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:03.221920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ac513-811c-4e4e-b355-5604a044c3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:03.222235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ac513-811c-4e4e-b355-5604a044c3a0 admin admin] PATH_INFO: `/v3/projects/eb962cc38f54499d8e2128d551657185` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:03.224211 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ac513-811c-4e4e-b355-5604a044c3a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb962cc38f54499d8e2128d551657185)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:03.226849 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ac513-811c-4e4e-b355-5604a044c3a0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:03.241088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:03.310535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb531209-f9d1-4f6a-804f-476fce431e84 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:03.326187 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb03d5-ae05-444c-b8a4-6e7957784d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:03.326187 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb03d5-ae05-444c-b8a4-6e7957784d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:03.326187 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb03d5-ae05-444c-b8a4-6e7957784d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:03.326187 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb03d5-ae05-444c-b8a4-6e7957784d98 admin admin] PATH_INFO: `/v3/projects/187d77d887774bbc82b249a64f335d59` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:03.326783 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb03d5-ae05-444c-b8a4-6e7957784d98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=187d77d887774bbc82b249a64f335d59)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:03.330050 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb03d5-ae05-444c-b8a4-6e7957784d98 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:03.368372 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5d9ac513-811c-4e4e-b355-5604a044c3a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb962cc38f54499d8e2128d551657185', 'request_id': 'req-5d9ac513-811c-4e4e-b355-5604a044c3a0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:03.444649 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5d9ac513-811c-4e4e-b355-5604a044c3a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb962cc38f54499d8e2128d551657185', 'request_id': 'req-5d9ac513-811c-4e4e-b355-5604a044c3a0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:03.456338 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5d9ac513-811c-4e4e-b355-5604a044c3a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb962cc38f54499d8e2128d551657185', 'request_id': 'req-5d9ac513-811c-4e4e-b355-5604a044c3a0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:03.470204 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5d9ac513-811c-4e4e-b355-5604a044c3a0 admin admin] The token cache is being invalidate because project eb962cc38f54499d8e2128d551657185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:55:03.470595 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5d9ac513-811c-4e4e-b355-5604a044c3a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:03.471670 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5d9ac513-811c-4e4e-b355-5604a044c3a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:03.473762 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 979/1946] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:55:03 2022] DELETE /identity/v3/projects/eb962cc38f54499d8e2128d551657185 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:03.475955 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba203b1-c25e-4946-9bb6-687e54e75ac4 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:03.476458 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba203b1-c25e-4946-9bb6-687e54e75ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:03.477841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba203b1-c25e-4946-9bb6-687e54e75ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:03.481878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:03.505220 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e1bb03d5-ae05-444c-b8a4-6e7957784d98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '187d77d887774bbc82b249a64f335d59', 'request_id': 'req-e1bb03d5-ae05-444c-b8a4-6e7957784d98'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:03.511757 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-bba203b1-c25e-4946-9bb6-687e54e75ac4 None None] MFA Rules not processed for user `c9a0c542d76b4dee9ce07e5adea2ee43`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:03.512415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e1bb03d5-ae05-444c-b8a4-6e7957784d98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '187d77d887774bbc82b249a64f335d59', 'request_id': 'req-e1bb03d5-ae05-444c-b8a4-6e7957784d98'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:03.513188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bba203b1-c25e-4946-9bb6-687e54e75ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:03.521526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e1bb03d5-ae05-444c-b8a4-6e7957784d98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '187d77d887774bbc82b249a64f335d59', 'request_id': 'req-e1bb03d5-ae05-444c-b8a4-6e7957784d98'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:03.621638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e1bb03d5-ae05-444c-b8a4-6e7957784d98 admin admin] The token cache is being invalidate because project 187d77d887774bbc82b249a64f335d59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:55:03.621880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e1bb03d5-ae05-444c-b8a4-6e7957784d98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:03.622469 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e1bb03d5-ae05-444c-b8a4-6e7957784d98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:03.624221 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 968/1947] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:55:03 2022] DELETE /identity/v3/projects/187d77d887774bbc82b249a64f335d59 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:03.628043 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 980/1948] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:03.628504 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb03d5-ae05-444c-b8a4-6e7957784d98 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:03.628504 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e1bb03d5-ae05-444c-b8a4-6e7957784d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:03.628641 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62549a17-e49b-4f4c-9041-997847cff3b3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:03.628641 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62549a17-e49b-4f4c-9041-997847cff3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:03.628641 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62549a17-e49b-4f4c-9041-997847cff3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:03.655885 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-62549a17-e49b-4f4c-9041-997847cff3b3 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:03.657146 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-62549a17-e49b-4f4c-9041-997847cff3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:03.709142 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb03d5-ae05-444c-b8a4-6e7957784d98 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:03.715134 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737dfcce-c258-4f69-895e-ad456290bf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:03.716004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dfcce-c258-4f69-895e-ad456290bf67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:03.716280 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dfcce-c258-4f69-895e-ad456290bf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:03.716604 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dfcce-c258-4f69-895e-ad456290bf67 admin admin] PATH_INFO: `/v3/projects/33e4b0e8cfe047a6b81b95f02657a953` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:03.717876 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737dfcce-c258-4f69-895e-ad456290bf67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33e4b0e8cfe047a6b81b95f02657a953)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:03.719931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737dfcce-c258-4f69-895e-ad456290bf67 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:03.731385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 981/1949] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:03.733714 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c390e3-d084-4249-9130-95840f643779 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:03.734437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c390e3-d084-4249-9130-95840f643779 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:03.734993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c390e3-d084-4249-9130-95840f643779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:03.758833 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e1c390e3-d084-4249-9130-95840f643779 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:03.760069 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e1c390e3-d084-4249-9130-95840f643779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:03.768934 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 982/1950] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:03.776389 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c390e3-d084-4249-9130-95840f643779 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:03.776389 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e1c390e3-d084-4249-9130-95840f643779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:03.784879 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c390e3-d084-4249-9130-95840f643779 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:03.790726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a30a79-cc39-48ca-baca-1574f361fd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:03.791879 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a30a79-cc39-48ca-baca-1574f361fd58 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:03.792167 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a30a79-cc39-48ca-baca-1574f361fd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:03.792577 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a30a79-cc39-48ca-baca-1574f361fd58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:03.793806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a30a79-cc39-48ca-baca-1574f361fd58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:03.796337 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a30a79-cc39-48ca-baca-1574f361fd58 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:03.875161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-737dfcce-c258-4f69-895e-ad456290bf67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e4b0e8cfe047a6b81b95f02657a953', 'request_id': 'req-737dfcce-c258-4f69-895e-ad456290bf67'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:03.881788 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-737dfcce-c258-4f69-895e-ad456290bf67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e4b0e8cfe047a6b81b95f02657a953', 'request_id': 'req-737dfcce-c258-4f69-895e-ad456290bf67'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:03.889572 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-737dfcce-c258-4f69-895e-ad456290bf67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e4b0e8cfe047a6b81b95f02657a953', 'request_id': 'req-737dfcce-c258-4f69-895e-ad456290bf67'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:03.950254 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 983/1951] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:55:03 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:03.951853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5623c3e-2d26-43e1-866f-6b16aa22f289 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:03.952148 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5623c3e-2d26-43e1-866f-6b16aa22f289 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:03.952429 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5623c3e-2d26-43e1-866f-6b16aa22f289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:03.981869 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e5623c3e-2d26-43e1-866f-6b16aa22f289 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:03.983517 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e5623c3e-2d26-43e1-866f-6b16aa22f289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:04.020635 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-737dfcce-c258-4f69-895e-ad456290bf67 admin admin] The token cache is being invalidate because project 33e4b0e8cfe047a6b81b95f02657a953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:55:04.020635 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-737dfcce-c258-4f69-895e-ad456290bf67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:04.020635 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-737dfcce-c258-4f69-895e-ad456290bf67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:04.020635 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 969/1952] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:55:03 2022] DELETE /identity/v3/projects/33e4b0e8cfe047a6b81b95f02657a953 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:04.025800 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f5e2a-8bdc-43a3-8a96-6054edd6b44a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:04.026016 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:04.026215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f5e2a-8bdc-43a3-8a96-6054edd6b44a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:04.026636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f5e2a-8bdc-43a3-8a96-6054edd6b44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:04.050839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-875f5e2a-8bdc-43a3-8a96-6054edd6b44a None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:04.051870 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-875f5e2a-8bdc-43a3-8a96-6054edd6b44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:04.073347 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 984/1953] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:04.078019 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5623c3e-2d26-43e1-866f-6b16aa22f289 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:04.079712 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e5623c3e-2d26-43e1-866f-6b16aa22f289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:04.094223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5623c3e-2d26-43e1-866f-6b16aa22f289 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:04.100553 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893263c-0447-4d5f-883c-27953438d5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:04.101244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893263c-0447-4d5f-883c-27953438d5e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:04.101726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893263c-0447-4d5f-883c-27953438d5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:04.102020 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893263c-0447-4d5f-883c-27953438d5e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:04.102726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893263c-0447-4d5f-883c-27953438d5e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:04.104683 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893263c-0447-4d5f-883c-27953438d5e3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:04.115384 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:04.146935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 970/1954] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:04.148504 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f5e2a-8bdc-43a3-8a96-6054edd6b44a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:04.150786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-875f5e2a-8bdc-43a3-8a96-6054edd6b44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:04.163515 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f5e2a-8bdc-43a3-8a96-6054edd6b44a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:04.168641 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d01ac-96c6-438f-9c8d-0756f202a426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:04.169629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d01ac-96c6-438f-9c8d-0756f202a426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:04.169905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d01ac-96c6-438f-9c8d-0756f202a426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:04.170184 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d01ac-96c6-438f-9c8d-0756f202a426 admin admin] PATH_INFO: `/v3/users/0e1de0498f1b42ea90ec57812b1ac3d4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:04.171474 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d01ac-96c6-438f-9c8d-0756f202a426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e1de0498f1b42ea90ec57812b1ac3d4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:04.173465 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d01ac-96c6-438f-9c8d-0756f202a426 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:04.235645 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 985/1955] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:55:04 2022] POST /identity/v3/users => generated 299 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:04.235645 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893263c-0447-4d5f-883c-27953438d5e3 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:04.250230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893263c-0447-4d5f-883c-27953438d5e3 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:04.257572 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2c6b1-05eb-40d3-a0e1-7a933f320e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:04.258879 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2c6b1-05eb-40d3-a0e1-7a933f320e6b admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:04.259062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2c6b1-05eb-40d3-a0e1-7a933f320e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:04.259429 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2c6b1-05eb-40d3-a0e1-7a933f320e6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:04.260069 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2c6b1-05eb-40d3-a0e1-7a933f320e6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:55:04.260374 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2c6b1-05eb-40d3-a0e1-7a933f320e6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:04.262792 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2c6b1-05eb-40d3-a0e1-7a933f320e6b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:04.281050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 986/1956] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:55:04.281970 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2c6b1-05eb-40d3-a0e1-7a933f320e6b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:04.294939 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2c6b1-05eb-40d3-a0e1-7a933f320e6b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:04.300600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b9a28-dd96-4077-818a-806ac5fce9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:04.301400 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b9a28-dd96-4077-818a-806ac5fce9cd admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:04.301757 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b9a28-dd96-4077-818a-806ac5fce9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:04.302123 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b9a28-dd96-4077-818a-806ac5fce9cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:04.302927 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b9a28-dd96-4077-818a-806ac5fce9cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:55:04.303293 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b9a28-dd96-4077-818a-806ac5fce9cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:04.305849 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b9a28-dd96-4077-818a-806ac5fce9cd admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:04.325320 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 987/1957] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:55:04.325320 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b9a28-dd96-4077-818a-806ac5fce9cd admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:04.340277 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b9a28-dd96-4077-818a-806ac5fce9cd admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:04.350292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea46f6-2493-4ecc-bb5b-e126dc70ec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:04.351398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea46f6-2493-4ecc-bb5b-e126dc70ec2c admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:04.351864 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea46f6-2493-4ecc-bb5b-e126dc70ec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:04.352319 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea46f6-2493-4ecc-bb5b-e126dc70ec2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:04.353601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea46f6-2493-4ecc-bb5b-e126dc70ec2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:04.355960 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea46f6-2493-4ecc-bb5b-e126dc70ec2c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:04.370346 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 988/1958] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:04.371307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea46f6-2493-4ecc-bb5b-e126dc70ec2c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:04.386002 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea46f6-2493-4ecc-bb5b-e126dc70ec2c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:04.391264 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7603a-56c6-4538-83ac-53b38d437423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:04.391963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7603a-56c6-4538-83ac-53b38d437423 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:04.392284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7603a-56c6-4538-83ac-53b38d437423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:04.392516 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7603a-56c6-4538-83ac-53b38d437423 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:04.393842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7603a-56c6-4538-83ac-53b38d437423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:04.395340 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7603a-56c6-4538-83ac-53b38d437423 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:04.443597 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c17d01ac-96c6-438f-9c8d-0756f202a426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e1de0498f1b42ea90ec57812b1ac3d4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:04.509655 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 989/1959] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:55:04 2022] POST /identity/v3/projects => generated 361 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:04.512523 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7603a-56c6-4538-83ac-53b38d437423 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:04.513820 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c17d01ac-96c6-438f-9c8d-0756f202a426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e1de0498f1b42ea90ec57812b1ac3d4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:04.514768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c17d01ac-96c6-438f-9c8d-0756f202a426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e1de0498f1b42ea90ec57812b1ac3d4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:04.516517 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c17d01ac-96c6-438f-9c8d-0756f202a426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e1de0498f1b42ea90ec57812b1ac3d4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:04.528317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c17d01ac-96c6-438f-9c8d-0756f202a426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e1de0498f1b42ea90ec57812b1ac3d4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:04.535368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:04.560703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 971/1960] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:55:04 2022] DELETE /identity/v3/users/0e1de0498f1b42ea90ec57812b1ac3d4 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:04.560703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d01ac-96c6-438f-9c8d-0756f202a426 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:04.560703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c17d01ac-96c6-438f-9c8d-0756f202a426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:04.629510 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7603a-56c6-4538-83ac-53b38d437423 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:04.663144 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d01ac-96c6-438f-9c8d-0756f202a426 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:04.674768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec127f-3305-417e-ab4b-ed5ffb4a5ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:04.675930 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec127f-3305-417e-ab4b-ed5ffb4a5ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:04.676212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec127f-3305-417e-ab4b-ed5ffb4a5ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:04.676488 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec127f-3305-417e-ab4b-ed5ffb4a5ff2 admin admin] PATH_INFO: `/v3/projects/5d3724427c634179bb963a099710ea9c/users/17cee42ffa1443c58223c9ddadb59daf/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:04.698193 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec127f-3305-417e-ab4b-ed5ffb4a5ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d3724427c634179bb963a099710ea9c, user_id=17cee42ffa1443c58223c9ddadb59daf, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:04.702154 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec127f-3305-417e-ab4b-ed5ffb4a5ff2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:04.745215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d637c36-131d-4387-908c-c30d40a3a76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:04.745914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d637c36-131d-4387-908c-c30d40a3a76b admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:04.746262 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d637c36-131d-4387-908c-c30d40a3a76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:04.746544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d637c36-131d-4387-908c-c30d40a3a76b admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:04.747248 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d637c36-131d-4387-908c-c30d40a3a76b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:04.749309 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d637c36-131d-4387-908c-c30d40a3a76b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:04.803332 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 972/1961] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:04 2022] PUT /identity/v3/projects/5d3724427c634179bb963a099710ea9c/users/17cee42ffa1443c58223c9ddadb59daf/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:04.803971 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec127f-3305-417e-ab4b-ed5ffb4a5ff2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:04.806060 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6fec127f-3305-417e-ab4b-ed5ffb4a5ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:04.868684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:04.893429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec127f-3305-417e-ab4b-ed5ffb4a5ff2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:04.899397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3189675-135a-4c88-b892-28a69203cf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:04.900234 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3189675-135a-4c88-b892-28a69203cf01 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:04.900428 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3189675-135a-4c88-b892-28a69203cf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:04.900703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3189675-135a-4c88-b892-28a69203cf01 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:04.905845 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3189675-135a-4c88-b892-28a69203cf01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:04.909591 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3189675-135a-4c88-b892-28a69203cf01 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:04.924834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 990/1962] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:55:04 2022] POST /identity/v3/projects => generated 385 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:04.925849 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d637c36-131d-4387-908c-c30d40a3a76b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:05.018272 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 973/1963] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:55:04 2022] POST /identity/v3/users => generated 281 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:05.019451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3189675-135a-4c88-b892-28a69203cf01 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:05.021291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f3189675-135a-4c88-b892-28a69203cf01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:05.038914 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3189675-135a-4c88-b892-28a69203cf01 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:05.042493 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d637c36-131d-4387-908c-c30d40a3a76b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:05.047660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5632707-0ce8-4777-9667-f8543f402294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:05.048365 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5632707-0ce8-4777-9667-f8543f402294 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:05.048650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5632707-0ce8-4777-9667-f8543f402294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:05.049120 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5632707-0ce8-4777-9667-f8543f402294 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:05.049880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5632707-0ce8-4777-9667-f8543f402294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:05.051899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5632707-0ce8-4777-9667-f8543f402294 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:05.054389 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c21f36-d586-45ee-9cc5-5abcad7c160c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:05.055581 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c21f36-d586-45ee-9cc5-5abcad7c160c admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:05.056066 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c21f36-d586-45ee-9cc5-5abcad7c160c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:05.056537 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c21f36-d586-45ee-9cc5-5abcad7c160c admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:05.057741 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c21f36-d586-45ee-9cc5-5abcad7c160c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:05.060688 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c21f36-d586-45ee-9cc5-5abcad7c160c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:05.085737 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 991/1964] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:05.089350 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c21f36-d586-45ee-9cc5-5abcad7c160c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:05.102418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c21f36-d586-45ee-9cc5-5abcad7c160c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:05.112366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2fdbf-1c30-4bb2-9b27-0c13bf8cc3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:05.113226 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2fdbf-1c30-4bb2-9b27-0c13bf8cc3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:05.113605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2fdbf-1c30-4bb2-9b27-0c13bf8cc3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:05.113948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2fdbf-1c30-4bb2-9b27-0c13bf8cc3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:05.114900 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2fdbf-1c30-4bb2-9b27-0c13bf8cc3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:05.116818 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2fdbf-1c30-4bb2-9b27-0c13bf8cc3d1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:05.133487 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 992/1965] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:05.133487 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2fdbf-1c30-4bb2-9b27-0c13bf8cc3d1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:05.139044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 974/1966] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:55:05 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:05.140781 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5632707-0ce8-4777-9667-f8543f402294 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:05.151246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2fdbf-1c30-4bb2-9b27-0c13bf8cc3d1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:05.158647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5632707-0ce8-4777-9667-f8543f402294 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:05.159222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d455ab-85b0-4b29-9295-90cae4f1b1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:05.160683 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d455ab-85b0-4b29-9295-90cae4f1b1df admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:05.161032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d455ab-85b0-4b29-9295-90cae4f1b1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:05.161413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d455ab-85b0-4b29-9295-90cae4f1b1df admin admin] PATH_INFO: `/v3/projects/5d3724427c634179bb963a099710ea9c/users/17cee42ffa1443c58223c9ddadb59daf/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:05.166175 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6e8ba-e171-4e6c-8cd9-28abfaf002f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:05.167233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6e8ba-e171-4e6c-8cd9-28abfaf002f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:05.167697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6e8ba-e171-4e6c-8cd9-28abfaf002f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:05.168120 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d455ab-85b0-4b29-9295-90cae4f1b1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d3724427c634179bb963a099710ea9c, user_id=17cee42ffa1443c58223c9ddadb59daf, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:05.168254 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6e8ba-e171-4e6c-8cd9-28abfaf002f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:05.169397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6e8ba-e171-4e6c-8cd9-28abfaf002f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:05.172167 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6e8ba-e171-4e6c-8cd9-28abfaf002f5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:05.173297 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d455ab-85b0-4b29-9295-90cae4f1b1df admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:05.191242 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 975/1967] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:05.192847 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6e8ba-e171-4e6c-8cd9-28abfaf002f5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:05.202328 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 993/1968] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:05 2022] PUT /identity/v3/projects/5d3724427c634179bb963a099710ea9c/users/17cee42ffa1443c58223c9ddadb59daf/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:05.206802 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6e8ba-e171-4e6c-8cd9-28abfaf002f5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:05.211205 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d455ab-85b0-4b29-9295-90cae4f1b1df admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:05.214743 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e3d455ab-85b0-4b29-9295-90cae4f1b1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:05.262646 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:05.297355 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3f2b4-df43-47b1-a4b0-8c5436251a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:05.298189 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3f2b4-df43-47b1-a4b0-8c5436251a3f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:05.298643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3f2b4-df43-47b1-a4b0-8c5436251a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:05.298804 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3f2b4-df43-47b1-a4b0-8c5436251a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:05.299538 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3f2b4-df43-47b1-a4b0-8c5436251a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:05.301672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3f2b4-df43-47b1-a4b0-8c5436251a3f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:05.324586 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 976/1969] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:05.329725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d455ab-85b0-4b29-9295-90cae4f1b1df admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:05.330894 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3f2b4-df43-47b1-a4b0-8c5436251a3f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:05.332880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dd72a-caa3-485b-b140-5549f2bb1d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:05.333842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dd72a-caa3-485b-b140-5549f2bb1d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:05.334164 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dd72a-caa3-485b-b140-5549f2bb1d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:05.335301 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dd72a-caa3-485b-b140-5549f2bb1d05 admin admin] PATH_INFO: `/v3/projects/8092d8ccd70540c88ed74923256994c6` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:05.335815 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3dd72a-caa3-485b-b140-5549f2bb1d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8092d8ccd70540c88ed74923256994c6)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:05.338404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3dd72a-caa3-485b-b140-5549f2bb1d05 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:05.340190 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3f2b4-df43-47b1-a4b0-8c5436251a3f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:05.346450 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf353e-850d-49a0-9815-ab5a8a9fe067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:05.347927 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf353e-850d-49a0-9815-ab5a8a9fe067 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:05.348267 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf353e-850d-49a0-9815-ab5a8a9fe067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:05.348755 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf353e-850d-49a0-9815-ab5a8a9fe067 admin admin] PATH_INFO: `/v3/projects/6c3661e151a04d18b71343994bca3ad2/users/28cb46d35a9d440e9533ae20df54f776/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:05.369623 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf353e-850d-49a0-9815-ab5a8a9fe067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c3661e151a04d18b71343994bca3ad2, user_id=28cb46d35a9d440e9533ae20df54f776, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:05.372694 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf353e-850d-49a0-9815-ab5a8a9fe067 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:05.502588 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 977/1970] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:05 2022] PUT /identity/v3/projects/6c3661e151a04d18b71343994bca3ad2/users/28cb46d35a9d440e9533ae20df54f776/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:05.504541 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4b0d5-2071-4050-8772-1f9e7a2110d6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:05.504718 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4b0d5-2071-4050-8772-1f9e7a2110d6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:05.505004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4b0d5-2071-4050-8772-1f9e7a2110d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:05.515201 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cf3dd72a-caa3-485b-b140-5549f2bb1d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8092d8ccd70540c88ed74923256994c6', 'request_id': 'req-cf3dd72a-caa3-485b-b140-5549f2bb1d05'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:05.552037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-01d4b0d5-2071-4050-8772-1f9e7a2110d6 None None] MFA Rules not processed for user `17cee42ffa1443c58223c9ddadb59daf`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:05.553482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-01d4b0d5-2071-4050-8772-1f9e7a2110d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:05.589187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cf3dd72a-caa3-485b-b140-5549f2bb1d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8092d8ccd70540c88ed74923256994c6', 'request_id': 'req-cf3dd72a-caa3-485b-b140-5549f2bb1d05'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:05.601625 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cf3dd72a-caa3-485b-b140-5549f2bb1d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8092d8ccd70540c88ed74923256994c6', 'request_id': 'req-cf3dd72a-caa3-485b-b140-5549f2bb1d05'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:05.624455 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cf3dd72a-caa3-485b-b140-5549f2bb1d05 admin admin] The token cache is being invalidate because project 8092d8ccd70540c88ed74923256994c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:55:05.625030 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cf3dd72a-caa3-485b-b140-5549f2bb1d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:05.626206 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cf3dd72a-caa3-485b-b140-5549f2bb1d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:05.629196 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 994/1971] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:55:05 2022] DELETE /identity/v3/projects/8092d8ccd70540c88ed74923256994c6 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:05.631025 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dd72a-caa3-485b-b140-5549f2bb1d05 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:05.632856 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cf3dd72a-caa3-485b-b140-5549f2bb1d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:05.651395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:05.659108 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 978/1972] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:05.661429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eb141-abb6-4e8c-a01e-a1f518e0f278 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:05.662194 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eb141-abb6-4e8c-a01e-a1f518e0f278 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:05.662909 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eb141-abb6-4e8c-a01e-a1f518e0f278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:05.718422 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b11eb141-abb6-4e8c-a01e-a1f518e0f278 None None] MFA Rules not processed for user `28cb46d35a9d440e9533ae20df54f776`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:05.718422 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b11eb141-abb6-4e8c-a01e-a1f518e0f278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:05.764650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dd72a-caa3-485b-b140-5549f2bb1d05 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:05.771797 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de389c99-5b82-48b9-b2fc-9618e2498a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:05.772617 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de389c99-5b82-48b9-b2fc-9618e2498a2f admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:05.773038 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de389c99-5b82-48b9-b2fc-9618e2498a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:05.773457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de389c99-5b82-48b9-b2fc-9618e2498a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:05.775077 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de389c99-5b82-48b9-b2fc-9618e2498a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:05.777115 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de389c99-5b82-48b9-b2fc-9618e2498a2f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:05.790999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 995/1973] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:05.795848 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67201c1e-dda3-46a5-839c-059aaa95849d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:05.796499 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67201c1e-dda3-46a5-839c-059aaa95849d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:05.797109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67201c1e-dda3-46a5-839c-059aaa95849d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:05.825747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 979/1974] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:05.830792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eb141-abb6-4e8c-a01e-a1f518e0f278 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:05.830792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b11eb141-abb6-4e8c-a01e-a1f518e0f278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:05.832820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-67201c1e-dda3-46a5-839c-059aaa95849d None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:05.834841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-67201c1e-dda3-46a5-839c-059aaa95849d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:05.864304 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 996/1975] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:05.864304 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67201c1e-dda3-46a5-839c-059aaa95849d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:05.886367 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67201c1e-dda3-46a5-839c-059aaa95849d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:05.894758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3e5a5-025b-4be8-9a70-cda187373e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:05.896393 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3e5a5-025b-4be8-9a70-cda187373e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:05.896894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3e5a5-025b-4be8-9a70-cda187373e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:05.897531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3e5a5-025b-4be8-9a70-cda187373e92 admin admin] PATH_INFO: `/v3/projects/060af6cf4f7a48758f6859bd3766ae1b/users/1551f28754a64d1d9010ed90b67c5dc4/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:05.925248 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3e5a5-025b-4be8-9a70-cda187373e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=060af6cf4f7a48758f6859bd3766ae1b, user_id=1551f28754a64d1d9010ed90b67c5dc4, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:05.931489 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3e5a5-025b-4be8-9a70-cda187373e92 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:05.954572 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eb141-abb6-4e8c-a01e-a1f518e0f278 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:05.962680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac7264-f055-4df0-bf6e-0d05fc957375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:05.963838 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac7264-f055-4df0-bf6e-0d05fc957375 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:05.964353 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac7264-f055-4df0-bf6e-0d05fc957375 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:05.964877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac7264-f055-4df0-bf6e-0d05fc957375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:05.968315 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8dac7264-f055-4df0-bf6e-0d05fc957375 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:06.049735 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 997/1976] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:05 2022] PUT /identity/v3/projects/060af6cf4f7a48758f6859bd3766ae1b/users/1551f28754a64d1d9010ed90b67c5dc4/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:06.052395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee2c15-cad6-4d7a-9682-cf602a6f59f4 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:06.052905 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee2c15-cad6-4d7a-9682-cf602a6f59f4 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:06.053434 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee2c15-cad6-4d7a-9682-cf602a6f59f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:06.064928 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac7264-f055-4df0-bf6e-0d05fc957375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:06.067210 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac7264-f055-4df0-bf6e-0d05fc957375 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:06.080033 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6fee2c15-cad6-4d7a-9682-cf602a6f59f4 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:06.081736 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6fee2c15-cad6-4d7a-9682-cf602a6f59f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:06.083586 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 980/1977] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:06.084550 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac7264-f055-4df0-bf6e-0d05fc957375 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:06.086124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8dac7264-f055-4df0-bf6e-0d05fc957375 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:06.099606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac7264-f055-4df0-bf6e-0d05fc957375 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:06.106020 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:06.131413 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:06.185447 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca656e28-4542-4cf9-a7a9-a1f16b9be637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:06.186250 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca656e28-4542-4cf9-a7a9-a1f16b9be637 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:06.186641 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca656e28-4542-4cf9-a7a9-a1f16b9be637 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:06.186978 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca656e28-4542-4cf9-a7a9-a1f16b9be637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:06.196951 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 998/1978] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:06.199882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091901e0-44f4-4f94-85ec-d5f84cbd0d98 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:06.200333 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091901e0-44f4-4f94-85ec-d5f84cbd0d98 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:06.200662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091901e0-44f4-4f94-85ec-d5f84cbd0d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:06.228291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-091901e0-44f4-4f94-85ec-d5f84cbd0d98 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:06.231249 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-091901e0-44f4-4f94-85ec-d5f84cbd0d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:06.248568 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 999/1979] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:06.249616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091901e0-44f4-4f94-85ec-d5f84cbd0d98 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:06.260758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091901e0-44f4-4f94-85ec-d5f84cbd0d98 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:06.267178 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76629094-f1fa-474c-991b-c2dfb0605ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:06.267976 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76629094-f1fa-474c-991b-c2dfb0605ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:06.268146 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76629094-f1fa-474c-991b-c2dfb0605ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:06.268423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76629094-f1fa-474c-991b-c2dfb0605ee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:06.269345 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76629094-f1fa-474c-991b-c2dfb0605ee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:55:06.269935 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76629094-f1fa-474c-991b-c2dfb0605ee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:06.272078 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76629094-f1fa-474c-991b-c2dfb0605ee4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:06.288868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1000/1980] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:55:06.289818 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76629094-f1fa-474c-991b-c2dfb0605ee4 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:06.294233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-76629094-f1fa-474c-991b-c2dfb0605ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:06.325464 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca656e28-4542-4cf9-a7a9-a1f16b9be637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:06.327354 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca656e28-4542-4cf9-a7a9-a1f16b9be637 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:06.350329 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 981/1981] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:06.352377 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca656e28-4542-4cf9-a7a9-a1f16b9be637 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:06.376549 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca656e28-4542-4cf9-a7a9-a1f16b9be637 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:06.379525 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76629094-f1fa-474c-991b-c2dfb0605ee4 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:06.390406 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedb7a1-9be9-458f-8c44-61d0c53e2a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:06.391185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3831ac0-80f7-4b52-967f-bede56cbe67d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:06.391738 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedb7a1-9be9-458f-8c44-61d0c53e2a40 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:06.392252 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3831ac0-80f7-4b52-967f-bede56cbe67d service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:06.392409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedb7a1-9be9-458f-8c44-61d0c53e2a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:06.392707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedb7a1-9be9-458f-8c44-61d0c53e2a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:06.392872 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3831ac0-80f7-4b52-967f-bede56cbe67d service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:06.393156 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3831ac0-80f7-4b52-967f-bede56cbe67d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:06.394054 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedb7a1-9be9-458f-8c44-61d0c53e2a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:06.400586 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedb7a1-9be9-458f-8c44-61d0c53e2a40 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:06.427468 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3831ac0-80f7-4b52-967f-bede56cbe67d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:06.429451 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3831ac0-80f7-4b52-967f-bede56cbe67d service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:06.444170 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1001/1982] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:06.444992 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3831ac0-80f7-4b52-967f-bede56cbe67d service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:06.447323 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e3831ac0-80f7-4b52-967f-bede56cbe67d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:06.472409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3831ac0-80f7-4b52-967f-bede56cbe67d service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:06.483597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52caf9-bac0-4273-8f43-9afa307037c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:06.485105 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52caf9-bac0-4273-8f43-9afa307037c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:06.485617 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52caf9-bac0-4273-8f43-9afa307037c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:06.486082 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52caf9-bac0-4273-8f43-9afa307037c0 admin admin] PATH_INFO: `/v3/users/28cb46d35a9d440e9533ae20df54f776` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:06.488107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52caf9-bac0-4273-8f43-9afa307037c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28cb46d35a9d440e9533ae20df54f776)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:06.491846 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52caf9-bac0-4273-8f43-9afa307037c0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:06.527500 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 982/1983] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:55:06 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:06.529243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedb7a1-9be9-458f-8c44-61d0c53e2a40 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:06.703379 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedb7a1-9be9-458f-8c44-61d0c53e2a40 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:06.718694 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f570652-0965-40e8-9cbf-dd570a29426b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:06.721354 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f570652-0965-40e8-9cbf-dd570a29426b admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:06.722936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f570652-0965-40e8-9cbf-dd570a29426b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:06.722936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f570652-0965-40e8-9cbf-dd570a29426b admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:06.724008 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f570652-0965-40e8-9cbf-dd570a29426b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:06.728147 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f570652-0965-40e8-9cbf-dd570a29426b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:06.794096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0d52caf9-bac0-4273-8f43-9afa307037c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28cb46d35a9d440e9533ae20df54f776'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:06.795524 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0d52caf9-bac0-4273-8f43-9afa307037c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28cb46d35a9d440e9533ae20df54f776'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:06.819795 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0d52caf9-bac0-4273-8f43-9afa307037c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28cb46d35a9d440e9533ae20df54f776'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:06.918845 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 983/1984] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:55:06 2022] POST /identity/v3/users => generated 289 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:06.924582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f570652-0965-40e8-9cbf-dd570a29426b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:06.945224 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f570652-0965-40e8-9cbf-dd570a29426b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:06.948160 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0d52caf9-bac0-4273-8f43-9afa307037c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28cb46d35a9d440e9533ae20df54f776'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:06.949216 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0d52caf9-bac0-4273-8f43-9afa307037c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28cb46d35a9d440e9533ae20df54f776'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:06.951742 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9badc0f-7737-41c1-8a3e-a93b413aeb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:06.952519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9badc0f-7737-41c1-8a3e-a93b413aeb8a admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:06.952916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9badc0f-7737-41c1-8a3e-a93b413aeb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:06.953316 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9badc0f-7737-41c1-8a3e-a93b413aeb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:06.954032 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9badc0f-7737-41c1-8a3e-a93b413aeb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:06.956261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9badc0f-7737-41c1-8a3e-a93b413aeb8a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:06.973540 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 984/1985] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:55:06.980635 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9badc0f-7737-41c1-8a3e-a93b413aeb8a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:06.985647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d9badc0f-7737-41c1-8a3e-a93b413aeb8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:07.004258 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1002/1986] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:55:06 2022] DELETE /identity/v3/users/28cb46d35a9d440e9533ae20df54f776 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:07.006388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9badc0f-7737-41c1-8a3e-a93b413aeb8a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:07.012487 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676d9c4-e341-4bc7-bd05-a9d9798972cf None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:07.016978 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676d9c4-e341-4bc7-bd05-a9d9798972cf None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:07.016978 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676d9c4-e341-4bc7-bd05-a9d9798972cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:07.077658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:07.098696 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6676d9c4-e341-4bc7-bd05-a9d9798972cf None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:07.103348 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6676d9c4-e341-4bc7-bd05-a9d9798972cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:07.115165 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:07.138615 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffd54e-496a-4aaf-b437-fa719146f915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:07.140877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffd54e-496a-4aaf-b437-fa719146f915 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:07.142179 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffd54e-496a-4aaf-b437-fa719146f915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:07.142179 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffd54e-496a-4aaf-b437-fa719146f915 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:07.149839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffd54e-496a-4aaf-b437-fa719146f915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:07.149839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffd54e-496a-4aaf-b437-fa719146f915 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:07.171969 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 985/1987] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:55:07.189179 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffd54e-496a-4aaf-b437-fa719146f915 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:07.232409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffd54e-496a-4aaf-b437-fa719146f915 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:07.250184 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d53f3-c76a-479e-976a-11544a02427e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:07.258935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d53f3-c76a-479e-976a-11544a02427e admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:07.258935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d53f3-c76a-479e-976a-11544a02427e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:07.258935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d53f3-c76a-479e-976a-11544a02427e admin admin] PATH_INFO: `/v3/projects/56f65eb5205d4cdd949a6f3a6131ee7a/users/9aa096e83bea4280806ab0b1fd9fc546/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:07.308742 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d53f3-c76a-479e-976a-11544a02427e admin admin] RBAC: Authorizing `identity:create_grant(project_id=56f65eb5205d4cdd949a6f3a6131ee7a, user_id=9aa096e83bea4280806ab0b1fd9fc546, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:07.314123 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d53f3-c76a-479e-976a-11544a02427e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:07.322742 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1003/1988] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:07.336239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676d9c4-e341-4bc7-bd05-a9d9798972cf None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:07.338663 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6676d9c4-e341-4bc7-bd05-a9d9798972cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:07.431727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 986/1989] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:07 2022] PUT /identity/v3/projects/56f65eb5205d4cdd949a6f3a6131ee7a/users/9aa096e83bea4280806ab0b1fd9fc546/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:07.444562 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb25b2f-c184-473a-a0ca-4f5b8ec4f53e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:07.445455 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb25b2f-c184-473a-a0ca-4f5b8ec4f53e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:07.445887 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb25b2f-c184-473a-a0ca-4f5b8ec4f53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:07.450457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676d9c4-e341-4bc7-bd05-a9d9798972cf None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:07.490599 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0fb25b2f-c184-473a-a0ca-4f5b8ec4f53e None None] MFA Rules not processed for user `9aa096e83bea4280806ab0b1fd9fc546`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:07.496943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0fb25b2f-c184-473a-a0ca-4f5b8ec4f53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:07.546075 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ae2d7-9fa7-4280-9350-30a4c2e3378d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:07.546993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ae2d7-9fa7-4280-9350-30a4c2e3378d service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:07.547430 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ae2d7-9fa7-4280-9350-30a4c2e3378d service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:07.547765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ae2d7-9fa7-4280-9350-30a4c2e3378d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:07.610626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 987/1990] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:07.637947 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb25b2f-c184-473a-a0ca-4f5b8ec4f53e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:07.639577 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0fb25b2f-c184-473a-a0ca-4f5b8ec4f53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:07.675379 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ae2d7-9fa7-4280-9350-30a4c2e3378d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:07.677347 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ae2d7-9fa7-4280-9350-30a4c2e3378d service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:07.699510 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1004/1991] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:07.739065 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb25b2f-c184-473a-a0ca-4f5b8ec4f53e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:07.747528 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911f114-3f86-4f23-a3f4-a61323026dda service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7701907eb3b24c3681352c91ad6a3aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:07.749548 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911f114-3f86-4f23-a3f4-a61323026dda service glance] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:07.749833 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911f114-3f86-4f23-a3f4-a61323026dda service glance] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:07.750542 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911f114-3f86-4f23-a3f4-a61323026dda service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:07.765227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911f114-3f86-4f23-a3f4-a61323026dda service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:07.768039 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911f114-3f86-4f23-a3f4-a61323026dda service glance] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:07.787455 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 988/1992] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:08.492282 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ae2d7-9fa7-4280-9350-30a4c2e3378d service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:08.497131 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-aa9ae2d7-9fa7-4280-9350-30a4c2e3378d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:08.527273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ae2d7-9fa7-4280-9350-30a4c2e3378d service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:08.535506 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28754434-d491-4dc5-a623-781cfcb9e6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:08.537064 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28754434-d491-4dc5-a623-781cfcb9e6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:08.538331 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28754434-d491-4dc5-a623-781cfcb9e6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:08.538823 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28754434-d491-4dc5-a623-781cfcb9e6fb admin admin] PATH_INFO: `/v3/projects/6c3661e151a04d18b71343994bca3ad2` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:08.541312 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28754434-d491-4dc5-a623-781cfcb9e6fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c3661e151a04d18b71343994bca3ad2)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:08.543449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28754434-d491-4dc5-a623-781cfcb9e6fb admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:08.570109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:08.721337 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-28754434-d491-4dc5-a623-781cfcb9e6fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c3661e151a04d18b71343994bca3ad2', 'request_id': 'req-28754434-d491-4dc5-a623-781cfcb9e6fb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:08.827877 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-28754434-d491-4dc5-a623-781cfcb9e6fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c3661e151a04d18b71343994bca3ad2', 'request_id': 'req-28754434-d491-4dc5-a623-781cfcb9e6fb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:08.857092 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-28754434-d491-4dc5-a623-781cfcb9e6fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c3661e151a04d18b71343994bca3ad2', 'request_id': 'req-28754434-d491-4dc5-a623-781cfcb9e6fb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:08.888128 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-28754434-d491-4dc5-a623-781cfcb9e6fb admin admin] The token cache is being invalidate because project 6c3661e151a04d18b71343994bca3ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:55:08.888564 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-28754434-d491-4dc5-a623-781cfcb9e6fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:08.889680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-28754434-d491-4dc5-a623-781cfcb9e6fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:08.891664 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1005/1993] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:55:08 2022] DELETE /identity/v3/projects/6c3661e151a04d18b71343994bca3ad2 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:55:08.897854 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe2e86-2b11-4840-b037-9281bee62895 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:08.901479 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe2e86-2b11-4840-b037-9281bee62895 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:08.901479 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe2e86-2b11-4840-b037-9281bee62895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:08.917986 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-42fe2e86-2b11-4840-b037-9281bee62895 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:08.919216 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-42fe2e86-2b11-4840-b037-9281bee62895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:08.957682 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:08.998195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 989/1994] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:09.005855 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7b52b-0974-4169-991f-406db2cac533 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:09.006205 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7b52b-0974-4169-991f-406db2cac533 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:09.006555 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7b52b-0974-4169-991f-406db2cac533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:09.043134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-49e7b52b-0974-4169-991f-406db2cac533 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:09.045310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-49e7b52b-0974-4169-991f-406db2cac533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:09.058626 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1006/1995] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:09.062981 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe2e86-2b11-4840-b037-9281bee62895 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:09.084201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe2e86-2b11-4840-b037-9281bee62895 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:09.089669 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d00ed5-a596-4ec5-af88-d5de43445b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:09.090802 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d00ed5-a596-4ec5-af88-d5de43445b55 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:09.090991 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d00ed5-a596-4ec5-af88-d5de43445b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:09.091292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d00ed5-a596-4ec5-af88-d5de43445b55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:09.092042 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d00ed5-a596-4ec5-af88-d5de43445b55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:55:09.092566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d00ed5-a596-4ec5-af88-d5de43445b55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:09.094432 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d00ed5-a596-4ec5-af88-d5de43445b55 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:09.110104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 990/1996] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:55:09.115693 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7b52b-0974-4169-991f-406db2cac533 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:09.129705 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7b52b-0974-4169-991f-406db2cac533 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:09.137486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ea14b-ef6c-442a-8eb0-43d2cc0fe6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:09.138306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ea14b-ef6c-442a-8eb0-43d2cc0fe6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:09.138885 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ea14b-ef6c-442a-8eb0-43d2cc0fe6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:09.139252 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ea14b-ef6c-442a-8eb0-43d2cc0fe6c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:09.142048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ea14b-ef6c-442a-8eb0-43d2cc0fe6c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:09.149576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ea14b-ef6c-442a-8eb0-43d2cc0fe6c2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:09.267467 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1007/1997] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:55:09 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:09.270111 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d00ed5-a596-4ec5-af88-d5de43445b55 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:09.284389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d00ed5-a596-4ec5-af88-d5de43445b55 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:09.380305 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fdc5a-feb7-4009-8de4-ad65a45c7172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:09.381408 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fdc5a-feb7-4009-8de4-ad65a45c7172 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:09.381873 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fdc5a-feb7-4009-8de4-ad65a45c7172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:09.382154 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fdc5a-feb7-4009-8de4-ad65a45c7172 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:09.383039 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fdc5a-feb7-4009-8de4-ad65a45c7172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:09.385463 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fdc5a-feb7-4009-8de4-ad65a45c7172 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:09.514486 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 991/1998] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:55:09 2022] POST /identity/v3/users => generated 288 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:09.522858 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ea14b-ef6c-442a-8eb0-43d2cc0fe6c2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:09.535059 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ea14b-ef6c-442a-8eb0-43d2cc0fe6c2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:09.540820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cee02-00e7-4dc8-88c5-def446d61122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:09.541552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cee02-00e7-4dc8-88c5-def446d61122 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:09.541837 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cee02-00e7-4dc8-88c5-def446d61122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:09.542116 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cee02-00e7-4dc8-88c5-def446d61122 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:09.542862 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72cee02-00e7-4dc8-88c5-def446d61122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:09.544845 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72cee02-00e7-4dc8-88c5-def446d61122 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:09.563082 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1008/1999] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:09.570124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fdc5a-feb7-4009-8de4-ad65a45c7172 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:09.590874 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fdc5a-feb7-4009-8de4-ad65a45c7172 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:09.599813 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eafa40-db9d-4527-bca4-40f7e0fbd1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:09.600818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eafa40-db9d-4527-bca4-40f7e0fbd1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:09.601392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eafa40-db9d-4527-bca4-40f7e0fbd1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:09.602652 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eafa40-db9d-4527-bca4-40f7e0fbd1e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:09.604071 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eafa40-db9d-4527-bca4-40f7e0fbd1e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:09.606850 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eafa40-db9d-4527-bca4-40f7e0fbd1e7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:09.625990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 992/2000] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:09.630195 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cee02-00e7-4dc8-88c5-def446d61122 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:09.641337 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cee02-00e7-4dc8-88c5-def446d61122 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:09.646226 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cf773-f1b8-4376-915f-fda5cb924123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:09.647122 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cf773-f1b8-4376-915f-fda5cb924123 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:09.647399 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cf773-f1b8-4376-915f-fda5cb924123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:09.647671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cf773-f1b8-4376-915f-fda5cb924123 admin admin] PATH_INFO: `/v3/projects/23698a85c008409bae3fee9429974325/users/3131756d356f46098f58fde8ce6fe012/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:09.666336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3cf773-f1b8-4376-915f-fda5cb924123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23698a85c008409bae3fee9429974325, user_id=3131756d356f46098f58fde8ce6fe012, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:09.669001 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3cf773-f1b8-4376-915f-fda5cb924123 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:09.787652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1009/2001] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:09 2022] PUT /identity/v3/projects/23698a85c008409bae3fee9429974325/users/3131756d356f46098f58fde8ce6fe012/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:09.789092 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5033656-86cc-4211-a19a-31aa3a72509a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:09.789427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5033656-86cc-4211-a19a-31aa3a72509a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:09.790466 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5033656-86cc-4211-a19a-31aa3a72509a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:09.829027 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c5033656-86cc-4211-a19a-31aa3a72509a None None] MFA Rules not processed for user `3131756d356f46098f58fde8ce6fe012`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:09.830609 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c5033656-86cc-4211-a19a-31aa3a72509a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:09.929513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 993/2002] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:55:09.931078 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cf773-f1b8-4376-915f-fda5cb924123 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:10.047105 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cf773-f1b8-4376-915f-fda5cb924123 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:10.053433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817d09a-79bc-4b0f-a304-9545c0c1095f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:10.054164 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817d09a-79bc-4b0f-a304-9545c0c1095f admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:10.054457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817d09a-79bc-4b0f-a304-9545c0c1095f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:10.055276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817d09a-79bc-4b0f-a304-9545c0c1095f admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:10.056112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817d09a-79bc-4b0f-a304-9545c0c1095f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:10.058288 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817d09a-79bc-4b0f-a304-9545c0c1095f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:10.160280 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1010/2003] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:55:09 2022] POST /identity/v3/projects => generated 375 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:10.161523 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5033656-86cc-4211-a19a-31aa3a72509a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:10.177296 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5033656-86cc-4211-a19a-31aa3a72509a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:10.250662 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:10.282213 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf96f1-69a8-476a-9fd6-719cd63d08d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:10.283078 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf96f1-69a8-476a-9fd6-719cd63d08d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:10.283367 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf96f1-69a8-476a-9fd6-719cd63d08d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:10.283644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf96f1-69a8-476a-9fd6-719cd63d08d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:10.284349 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf96f1-69a8-476a-9fd6-719cd63d08d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:10.286671 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf96f1-69a8-476a-9fd6-719cd63d08d8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:10.381318 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 994/2004] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:55:10 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:10.385614 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817d09a-79bc-4b0f-a304-9545c0c1095f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:10.404056 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817d09a-79bc-4b0f-a304-9545c0c1095f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:10.412038 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da956b8-6f70-42bc-89ce-4547686615ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:10.412789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da956b8-6f70-42bc-89ce-4547686615ee admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:10.413130 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da956b8-6f70-42bc-89ce-4547686615ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:10.413592 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da956b8-6f70-42bc-89ce-4547686615ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:10.415236 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da956b8-6f70-42bc-89ce-4547686615ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:10.417692 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da956b8-6f70-42bc-89ce-4547686615ee admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:10.437346 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1011/2005] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:55:10.440146 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf96f1-69a8-476a-9fd6-719cd63d08d8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:10.455244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf96f1-69a8-476a-9fd6-719cd63d08d8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:10.463253 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b92371-28f1-4f77-a6aa-fb035fac18a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:10.464404 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b92371-28f1-4f77-a6aa-fb035fac18a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:10.464844 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b92371-28f1-4f77-a6aa-fb035fac18a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:10.465907 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b92371-28f1-4f77-a6aa-fb035fac18a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:10.466565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b92371-28f1-4f77-a6aa-fb035fac18a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:10.469717 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b92371-28f1-4f77-a6aa-fb035fac18a7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:10.496995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 995/2006] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:55:10.498377 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da956b8-6f70-42bc-89ce-4547686615ee admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:10.517536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da956b8-6f70-42bc-89ce-4547686615ee admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:10.523740 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbba4ad-e677-4227-bc21-877243dcf68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:10.524738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbba4ad-e677-4227-bc21-877243dcf68f admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:10.525091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbba4ad-e677-4227-bc21-877243dcf68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:10.525515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbba4ad-e677-4227-bc21-877243dcf68f admin admin] PATH_INFO: `/v3/projects/6cdca35127e041728aed13169c3ce2c8/users/a7de8ca7f9c54d1db52d2424f1ed3119/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:10.541729 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:10.547266 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbba4ad-e677-4227-bc21-877243dcf68f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cdca35127e041728aed13169c3ce2c8, user_id=a7de8ca7f9c54d1db52d2424f1ed3119, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:10.550617 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbba4ad-e677-4227-bc21-877243dcf68f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:10.633198 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1012/2007] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:10 2022] PUT /identity/v3/projects/6cdca35127e041728aed13169c3ce2c8/users/a7de8ca7f9c54d1db52d2424f1ed3119/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:10.650537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49facad-5b84-4e98-b1cd-6267b7d61a9b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:10.650957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49facad-5b84-4e98-b1cd-6267b7d61a9b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:10.651443 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49facad-5b84-4e98-b1cd-6267b7d61a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:10.704435 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e49facad-5b84-4e98-b1cd-6267b7d61a9b None None] MFA Rules not processed for user `a7de8ca7f9c54d1db52d2424f1ed3119`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:10.706375 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e49facad-5b84-4e98-b1cd-6267b7d61a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:10.814942 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 996/2008] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:55:10.816838 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbba4ad-e677-4227-bc21-877243dcf68f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:10.901542 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbba4ad-e677-4227-bc21-877243dcf68f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:10.907422 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4ec14-38b0-445b-b68f-c901fffa5f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:10.908110 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4ec14-38b0-445b-b68f-c901fffa5f7a admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:10.909401 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4ec14-38b0-445b-b68f-c901fffa5f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:10.909960 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4ec14-38b0-445b-b68f-c901fffa5f7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:10.911248 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4ec14-38b0-445b-b68f-c901fffa5f7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:10.913465 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4ec14-38b0-445b-b68f-c901fffa5f7a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:11.031479 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1013/2009] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:55:10 2022] POST /identity/v3/projects => generated 377 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:11.036414 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49facad-5b84-4e98-b1cd-6267b7d61a9b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:11.056374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49facad-5b84-4e98-b1cd-6267b7d61a9b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:11.145736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5104a-68cb-443d-82e6-27a5ad5d82ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:11.146453 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5104a-68cb-443d-82e6-27a5ad5d82ce admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:11.146739 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5104a-68cb-443d-82e6-27a5ad5d82ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:11.147037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5104a-68cb-443d-82e6-27a5ad5d82ce admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:11.147773 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5104a-68cb-443d-82e6-27a5ad5d82ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:11.150917 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5104a-68cb-443d-82e6-27a5ad5d82ce admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:11.256982 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 997/2010] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:55:11 2022] POST /identity/v3/users => generated 295 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:55:11.262250 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4ec14-38b0-445b-b68f-c901fffa5f7a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:11.276401 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4ec14-38b0-445b-b68f-c901fffa5f7a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:11.281824 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac271d-a659-45d4-a8ac-1e67c86c7eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:11.282484 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac271d-a659-45d4-a8ac-1e67c86c7eda admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:11.282760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac271d-a659-45d4-a8ac-1e67c86c7eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:11.283291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac271d-a659-45d4-a8ac-1e67c86c7eda admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:11.284036 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac271d-a659-45d4-a8ac-1e67c86c7eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:11.286753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac271d-a659-45d4-a8ac-1e67c86c7eda admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:11.300560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1014/2011] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:55:11.307581 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5104a-68cb-443d-82e6-27a5ad5d82ce admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:11.319869 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5104a-68cb-443d-82e6-27a5ad5d82ce admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:11.326160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21771bdf-58ec-454a-8516-f92761b7d6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:11.327072 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21771bdf-58ec-454a-8516-f92761b7d6ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:11.327344 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21771bdf-58ec-454a-8516-f92761b7d6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:11.327618 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21771bdf-58ec-454a-8516-f92761b7d6ec admin admin] PATH_INFO: `/v3/projects/cbc7fcc26f8c4ca6abdf9cd1a3b612cc/users/0aa35c786eef4157a029e987c154d1ac/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:11.349559 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21771bdf-58ec-454a-8516-f92761b7d6ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc7fcc26f8c4ca6abdf9cd1a3b612cc, user_id=0aa35c786eef4157a029e987c154d1ac, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:11.352656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21771bdf-58ec-454a-8516-f92761b7d6ec admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:11.430734 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 998/2012] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:11 2022] PUT /identity/v3/projects/cbc7fcc26f8c4ca6abdf9cd1a3b612cc/users/0aa35c786eef4157a029e987c154d1ac/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:11.435560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac271d-a659-45d4-a8ac-1e67c86c7eda admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:11.450657 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac271d-a659-45d4-a8ac-1e67c86c7eda admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:11.579945 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603a5df-f40f-4866-a7ba-c4030d58cde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:11.581397 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603a5df-f40f-4866-a7ba-c4030d58cde5 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:11.581980 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603a5df-f40f-4866-a7ba-c4030d58cde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:11.582267 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603a5df-f40f-4866-a7ba-c4030d58cde5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:11.583183 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603a5df-f40f-4866-a7ba-c4030d58cde5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:11.585010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603a5df-f40f-4866-a7ba-c4030d58cde5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:11.599046 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1015/2013] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:11.603431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21771bdf-58ec-454a-8516-f92761b7d6ec admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:11.616062 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21771bdf-58ec-454a-8516-f92761b7d6ec admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:11.630876 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4de8e0-e8b1-4d9c-bf39-51675b7ebb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:11.635363 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4de8e0-e8b1-4d9c-bf39-51675b7ebb34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:11.637847 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4de8e0-e8b1-4d9c-bf39-51675b7ebb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:11.638514 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4de8e0-e8b1-4d9c-bf39-51675b7ebb34 admin admin] PATH_INFO: `/v3/projects/cbc7fcc26f8c4ca6abdf9cd1a3b612cc/users/0aa35c786eef4157a029e987c154d1ac/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:11.643315 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4de8e0-e8b1-4d9c-bf39-51675b7ebb34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc7fcc26f8c4ca6abdf9cd1a3b612cc, user_id=0aa35c786eef4157a029e987c154d1ac, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:11.648662 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4de8e0-e8b1-4d9c-bf39-51675b7ebb34 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:11.655319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:11.666879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 999/2014] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:11 2022] PUT /identity/v3/projects/cbc7fcc26f8c4ca6abdf9cd1a3b612cc/users/0aa35c786eef4157a029e987c154d1ac/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:11.693937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf5adc-3edf-49e9-b43b-59ff14bb4f8f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:11.695198 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf5adc-3edf-49e9-b43b-59ff14bb4f8f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:11.696919 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf5adc-3edf-49e9-b43b-59ff14bb4f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:11.745690 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-cfdf5adc-3edf-49e9-b43b-59ff14bb4f8f None None] MFA Rules not processed for user `0aa35c786eef4157a029e987c154d1ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:11.747420 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cfdf5adc-3edf-49e9-b43b-59ff14bb4f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:11.845565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:11.881558 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1016/2015] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:11.902919 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4de8e0-e8b1-4d9c-bf39-51675b7ebb34 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:11.905089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5c4de8e0-e8b1-4d9c-bf39-51675b7ebb34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:12.016606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4de8e0-e8b1-4d9c-bf39-51675b7ebb34 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:12.026952 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a093cbf-99ab-41fd-a67f-d25b1ac26da1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:12.028183 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a093cbf-99ab-41fd-a67f-d25b1ac26da1 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:12.028816 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a093cbf-99ab-41fd-a67f-d25b1ac26da1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:12.029447 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a093cbf-99ab-41fd-a67f-d25b1ac26da1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:12.152302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a093cbf-99ab-41fd-a67f-d25b1ac26da1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:12.152302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a093cbf-99ab-41fd-a67f-d25b1ac26da1 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:12.152302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1000/2016] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:13.416613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf5adc-3edf-49e9-b43b-59ff14bb4f8f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:13.423827 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cfdf5adc-3edf-49e9-b43b-59ff14bb4f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:13.469692 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf5adc-3edf-49e9-b43b-59ff14bb4f8f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:13.484919 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaddd22-9069-4fa0-8e89-1514cb88f1ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:13.487229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaddd22-9069-4fa0-8e89-1514cb88f1ec service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:13.488139 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaddd22-9069-4fa0-8e89-1514cb88f1ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:13.501617 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaddd22-9069-4fa0-8e89-1514cb88f1ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:13.511108 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4eaddd22-9069-4fa0-8e89-1514cb88f1ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:13.631879 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaddd22-9069-4fa0-8e89-1514cb88f1ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:13.634957 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaddd22-9069-4fa0-8e89-1514cb88f1ec service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:13.652235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1017/2017] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:55:15.222192 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff395e-37a1-44b4-9490-0c84e07f7379 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:15.222822 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff395e-37a1-44b4-9490-0c84e07f7379 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:15.223270 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff395e-37a1-44b4-9490-0c84e07f7379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:15.260456 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0dff395e-37a1-44b4-9490-0c84e07f7379 None None] MFA Rules not processed for user `1551f28754a64d1d9010ed90b67c5dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:15.262131 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0dff395e-37a1-44b4-9490-0c84e07f7379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:15.359990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1001/2018] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:55:15.377902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaddd22-9069-4fa0-8e89-1514cb88f1ec service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:15.379456 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4eaddd22-9069-4fa0-8e89-1514cb88f1ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:15.554073 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaddd22-9069-4fa0-8e89-1514cb88f1ec service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:15.564026 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f80483-4f58-4f82-99ab-95499de335c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:15.565126 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f80483-4f58-4f82-99ab-95499de335c2 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:15.565713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f80483-4f58-4f82-99ab-95499de335c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:15.566212 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f80483-4f58-4f82-99ab-95499de335c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:15.579097 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f80483-4f58-4f82-99ab-95499de335c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:15.582224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f80483-4f58-4f82-99ab-95499de335c2 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:15.592109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1018/2019] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:15.879455 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff395e-37a1-44b4-9490-0c84e07f7379 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:15.905916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff395e-37a1-44b4-9490-0c84e07f7379 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:15.923085 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c8642-41db-4f18-b85a-38343948e43e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:15.923818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c8642-41db-4f18-b85a-38343948e43e service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:15.924095 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c8642-41db-4f18-b85a-38343948e43e service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:15.924404 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c8642-41db-4f18-b85a-38343948e43e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:15.991289 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:16.026681 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c8642-41db-4f18-b85a-38343948e43e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:16.028171 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c8642-41db-4f18-b85a-38343948e43e service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:16.041886 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1002/2020] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:16.192114 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f80483-4f58-4f82-99ab-95499de335c2 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:16.208949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f80483-4f58-4f82-99ab-95499de335c2 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:16.215962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdea39e-7a5f-4e13-a13f-7b34f6dcd0bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:16.215962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdea39e-7a5f-4e13-a13f-7b34f6dcd0bd service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:16.216367 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdea39e-7a5f-4e13-a13f-7b34f6dcd0bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:16.217639 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdea39e-7a5f-4e13-a13f-7b34f6dcd0bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:16.219111 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2cdea39e-7a5f-4e13-a13f-7b34f6dcd0bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:16.321695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:16.371273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdea39e-7a5f-4e13-a13f-7b34f6dcd0bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:16.373142 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdea39e-7a5f-4e13-a13f-7b34f6dcd0bd service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:16.405785 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1019/2021] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:18.817771 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18cb7e-c53c-4f77-9c3b-1b86f5d1d509 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:18.818443 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18cb7e-c53c-4f77-9c3b-1b86f5d1d509 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:18.818443 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18cb7e-c53c-4f77-9c3b-1b86f5d1d509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:18.850659 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2b18cb7e-c53c-4f77-9c3b-1b86f5d1d509 None None] MFA Rules not processed for user `1551f28754a64d1d9010ed90b67c5dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:18.853445 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2b18cb7e-c53c-4f77-9c3b-1b86f5d1d509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:18.867109 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1003/2022] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:20.222989 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdea39e-7a5f-4e13-a13f-7b34f6dcd0bd service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:20.240155 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdea39e-7a5f-4e13-a13f-7b34f6dcd0bd service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:20.248225 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3365da7-e04a-4e23-b0c3-1323f31978cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:20.248810 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3365da7-e04a-4e23-b0c3-1323f31978cb service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:20.249089 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3365da7-e04a-4e23-b0c3-1323f31978cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:20.249430 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3365da7-e04a-4e23-b0c3-1323f31978cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:20.265397 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3365da7-e04a-4e23-b0c3-1323f31978cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:20.268581 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3365da7-e04a-4e23-b0c3-1323f31978cb service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:20.293285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1020/2023] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:55:25.057648 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18cb7e-c53c-4f77-9c3b-1b86f5d1d509 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:25.059470 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2b18cb7e-c53c-4f77-9c3b-1b86f5d1d509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:25.191186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18cb7e-c53c-4f77-9c3b-1b86f5d1d509 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:25.206300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78f638-98e2-4aab-a95e-d9dce83b92bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:25.207265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78f638-98e2-4aab-a95e-d9dce83b92bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:25.207547 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78f638-98e2-4aab-a95e-d9dce83b92bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:25.207820 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78f638-98e2-4aab-a95e-d9dce83b92bf admin admin] PATH_INFO: `/v3/users/3820967699fd430a8e16c2c8f339888e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:25.216849 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78f638-98e2-4aab-a95e-d9dce83b92bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3820967699fd430a8e16c2c8f339888e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:25.222952 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78f638-98e2-4aab-a95e-d9dce83b92bf admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:25.466149 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6b78f638-98e2-4aab-a95e-d9dce83b92bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3820967699fd430a8e16c2c8f339888e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:25.536117 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6b78f638-98e2-4aab-a95e-d9dce83b92bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3820967699fd430a8e16c2c8f339888e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:25.536760 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6b78f638-98e2-4aab-a95e-d9dce83b92bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3820967699fd430a8e16c2c8f339888e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:25.537401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6b78f638-98e2-4aab-a95e-d9dce83b92bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3820967699fd430a8e16c2c8f339888e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:25.546934 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6b78f638-98e2-4aab-a95e-d9dce83b92bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3820967699fd430a8e16c2c8f339888e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:25.568089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1004/2024] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:55:25 2022] DELETE /identity/v3/users/3820967699fd430a8e16c2c8f339888e => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:25.573659 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae36026-e425-4ee0-bfb8-5207de1c2e75 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:25.574281 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae36026-e425-4ee0-bfb8-5207de1c2e75 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:25.574281 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae36026-e425-4ee0-bfb8-5207de1c2e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:25.592964 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8ae36026-e425-4ee0-bfb8-5207de1c2e75 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:25.594233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8ae36026-e425-4ee0-bfb8-5207de1c2e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:25.669677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1021/2025] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:25.680130 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78f638-98e2-4aab-a95e-d9dce83b92bf admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:25.682488 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6b78f638-98e2-4aab-a95e-d9dce83b92bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:25.776214 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:25.781691 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78f638-98e2-4aab-a95e-d9dce83b92bf admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:25.787564 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb15c9-f1bc-4227-98cf-bc6d9ba1d5c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:25.788745 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb15c9-f1bc-4227-98cf-bc6d9ba1d5c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:25.789240 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb15c9-f1bc-4227-98cf-bc6d9ba1d5c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:25.789707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb15c9-f1bc-4227-98cf-bc6d9ba1d5c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:25.801609 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb15c9-f1bc-4227-98cf-bc6d9ba1d5c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:25.803200 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb15c9-f1bc-4227-98cf-bc6d9ba1d5c0 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:25.816730 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1005/2026] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:25.907765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae36026-e425-4ee0-bfb8-5207de1c2e75 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:25.909317 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8ae36026-e425-4ee0-bfb8-5207de1c2e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:25.925030 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae36026-e425-4ee0-bfb8-5207de1c2e75 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:25.931924 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278abdd0-f2fa-420b-84c9-1813e2a999c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:25.932980 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278abdd0-f2fa-420b-84c9-1813e2a999c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:25.933314 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278abdd0-f2fa-420b-84c9-1813e2a999c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:25.933597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278abdd0-f2fa-420b-84c9-1813e2a999c3 admin admin] PATH_INFO: `/v3/users/3131756d356f46098f58fde8ce6fe012` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:25.935017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278abdd0-f2fa-420b-84c9-1813e2a999c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3131756d356f46098f58fde8ce6fe012)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:25.936992 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278abdd0-f2fa-420b-84c9-1813e2a999c3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:26.220057 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-278abdd0-f2fa-420b-84c9-1813e2a999c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3131756d356f46098f58fde8ce6fe012'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:26.225872 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-278abdd0-f2fa-420b-84c9-1813e2a999c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3131756d356f46098f58fde8ce6fe012'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:26.238196 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-278abdd0-f2fa-420b-84c9-1813e2a999c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3131756d356f46098f58fde8ce6fe012'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:26.315038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb15c9-f1bc-4227-98cf-bc6d9ba1d5c0 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:26.317634 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-278abdd0-f2fa-420b-84c9-1813e2a999c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3131756d356f46098f58fde8ce6fe012'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:26.318239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-278abdd0-f2fa-420b-84c9-1813e2a999c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3131756d356f46098f58fde8ce6fe012'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:26.320506 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d5fb15c9-f1bc-4227-98cf-bc6d9ba1d5c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:26.348694 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb15c9-f1bc-4227-98cf-bc6d9ba1d5c0 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:26.354945 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1022/2027] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:55:25 2022] DELETE /identity/v3/users/3131756d356f46098f58fde8ce6fe012 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:26.361396 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79be08-2f4f-4550-b5f4-bb0d4c50d122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:26.361656 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab683b-f04a-44b2-bac6-93e7f4321004 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:26.362079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab683b-f04a-44b2-bac6-93e7f4321004 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:26.362557 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab683b-f04a-44b2-bac6-93e7f4321004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:26.363752 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79be08-2f4f-4550-b5f4-bb0d4c50d122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:26.364503 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79be08-2f4f-4550-b5f4-bb0d4c50d122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:26.365055 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79be08-2f4f-4550-b5f4-bb0d4c50d122 admin admin] PATH_INFO: `/v3/users/fc85d3d6232a47f5b54c872284361eba` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:26.368176 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79be08-2f4f-4550-b5f4-bb0d4c50d122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc85d3d6232a47f5b54c872284361eba)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:26.372559 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79be08-2f4f-4550-b5f4-bb0d4c50d122 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:26.399091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-15ab683b-f04a-44b2-bac6-93e7f4321004 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:26.401882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-15ab683b-f04a-44b2-bac6-93e7f4321004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:26.447990 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:26.494535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1023/2028] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:26.501724 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab683b-f04a-44b2-bac6-93e7f4321004 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:26.503185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-15ab683b-f04a-44b2-bac6-93e7f4321004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:26.518714 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab683b-f04a-44b2-bac6-93e7f4321004 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:26.527402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cc569-666e-4755-a5da-4a0795329ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:26.528506 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cc569-666e-4755-a5da-4a0795329ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:26.528796 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cc569-666e-4755-a5da-4a0795329ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:26.529070 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cc569-666e-4755-a5da-4a0795329ced admin admin] PATH_INFO: `/v3/projects/0a36b0f6f3e3476282ab10ceedb68255` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:26.531167 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cc569-666e-4755-a5da-4a0795329ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a36b0f6f3e3476282ab10ceedb68255)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:26.533644 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cc569-666e-4755-a5da-4a0795329ced admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:26.628215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0e79be08-2f4f-4550-b5f4-bb0d4c50d122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc85d3d6232a47f5b54c872284361eba'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:26.688650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8d3cc569-666e-4755-a5da-4a0795329ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a36b0f6f3e3476282ab10ceedb68255', 'request_id': 'req-8d3cc569-666e-4755-a5da-4a0795329ced'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:26.747681 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0e79be08-2f4f-4550-b5f4-bb0d4c50d122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc85d3d6232a47f5b54c872284361eba'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:26.748676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0e79be08-2f4f-4550-b5f4-bb0d4c50d122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc85d3d6232a47f5b54c872284361eba'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:26.749536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0e79be08-2f4f-4550-b5f4-bb0d4c50d122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc85d3d6232a47f5b54c872284361eba'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:26.759700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0e79be08-2f4f-4550-b5f4-bb0d4c50d122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc85d3d6232a47f5b54c872284361eba'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:26.801154 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1006/2029] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:55:26 2022] DELETE /identity/v3/users/fc85d3d6232a47f5b54c872284361eba => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:55:26.802556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79be08-2f4f-4550-b5f4-bb0d4c50d122 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:26.804080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0e79be08-2f4f-4550-b5f4-bb0d4c50d122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:26.826781 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8d3cc569-666e-4755-a5da-4a0795329ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a36b0f6f3e3476282ab10ceedb68255', 'request_id': 'req-8d3cc569-666e-4755-a5da-4a0795329ced'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:26.835260 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8d3cc569-666e-4755-a5da-4a0795329ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a36b0f6f3e3476282ab10ceedb68255', 'request_id': 'req-8d3cc569-666e-4755-a5da-4a0795329ced'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:26.850134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8d3cc569-666e-4755-a5da-4a0795329ced admin admin] The token cache is being invalidate because project 0a36b0f6f3e3476282ab10ceedb68255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:55:26.850517 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8d3cc569-666e-4755-a5da-4a0795329ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:26.851939 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8d3cc569-666e-4755-a5da-4a0795329ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:26.853848 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1024/2030] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:55:26 2022] DELETE /identity/v3/projects/0a36b0f6f3e3476282ab10ceedb68255 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:55:26.855416 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fb9fe-8065-4e74-8454-43609acbaf2a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:26.855748 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fb9fe-8065-4e74-8454-43609acbaf2a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:26.855983 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fb9fe-8065-4e74-8454-43609acbaf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:26.880970 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79be08-2f4f-4550-b5f4-bb0d4c50d122 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:26.881311 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-237fb9fe-8065-4e74-8454-43609acbaf2a None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:26.883964 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-237fb9fe-8065-4e74-8454-43609acbaf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:26.887425 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b86bc-1d84-4220-823e-d73f9e745a35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:26.887886 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b86bc-1d84-4220-823e-d73f9e745a35 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:26.888238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b86bc-1d84-4220-823e-d73f9e745a35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:26.888517 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b86bc-1d84-4220-823e-d73f9e745a35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:26.891148 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-430b86bc-1d84-4220-823e-d73f9e745a35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:26.974423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1025/2031] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:26.975373 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237fb9fe-8065-4e74-8454-43609acbaf2a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:26.977243 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-237fb9fe-8065-4e74-8454-43609acbaf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:26.985505 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b86bc-1d84-4220-823e-d73f9e745a35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:26.986997 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b86bc-1d84-4220-823e-d73f9e745a35 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:26.990233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237fb9fe-8065-4e74-8454-43609acbaf2a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:26.999665 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df2625-bc0a-416e-81c2-e9265824c39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:27.000585 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df2625-bc0a-416e-81c2-e9265824c39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:27.000873 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df2625-bc0a-416e-81c2-e9265824c39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:27.001149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df2625-bc0a-416e-81c2-e9265824c39a admin admin] PATH_INFO: `/v3/users/c9a0c542d76b4dee9ce07e5adea2ee43` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:27.002376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1007/2032] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:27.002494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df2625-bc0a-416e-81c2-e9265824c39a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9a0c542d76b4dee9ce07e5adea2ee43)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:27.003094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b86bc-1d84-4220-823e-d73f9e745a35 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:27.004824 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df2625-bc0a-416e-81c2-e9265824c39a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:27.005040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-430b86bc-1d84-4220-823e-d73f9e745a35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:27.017178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b86bc-1d84-4220-823e-d73f9e745a35 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:27.022492 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda221ac-2800-48f2-b934-c905ad1c9820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:27.023934 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda221ac-2800-48f2-b934-c905ad1c9820 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:27.024475 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda221ac-2800-48f2-b934-c905ad1c9820 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:27.024761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda221ac-2800-48f2-b934-c905ad1c9820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:27.040292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda221ac-2800-48f2-b934-c905ad1c9820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:27.042134 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda221ac-2800-48f2-b934-c905ad1c9820 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:27.048312 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:27.056002 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1008/2033] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:27.260216 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-86df2625-bc0a-416e-81c2-e9265824c39a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9a0c542d76b4dee9ce07e5adea2ee43'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:27.261389 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-86df2625-bc0a-416e-81c2-e9265824c39a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9a0c542d76b4dee9ce07e5adea2ee43'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:27.271096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:27.274466 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-86df2625-bc0a-416e-81c2-e9265824c39a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9a0c542d76b4dee9ce07e5adea2ee43'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:27.406624 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-86df2625-bc0a-416e-81c2-e9265824c39a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9a0c542d76b4dee9ce07e5adea2ee43'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:27.407516 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-86df2625-bc0a-416e-81c2-e9265824c39a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9a0c542d76b4dee9ce07e5adea2ee43'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:27.453921 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1026/2034] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:55:26 2022] DELETE /identity/v3/users/c9a0c542d76b4dee9ce07e5adea2ee43 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:27.619449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda221ac-2800-48f2-b934-c905ad1c9820 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:27.621514 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fda221ac-2800-48f2-b934-c905ad1c9820 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:27.651144 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda221ac-2800-48f2-b934-c905ad1c9820 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:27.764028 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757dcd4-9aaa-441d-b425-999c2a112f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:27.764547 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df2625-bc0a-416e-81c2-e9265824c39a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:27.765341 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757dcd4-9aaa-441d-b425-999c2a112f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:27.765341 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757dcd4-9aaa-441d-b425-999c2a112f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:27.765708 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757dcd4-9aaa-441d-b425-999c2a112f6d admin admin] PATH_INFO: `/v3/projects/23698a85c008409bae3fee9429974325` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:27.766714 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757dcd4-9aaa-441d-b425-999c2a112f6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=23698a85c008409bae3fee9429974325)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:27.767631 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-86df2625-bc0a-416e-81c2-e9265824c39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:27.768822 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757dcd4-9aaa-441d-b425-999c2a112f6d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:27.806995 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df2625-bc0a-416e-81c2-e9265824c39a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:27.823212 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f505e16-be46-4009-8b28-ddbb9f7492cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:27.824049 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f505e16-be46-4009-8b28-ddbb9f7492cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:27.824338 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f505e16-be46-4009-8b28-ddbb9f7492cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:27.824614 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f505e16-be46-4009-8b28-ddbb9f7492cb admin admin] PATH_INFO: `/v3/projects/32e515d09bde410a9fc2fbc01bb16b78` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:27.827041 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f505e16-be46-4009-8b28-ddbb9f7492cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=32e515d09bde410a9fc2fbc01bb16b78)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:27.832566 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f505e16-be46-4009-8b28-ddbb9f7492cb admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:28.015037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b757dcd4-9aaa-441d-b425-999c2a112f6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23698a85c008409bae3fee9429974325', 'request_id': 'req-b757dcd4-9aaa-441d-b425-999c2a112f6d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:28.021021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1f505e16-be46-4009-8b28-ddbb9f7492cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32e515d09bde410a9fc2fbc01bb16b78', 'request_id': 'req-1f505e16-be46-4009-8b28-ddbb9f7492cb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:28.025607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b757dcd4-9aaa-441d-b425-999c2a112f6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23698a85c008409bae3fee9429974325', 'request_id': 'req-b757dcd4-9aaa-441d-b425-999c2a112f6d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:28.033274 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b757dcd4-9aaa-441d-b425-999c2a112f6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23698a85c008409bae3fee9429974325', 'request_id': 'req-b757dcd4-9aaa-441d-b425-999c2a112f6d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:28.125789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1f505e16-be46-4009-8b28-ddbb9f7492cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32e515d09bde410a9fc2fbc01bb16b78', 'request_id': 'req-1f505e16-be46-4009-8b28-ddbb9f7492cb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:28.138572 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1f505e16-be46-4009-8b28-ddbb9f7492cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32e515d09bde410a9fc2fbc01bb16b78', 'request_id': 'req-1f505e16-be46-4009-8b28-ddbb9f7492cb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:28.174565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1f505e16-be46-4009-8b28-ddbb9f7492cb admin admin] The token cache is being invalidate because project 32e515d09bde410a9fc2fbc01bb16b78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:55:28.174861 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1f505e16-be46-4009-8b28-ddbb9f7492cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:28.175714 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1f505e16-be46-4009-8b28-ddbb9f7492cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:28.177657 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1027/2035] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:55:27 2022] DELETE /identity/v3/projects/32e515d09bde410a9fc2fbc01bb16b78 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:28.182123 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f505e16-be46-4009-8b28-ddbb9f7492cb admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:28.183838 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1f505e16-be46-4009-8b28-ddbb9f7492cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:28.278390 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f505e16-be46-4009-8b28-ddbb9f7492cb admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:28.285013 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597e473-9594-4a60-b0bc-fafd9c6327ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:28.296164 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b757dcd4-9aaa-441d-b425-999c2a112f6d admin admin] The token cache is being invalidate because project 23698a85c008409bae3fee9429974325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:55:28.296164 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b757dcd4-9aaa-441d-b425-999c2a112f6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:28.296419 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597e473-9594-4a60-b0bc-fafd9c6327ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:28.296540 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b757dcd4-9aaa-441d-b425-999c2a112f6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:28.296639 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597e473-9594-4a60-b0bc-fafd9c6327ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:28.296639 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597e473-9594-4a60-b0bc-fafd9c6327ce admin admin] PATH_INFO: `/v3/users/05c38dbd8f104704be43e35379861bc0` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:28.296811 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1009/2036] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:55:27 2022] DELETE /identity/v3/projects/23698a85c008409bae3fee9429974325 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:28.296888 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597e473-9594-4a60-b0bc-fafd9c6327ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c38dbd8f104704be43e35379861bc0)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:28.296888 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597e473-9594-4a60-b0bc-fafd9c6327ce admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:28.297015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757dcd4-9aaa-441d-b425-999c2a112f6d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:28.297015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b757dcd4-9aaa-441d-b425-999c2a112f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:28.407598 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757dcd4-9aaa-441d-b425-999c2a112f6d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:28.413432 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282fcf9-e65a-49c9-8a8f-46341a30fd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:28.414406 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282fcf9-e65a-49c9-8a8f-46341a30fd49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:28.414681 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282fcf9-e65a-49c9-8a8f-46341a30fd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:28.414963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282fcf9-e65a-49c9-8a8f-46341a30fd49 admin admin] PATH_INFO: `/v3/users/a7de8ca7f9c54d1db52d2424f1ed3119` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:28.416588 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282fcf9-e65a-49c9-8a8f-46341a30fd49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7de8ca7f9c54d1db52d2424f1ed3119)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:28.419056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282fcf9-e65a-49c9-8a8f-46341a30fd49 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:28.507151 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c597e473-9594-4a60-b0bc-fafd9c6327ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c38dbd8f104704be43e35379861bc0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:28.509421 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c597e473-9594-4a60-b0bc-fafd9c6327ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c38dbd8f104704be43e35379861bc0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:28.518100 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c597e473-9594-4a60-b0bc-fafd9c6327ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c38dbd8f104704be43e35379861bc0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:28.519867 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=81,keystone:INSERT=2,keystone:DELETE=17 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:28.590799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:28.607206 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2282fcf9-e65a-49c9-8a8f-46341a30fd49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7de8ca7f9c54d1db52d2424f1ed3119'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:28.624644 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c597e473-9594-4a60-b0bc-fafd9c6327ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c38dbd8f104704be43e35379861bc0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:28.625484 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c597e473-9594-4a60-b0bc-fafd9c6327ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c38dbd8f104704be43e35379861bc0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:28.646787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1028/2037] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:55:28 2022] DELETE /identity/v3/users/05c38dbd8f104704be43e35379861bc0 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:55:28.651522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597e473-9594-4a60-b0bc-fafd9c6327ce admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:28.651522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c597e473-9594-4a60-b0bc-fafd9c6327ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:28.720359 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2282fcf9-e65a-49c9-8a8f-46341a30fd49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7de8ca7f9c54d1db52d2424f1ed3119'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:28.720359 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2282fcf9-e65a-49c9-8a8f-46341a30fd49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7de8ca7f9c54d1db52d2424f1ed3119'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:28.725215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2282fcf9-e65a-49c9-8a8f-46341a30fd49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7de8ca7f9c54d1db52d2424f1ed3119'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:28.739804 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2282fcf9-e65a-49c9-8a8f-46341a30fd49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7de8ca7f9c54d1db52d2424f1ed3119'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:28.752177 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597e473-9594-4a60-b0bc-fafd9c6327ce admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:28.760260 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0a8af-7d0f-4021-a538-c5b109ea4084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:28.761661 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0a8af-7d0f-4021-a538-c5b109ea4084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:28.761960 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0a8af-7d0f-4021-a538-c5b109ea4084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:28.762224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0a8af-7d0f-4021-a538-c5b109ea4084 admin admin] PATH_INFO: `/v3/projects/ad7161875dc846e090aabceee818d6ea` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:28.763747 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0a8af-7d0f-4021-a538-c5b109ea4084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad7161875dc846e090aabceee818d6ea)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:28.765824 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0a8af-7d0f-4021-a538-c5b109ea4084 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:28.786525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1010/2038] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:55:28 2022] DELETE /identity/v3/users/a7de8ca7f9c54d1db52d2424f1ed3119 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:28.950128 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cdc0a8af-7d0f-4021-a538-c5b109ea4084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad7161875dc846e090aabceee818d6ea', 'request_id': 'req-cdc0a8af-7d0f-4021-a538-c5b109ea4084'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:29.022654 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cdc0a8af-7d0f-4021-a538-c5b109ea4084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad7161875dc846e090aabceee818d6ea', 'request_id': 'req-cdc0a8af-7d0f-4021-a538-c5b109ea4084'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:29.034351 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cdc0a8af-7d0f-4021-a538-c5b109ea4084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad7161875dc846e090aabceee818d6ea', 'request_id': 'req-cdc0a8af-7d0f-4021-a538-c5b109ea4084'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:29.062042 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cdc0a8af-7d0f-4021-a538-c5b109ea4084 admin admin] The token cache is being invalidate because project ad7161875dc846e090aabceee818d6ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:55:29.062343 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cdc0a8af-7d0f-4021-a538-c5b109ea4084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:29.063855 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cdc0a8af-7d0f-4021-a538-c5b109ea4084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:29.069660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1029/2039] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:55:28 2022] DELETE /identity/v3/projects/ad7161875dc846e090aabceee818d6ea => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:29.072052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282fcf9-e65a-49c9-8a8f-46341a30fd49 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:29.074591 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2282fcf9-e65a-49c9-8a8f-46341a30fd49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:29.214611 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282fcf9-e65a-49c9-8a8f-46341a30fd49 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:29.313020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02b46c-af10-466c-baae-8d34695f807f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:29.314345 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02b46c-af10-466c-baae-8d34695f807f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:29.314626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02b46c-af10-466c-baae-8d34695f807f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:29.314900 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02b46c-af10-466c-baae-8d34695f807f admin admin] PATH_INFO: `/v3/users/17cee42ffa1443c58223c9ddadb59daf` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:29.316323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02b46c-af10-466c-baae-8d34695f807f admin admin] RBAC: Authorizing `identity:delete_user(user_id=17cee42ffa1443c58223c9ddadb59daf)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:29.318640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02b46c-af10-466c-baae-8d34695f807f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:29.388504 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0a8af-7d0f-4021-a538-c5b109ea4084 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:29.390194 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cdc0a8af-7d0f-4021-a538-c5b109ea4084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:29.409691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0a8af-7d0f-4021-a538-c5b109ea4084 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:29.416574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd107b6-677f-4ffc-b5a9-385e76393dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:29.417853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd107b6-677f-4ffc-b5a9-385e76393dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:29.417853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd107b6-677f-4ffc-b5a9-385e76393dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:29.418060 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd107b6-677f-4ffc-b5a9-385e76393dd0 admin admin] PATH_INFO: `/v3/projects/6cdca35127e041728aed13169c3ce2c8` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:29.419776 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd107b6-677f-4ffc-b5a9-385e76393dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cdca35127e041728aed13169c3ce2c8)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:29.424687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd107b6-677f-4ffc-b5a9-385e76393dd0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:29.597738 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8e02b46c-af10-466c-baae-8d34695f807f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17cee42ffa1443c58223c9ddadb59daf'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:29.607417 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-afd107b6-677f-4ffc-b5a9-385e76393dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cdca35127e041728aed13169c3ce2c8', 'request_id': 'req-afd107b6-677f-4ffc-b5a9-385e76393dd0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:29.661437 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8e02b46c-af10-466c-baae-8d34695f807f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17cee42ffa1443c58223c9ddadb59daf'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:29.664881 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8e02b46c-af10-466c-baae-8d34695f807f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17cee42ffa1443c58223c9ddadb59daf'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:29.664881 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8e02b46c-af10-466c-baae-8d34695f807f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17cee42ffa1443c58223c9ddadb59daf'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:29.670580 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:29.675053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8e02b46c-af10-466c-baae-8d34695f807f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17cee42ffa1443c58223c9ddadb59daf'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:29.694545 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1011/2040] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:55:29 2022] DELETE /identity/v3/users/17cee42ffa1443c58223c9ddadb59daf => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:55:29.696074 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02b46c-af10-466c-baae-8d34695f807f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:29.697800 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8e02b46c-af10-466c-baae-8d34695f807f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:29.788049 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-afd107b6-677f-4ffc-b5a9-385e76393dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cdca35127e041728aed13169c3ce2c8', 'request_id': 'req-afd107b6-677f-4ffc-b5a9-385e76393dd0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:29.793084 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:INSERT=3,keystone:DELETE=15,keystone:SELECT=82 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:29.805624 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-afd107b6-677f-4ffc-b5a9-385e76393dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cdca35127e041728aed13169c3ce2c8', 'request_id': 'req-afd107b6-677f-4ffc-b5a9-385e76393dd0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:29.829588 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-afd107b6-677f-4ffc-b5a9-385e76393dd0 admin admin] The token cache is being invalidate because project 6cdca35127e041728aed13169c3ce2c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:55:29.838300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-afd107b6-677f-4ffc-b5a9-385e76393dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:29.838300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-afd107b6-677f-4ffc-b5a9-385e76393dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:29.838300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1030/2041] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:55:29 2022] DELETE /identity/v3/projects/6cdca35127e041728aed13169c3ce2c8 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:29.840037 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd107b6-677f-4ffc-b5a9-385e76393dd0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:29.843241 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-afd107b6-677f-4ffc-b5a9-385e76393dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:29.853242 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02b46c-af10-466c-baae-8d34695f807f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:29.861612 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ad822-5cbd-4f79-b153-e6c03c52e869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:29.864922 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ad822-5cbd-4f79-b153-e6c03c52e869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:29.864922 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ad822-5cbd-4f79-b153-e6c03c52e869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:29.864922 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ad822-5cbd-4f79-b153-e6c03c52e869 admin admin] PATH_INFO: `/v3/projects/b0f527c32b4346f69be1761f710f139c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:29.866306 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ad822-5cbd-4f79-b153-e6c03c52e869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0f527c32b4346f69be1761f710f139c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:29.868733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ad822-5cbd-4f79-b153-e6c03c52e869 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:29.979221 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd107b6-677f-4ffc-b5a9-385e76393dd0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:29.984367 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdb793-cd3a-4ae6-a311-70ff116547c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:29.985362 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdb793-cd3a-4ae6-a311-70ff116547c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:29.985643 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdb793-cd3a-4ae6-a311-70ff116547c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:29.985915 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdb793-cd3a-4ae6-a311-70ff116547c6 admin admin] PATH_INFO: `/v3/users/0aa35c786eef4157a029e987c154d1ac` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:29.991146 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdb793-cd3a-4ae6-a311-70ff116547c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa35c786eef4157a029e987c154d1ac)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:29.991146 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdb793-cd3a-4ae6-a311-70ff116547c6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:30.079631 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e1ad822-5cbd-4f79-b153-e6c03c52e869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0f527c32b4346f69be1761f710f139c', 'request_id': 'req-7e1ad822-5cbd-4f79-b153-e6c03c52e869'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:30.097175 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e1ad822-5cbd-4f79-b153-e6c03c52e869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0f527c32b4346f69be1761f710f139c', 'request_id': 'req-7e1ad822-5cbd-4f79-b153-e6c03c52e869'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:30.113127 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e1ad822-5cbd-4f79-b153-e6c03c52e869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0f527c32b4346f69be1761f710f139c', 'request_id': 'req-7e1ad822-5cbd-4f79-b153-e6c03c52e869'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:30.253390 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e1ad822-5cbd-4f79-b153-e6c03c52e869 admin admin] The token cache is being invalidate because project b0f527c32b4346f69be1761f710f139c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:55:30.253830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e1ad822-5cbd-4f79-b153-e6c03c52e869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:30.254837 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e1ad822-5cbd-4f79-b153-e6c03c52e869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:30.257034 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1012/2042] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:55:29 2022] DELETE /identity/v3/projects/b0f527c32b4346f69be1761f710f139c => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:30.263994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94d1d9-fa5a-42b7-96e4-a311e121fea2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:30.264877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94d1d9-fa5a-42b7-96e4-a311e121fea2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:30.266613 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94d1d9-fa5a-42b7-96e4-a311e121fea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:30.283152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9fbdb793-cd3a-4ae6-a311-70ff116547c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa35c786eef4157a029e987c154d1ac'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:30.283883 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9fbdb793-cd3a-4ae6-a311-70ff116547c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa35c786eef4157a029e987c154d1ac'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:30.296714 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9fbdb793-cd3a-4ae6-a311-70ff116547c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa35c786eef4157a029e987c154d1ac'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:30.306108 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bc94d1d9-fa5a-42b7-96e4-a311e121fea2 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:30.308498 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bc94d1d9-fa5a-42b7-96e4-a311e121fea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:30.394998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9fbdb793-cd3a-4ae6-a311-70ff116547c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa35c786eef4157a029e987c154d1ac'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:30.397609 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9fbdb793-cd3a-4ae6-a311-70ff116547c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa35c786eef4157a029e987c154d1ac'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:30.447160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1013/2043] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:30.454067 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0e6f5-8f6d-444d-b04b-62571499ff6d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:30.454475 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0e6f5-8f6d-444d-b04b-62571499ff6d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:30.454754 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0e6f5-8f6d-444d-b04b-62571499ff6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:30.464263 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1031/2044] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:55:29 2022] DELETE /identity/v3/users/0aa35c786eef4157a029e987c154d1ac => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:55:30.501804 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:30.519540 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d6d0e6f5-8f6d-444d-b04b-62571499ff6d None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:30.521910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d6d0e6f5-8f6d-444d-b04b-62571499ff6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:30.605577 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdb793-cd3a-4ae6-a311-70ff116547c6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:30.611407 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9fbdb793-cd3a-4ae6-a311-70ff116547c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:30.654116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1014/2045] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:30.656058 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0e6f5-8f6d-444d-b04b-62571499ff6d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:30.678394 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0e6f5-8f6d-444d-b04b-62571499ff6d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:30.687340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0ae70-84b3-418b-999f-e1e938704492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:30.688666 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0ae70-84b3-418b-999f-e1e938704492 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:30.689105 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0ae70-84b3-418b-999f-e1e938704492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:30.689557 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0ae70-84b3-418b-999f-e1e938704492 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:30.690459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0ae70-84b3-418b-999f-e1e938704492 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:55:30.690930 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0ae70-84b3-418b-999f-e1e938704492 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:30.693169 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0ae70-84b3-418b-999f-e1e938704492 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:30.713565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1015/2046] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:55:30.718852 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0ae70-84b3-418b-999f-e1e938704492 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:30.737034 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0ae70-84b3-418b-999f-e1e938704492 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:30.744711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f987978-e4d0-4722-abbd-d3734126de45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:30.746008 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f987978-e4d0-4722-abbd-d3734126de45 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:30.746479 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f987978-e4d0-4722-abbd-d3734126de45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:30.746944 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f987978-e4d0-4722-abbd-d3734126de45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:30.748150 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f987978-e4d0-4722-abbd-d3734126de45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:30.751772 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f987978-e4d0-4722-abbd-d3734126de45 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:30.782237 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdb793-cd3a-4ae6-a311-70ff116547c6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:30.788404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c95a8-8b77-4ab2-a34d-5eea89e4667d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:30.790074 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c95a8-8b77-4ab2-a34d-5eea89e4667d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:30.790358 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c95a8-8b77-4ab2-a34d-5eea89e4667d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:30.790643 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c95a8-8b77-4ab2-a34d-5eea89e4667d admin admin] PATH_INFO: `/v3/projects/5d3724427c634179bb963a099710ea9c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:30.791995 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c95a8-8b77-4ab2-a34d-5eea89e4667d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d3724427c634179bb963a099710ea9c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:30.794127 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c95a8-8b77-4ab2-a34d-5eea89e4667d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:30.805336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:30.939427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1016/2047] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:55:30 2022] POST /identity/v3/projects => generated 385 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:30.941638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f987978-e4d0-4722-abbd-d3734126de45 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:30.988151 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3b1c95a8-8b77-4ab2-a34d-5eea89e4667d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d3724427c634179bb963a099710ea9c', 'request_id': 'req-3b1c95a8-8b77-4ab2-a34d-5eea89e4667d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:31.050038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f987978-e4d0-4722-abbd-d3734126de45 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:31.090482 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3b1c95a8-8b77-4ab2-a34d-5eea89e4667d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d3724427c634179bb963a099710ea9c', 'request_id': 'req-3b1c95a8-8b77-4ab2-a34d-5eea89e4667d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:31.099435 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3b1c95a8-8b77-4ab2-a34d-5eea89e4667d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d3724427c634179bb963a099710ea9c', 'request_id': 'req-3b1c95a8-8b77-4ab2-a34d-5eea89e4667d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:31.119218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3b1c95a8-8b77-4ab2-a34d-5eea89e4667d admin admin] The token cache is being invalidate because project 5d3724427c634179bb963a099710ea9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:55:31.120273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3b1c95a8-8b77-4ab2-a34d-5eea89e4667d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:31.127649 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3b1c95a8-8b77-4ab2-a34d-5eea89e4667d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:31.133778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1032/2048] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:55:30 2022] DELETE /identity/v3/projects/5d3724427c634179bb963a099710ea9c => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:31.136645 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d825f7-609a-4f2c-a809-e892862d6b21 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:31.141370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d825f7-609a-4f2c-a809-e892862d6b21 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:31.141370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d825f7-609a-4f2c-a809-e892862d6b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:31.141710 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb2b89-c51c-43fe-8ae1-33a0e3d363f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:31.144055 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb2b89-c51c-43fe-8ae1-33a0e3d363f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:31.145153 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb2b89-c51c-43fe-8ae1-33a0e3d363f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:31.145492 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb2b89-c51c-43fe-8ae1-33a0e3d363f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:31.146273 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb2b89-c51c-43fe-8ae1-33a0e3d363f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:31.152000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb2b89-c51c-43fe-8ae1-33a0e3d363f2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:31.162354 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a9d825f7-609a-4f2c-a809-e892862d6b21 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:31.163743 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a9d825f7-609a-4f2c-a809-e892862d6b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:31.176427 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1033/2049] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:31.176427 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d825f7-609a-4f2c-a809-e892862d6b21 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:31.176427 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a9d825f7-609a-4f2c-a809-e892862d6b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:31.187885 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d825f7-609a-4f2c-a809-e892862d6b21 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:31.192695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751424f-e093-466b-a532-026fb551c2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:31.193601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751424f-e093-466b-a532-026fb551c2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:31.193880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751424f-e093-466b-a532-026fb551c2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:31.194153 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751424f-e093-466b-a532-026fb551c2c5 admin admin] PATH_INFO: `/v3/projects/cbc7fcc26f8c4ca6abdf9cd1a3b612cc` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:31.196431 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751424f-e093-466b-a532-026fb551c2c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc7fcc26f8c4ca6abdf9cd1a3b612cc)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:31.199267 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751424f-e093-466b-a532-026fb551c2c5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:31.262019 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1017/2050] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:55:30 2022] POST /identity/v3/users => generated 293 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:55:31.267766 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d0bdb-8ce6-4894-b05c-0ebd2d260a19 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:31.267766 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d0bdb-8ce6-4894-b05c-0ebd2d260a19 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:31.267766 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d0bdb-8ce6-4894-b05c-0ebd2d260a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:31.288961 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bf9d0bdb-8ce6-4894-b05c-0ebd2d260a19 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:31.296209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bf9d0bdb-8ce6-4894-b05c-0ebd2d260a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:31.301079 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1018/2051] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:31.302015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d0bdb-8ce6-4894-b05c-0ebd2d260a19 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:31.303594 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bf9d0bdb-8ce6-4894-b05c-0ebd2d260a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:31.326323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d0bdb-8ce6-4894-b05c-0ebd2d260a19 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:31.333335 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f094d-0922-42ca-bb59-6693183d869b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:31.334189 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f094d-0922-42ca-bb59-6693183d869b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:31.334475 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f094d-0922-42ca-bb59-6693183d869b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:31.334752 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f094d-0922-42ca-bb59-6693183d869b admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:31.335578 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f094d-0922-42ca-bb59-6693183d869b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:31.337166 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f094d-0922-42ca-bb59-6693183d869b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:31.352893 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1019/2052] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:31.354203 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f094d-0922-42ca-bb59-6693183d869b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:31.372950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f094d-0922-42ca-bb59-6693183d869b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:31.387766 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3751424f-e093-466b-a532-026fb551c2c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc7fcc26f8c4ca6abdf9cd1a3b612cc', 'request_id': 'req-3751424f-e093-466b-a532-026fb551c2c5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:31.461184 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3751424f-e093-466b-a532-026fb551c2c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc7fcc26f8c4ca6abdf9cd1a3b612cc', 'request_id': 'req-3751424f-e093-466b-a532-026fb551c2c5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:31.472291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3751424f-e093-466b-a532-026fb551c2c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc7fcc26f8c4ca6abdf9cd1a3b612cc', 'request_id': 'req-3751424f-e093-466b-a532-026fb551c2c5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:31.489294 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42286663-8bbd-47f4-881f-d8ae07dd6c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:31.490007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42286663-8bbd-47f4-881f-d8ae07dd6c07 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:31.490290 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42286663-8bbd-47f4-881f-d8ae07dd6c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:31.490573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42286663-8bbd-47f4-881f-d8ae07dd6c07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:31.496373 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42286663-8bbd-47f4-881f-d8ae07dd6c07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:55:31.496373 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42286663-8bbd-47f4-881f-d8ae07dd6c07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:31.496607 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3751424f-e093-466b-a532-026fb551c2c5 admin admin] The token cache is being invalidate because project cbc7fcc26f8c4ca6abdf9cd1a3b612cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:55:31.496607 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3751424f-e093-466b-a532-026fb551c2c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:31.496607 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3751424f-e093-466b-a532-026fb551c2c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:31.496813 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42286663-8bbd-47f4-881f-d8ae07dd6c07 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:31.501814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1034/2053] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:55:31 2022] DELETE /identity/v3/projects/cbc7fcc26f8c4ca6abdf9cd1a3b612cc => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:31.504417 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751424f-e093-466b-a532-026fb551c2c5 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:31.507109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3751424f-e093-466b-a532-026fb551c2c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:31.521112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1020/2054] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:55:31.522555 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0271715-2a12-4c4b-a01c-a0aeed9823f3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:31.523098 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0271715-2a12-4c4b-a01c-a0aeed9823f3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:31.523592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0271715-2a12-4c4b-a01c-a0aeed9823f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:31.527370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751424f-e093-466b-a532-026fb551c2c5 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:31.539712 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3efcaa-8357-4a7e-bf29-aff7120942ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:31.540695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3efcaa-8357-4a7e-bf29-aff7120942ee admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:31.540986 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3efcaa-8357-4a7e-bf29-aff7120942ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:31.541447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3efcaa-8357-4a7e-bf29-aff7120942ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:31.547151 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3efcaa-8357-4a7e-bf29-aff7120942ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:31.547151 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3efcaa-8357-4a7e-bf29-aff7120942ee admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:31.557479 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c0271715-2a12-4c4b-a01c-a0aeed9823f3 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:31.559218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c0271715-2a12-4c4b-a01c-a0aeed9823f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:31.561162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1035/2055] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:31.562185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3efcaa-8357-4a7e-bf29-aff7120942ee admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:31.564261 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ca3efcaa-8357-4a7e-bf29-aff7120942ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:31.579934 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1021/2056] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:31.579934 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0271715-2a12-4c4b-a01c-a0aeed9823f3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:31.581248 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3efcaa-8357-4a7e-bf29-aff7120942ee admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:31.586699 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1027b6-15cc-4368-9bcc-97ee436040f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:31.587692 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1027b6-15cc-4368-9bcc-97ee436040f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:31.593002 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1027b6-15cc-4368-9bcc-97ee436040f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:31.593002 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1027b6-15cc-4368-9bcc-97ee436040f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:31.593002 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1027b6-15cc-4368-9bcc-97ee436040f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:31.593002 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1027b6-15cc-4368-9bcc-97ee436040f2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:31.595803 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0271715-2a12-4c4b-a01c-a0aeed9823f3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:31.603541 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbac6e-e1ca-4c19-bd96-e9c1b9671aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:31.604638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbac6e-e1ca-4c19-bd96-e9c1b9671aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:31.605431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbac6e-e1ca-4c19-bd96-e9c1b9671aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:31.605798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbac6e-e1ca-4c19-bd96-e9c1b9671aa0 admin admin] PATH_INFO: `/v3/projects/9e223395b3df4e18abfbc26ceaa5cccf/users/db2e6631b83d47828574f81a77383554/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:31.639860 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bbac6e-e1ca-4c19-bd96-e9c1b9671aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e223395b3df4e18abfbc26ceaa5cccf, user_id=db2e6631b83d47828574f81a77383554, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:31.642775 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bbac6e-e1ca-4c19-bd96-e9c1b9671aa0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:31.711907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1036/2057] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:55:31 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:31.714583 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdc8d3-a596-4f5b-8a3f-0b13a7097030 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:31.714583 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdc8d3-a596-4f5b-8a3f-0b13a7097030 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:31.714583 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdc8d3-a596-4f5b-8a3f-0b13a7097030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:31.735138 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-20fdc8d3-a596-4f5b-8a3f-0b13a7097030 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:31.739623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-20fdc8d3-a596-4f5b-8a3f-0b13a7097030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:31.770761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1022/2058] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:31 2022] PUT /identity/v3/projects/9e223395b3df4e18abfbc26ceaa5cccf/users/db2e6631b83d47828574f81a77383554/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:31.781886 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbac6e-e1ca-4c19-bd96-e9c1b9671aa0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:31.837007 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1037/2059] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:31.844630 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fe8d7-874c-4a59-8f5e-cfcfe7db8f58 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:31.844972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fe8d7-874c-4a59-8f5e-cfcfe7db8f58 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:31.845193 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fe8d7-874c-4a59-8f5e-cfcfe7db8f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:31.891696 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbac6e-e1ca-4c19-bd96-e9c1b9671aa0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:31.898434 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8f1fe8d7-874c-4a59-8f5e-cfcfe7db8f58 None None] MFA Rules not processed for user `db2e6631b83d47828574f81a77383554`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:31.900670 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8f1fe8d7-874c-4a59-8f5e-cfcfe7db8f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:31.902186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee3788-ed84-49a7-9ac0-c24696dfc472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:31.903548 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee3788-ed84-49a7-9ac0-c24696dfc472 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:31.904196 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee3788-ed84-49a7-9ac0-c24696dfc472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:31.904953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee3788-ed84-49a7-9ac0-c24696dfc472 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:31.906434 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee3788-ed84-49a7-9ac0-c24696dfc472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:31.910407 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee3788-ed84-49a7-9ac0-c24696dfc472 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:32.031382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1038/2060] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:32.031382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fe8d7-874c-4a59-8f5e-cfcfe7db8f58 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:32.043805 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1023/2061] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:55:31 2022] POST /identity/v3/users => generated 287 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:32.044786 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fe8d7-874c-4a59-8f5e-cfcfe7db8f58 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:32.045187 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee3788-ed84-49a7-9ac0-c24696dfc472 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:32.049950 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d894bc-fb0e-4057-b34a-4bc19b3419bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:32.050637 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d894bc-fb0e-4057-b34a-4bc19b3419bc admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:32.050917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d894bc-fb0e-4057-b34a-4bc19b3419bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:32.051195 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d894bc-fb0e-4057-b34a-4bc19b3419bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:32.051953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d894bc-fb0e-4057-b34a-4bc19b3419bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:55:32.052238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d894bc-fb0e-4057-b34a-4bc19b3419bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:32.054045 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d894bc-fb0e-4057-b34a-4bc19b3419bc admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:32.063193 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee3788-ed84-49a7-9ac0-c24696dfc472 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:32.068999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1039/2062] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:55:32.069696 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6753cb-7e50-4f56-a620-e74d1006de34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:32.070078 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d894bc-fb0e-4057-b34a-4bc19b3419bc admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:32.070538 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6753cb-7e50-4f56-a620-e74d1006de34 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:32.076185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6753cb-7e50-4f56-a620-e74d1006de34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:32.076185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6753cb-7e50-4f56-a620-e74d1006de34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:32.076185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6753cb-7e50-4f56-a620-e74d1006de34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:32.076648 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6753cb-7e50-4f56-a620-e74d1006de34 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:32.090192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d894bc-fb0e-4057-b34a-4bc19b3419bc admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:32.103105 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91b0e8-a6c0-41dc-a31a-17c0cfb55b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:32.103800 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91b0e8-a6c0-41dc-a31a-17c0cfb55b90 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:32.104167 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91b0e8-a6c0-41dc-a31a-17c0cfb55b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:32.104459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91b0e8-a6c0-41dc-a31a-17c0cfb55b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:32.105425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91b0e8-a6c0-41dc-a31a-17c0cfb55b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:32.107146 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91b0e8-a6c0-41dc-a31a-17c0cfb55b90 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:32.120742 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1040/2063] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:32.121869 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91b0e8-a6c0-41dc-a31a-17c0cfb55b90 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:32.141367 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91b0e8-a6c0-41dc-a31a-17c0cfb55b90 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:32.146606 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b43d8-bfd0-45c1-9b5e-aa68f95345e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:32.151154 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b43d8-bfd0-45c1-9b5e-aa68f95345e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:32.151154 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b43d8-bfd0-45c1-9b5e-aa68f95345e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:32.151154 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b43d8-bfd0-45c1-9b5e-aa68f95345e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:32.153797 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b43d8-bfd0-45c1-9b5e-aa68f95345e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:32.156864 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b43d8-bfd0-45c1-9b5e-aa68f95345e0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:32.185056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1024/2064] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:55:32 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:32.186153 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6753cb-7e50-4f56-a620-e74d1006de34 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:32.276168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6753cb-7e50-4f56-a620-e74d1006de34 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:32.283343 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83535108-619a-4be3-9d18-611572a77295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:32.284106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83535108-619a-4be3-9d18-611572a77295 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:32.284340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83535108-619a-4be3-9d18-611572a77295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:32.284618 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83535108-619a-4be3-9d18-611572a77295 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:32.285375 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83535108-619a-4be3-9d18-611572a77295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:32.286985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83535108-619a-4be3-9d18-611572a77295 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:32.305619 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1025/2066] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:32.305819 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1041/2066] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:55:32 2022] POST /identity/v3/projects => generated 369 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:32.305909 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83535108-619a-4be3-9d18-611572a77295 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:32.305983 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b43d8-bfd0-45c1-9b5e-aa68f95345e0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:32.315006 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83535108-619a-4be3-9d18-611572a77295 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:32.408624 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b43d8-bfd0-45c1-9b5e-aa68f95345e0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:32.409756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48001a-0f4e-4105-94a9-b4da7f069ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:32.410443 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48001a-0f4e-4105-94a9-b4da7f069ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:32.410728 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48001a-0f4e-4105-94a9-b4da7f069ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:32.411005 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48001a-0f4e-4105-94a9-b4da7f069ee5 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:32.411704 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48001a-0f4e-4105-94a9-b4da7f069ee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:32.413740 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48001a-0f4e-4105-94a9-b4da7f069ee5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:32.414643 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad2973-374c-4697-a633-1655fca19766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:32.415773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad2973-374c-4697-a633-1655fca19766 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:32.416138 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad2973-374c-4697-a633-1655fca19766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:32.416423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad2973-374c-4697-a633-1655fca19766 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:32.417282 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad2973-374c-4697-a633-1655fca19766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:32.419311 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad2973-374c-4697-a633-1655fca19766 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:32.517386 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1042/2067] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:55:32 2022] POST /identity/v3/users => generated 285 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:55:32.518255 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad2973-374c-4697-a633-1655fca19766 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:32.530409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1026/2068] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:55:32 2022] POST /identity/v3/users => generated 299 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:32.530409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48001a-0f4e-4105-94a9-b4da7f069ee5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:32.531015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad2973-374c-4697-a633-1655fca19766 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:32.536232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bc53e-dac6-4b07-8ab1-7612398e9f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:32.537139 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bc53e-dac6-4b07-8ab1-7612398e9f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:32.537450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bc53e-dac6-4b07-8ab1-7612398e9f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:32.537752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bc53e-dac6-4b07-8ab1-7612398e9f6f admin admin] PATH_INFO: `/v3/projects/dc9eb3074bcf4c8eb5ddec86dd21f676/users/14b1aff9e40a44dbabe2766d3e51f914/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:32.542242 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48001a-0f4e-4105-94a9-b4da7f069ee5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:32.548298 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898c077-4470-4756-8089-d7acbbbabed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:32.548984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898c077-4470-4756-8089-d7acbbbabed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:32.558653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898c077-4470-4756-8089-d7acbbbabed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:32.558653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898c077-4470-4756-8089-d7acbbbabed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:32.558653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898c077-4470-4756-8089-d7acbbbabed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:32.558653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898c077-4470-4756-8089-d7acbbbabed6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:32.559311 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bc53e-dac6-4b07-8ab1-7612398e9f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc9eb3074bcf4c8eb5ddec86dd21f676, user_id=14b1aff9e40a44dbabe2766d3e51f914, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:32.562223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bc53e-dac6-4b07-8ab1-7612398e9f6f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:32.567929 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1027/2069] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:32.567929 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898c077-4470-4756-8089-d7acbbbabed6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:32.579967 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898c077-4470-4756-8089-d7acbbbabed6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:32.587480 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf7eb1-87cb-4004-a8b0-0f2065a811c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:32.588294 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf7eb1-87cb-4004-a8b0-0f2065a811c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:32.588610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf7eb1-87cb-4004-a8b0-0f2065a811c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:32.588899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf7eb1-87cb-4004-a8b0-0f2065a811c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:32.589668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf7eb1-87cb-4004-a8b0-0f2065a811c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:32.591389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf7eb1-87cb-4004-a8b0-0f2065a811c7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:32.609910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1028/2070] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:32.609910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf7eb1-87cb-4004-a8b0-0f2065a811c7 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:32.623044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf7eb1-87cb-4004-a8b0-0f2065a811c7 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:32.629868 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb595a5-5c2f-45aa-b56b-fcf313ca1f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:32.630954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb595a5-5c2f-45aa-b56b-fcf313ca1f7a admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:32.631652 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb595a5-5c2f-45aa-b56b-fcf313ca1f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:32.632025 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb595a5-5c2f-45aa-b56b-fcf313ca1f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:32.632937 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb595a5-5c2f-45aa-b56b-fcf313ca1f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:32.634845 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb595a5-5c2f-45aa-b56b-fcf313ca1f7a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:32.641453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1043/2071] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:32 2022] PUT /identity/v3/projects/dc9eb3074bcf4c8eb5ddec86dd21f676/users/14b1aff9e40a44dbabe2766d3e51f914/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:32.642615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bc53e-dac6-4b07-8ab1-7612398e9f6f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:32.658003 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1029/2072] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:32.659620 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a64401-3ee0-47cb-aeb9-dc9bcf3df801 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:32.659970 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a64401-3ee0-47cb-aeb9-dc9bcf3df801 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:32.660316 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a64401-3ee0-47cb-aeb9-dc9bcf3df801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:32.686016 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f1a64401-3ee0-47cb-aeb9-dc9bcf3df801 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:32.687337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f1a64401-3ee0-47cb-aeb9-dc9bcf3df801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:32.749976 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bc53e-dac6-4b07-8ab1-7612398e9f6f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:32.758271 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5839e5-80b0-4266-9f9a-7463661e2cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:32.759598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5839e5-80b0-4266-9f9a-7463661e2cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:32.760036 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5839e5-80b0-4266-9f9a-7463661e2cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:32.760459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5839e5-80b0-4266-9f9a-7463661e2cf2 admin admin] PATH_INFO: `/v3/projects/7f36d038ead54ea19c5950c99039fbe9/users/b88a9574b2a34c7286b8316e624769f2/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:32.772194 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1030/2073] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:32.773766 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a64401-3ee0-47cb-aeb9-dc9bcf3df801 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:32.785058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5839e5-80b0-4266-9f9a-7463661e2cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f36d038ead54ea19c5950c99039fbe9, user_id=b88a9574b2a34c7286b8316e624769f2, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:32.788554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5839e5-80b0-4266-9f9a-7463661e2cf2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:32.791904 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a64401-3ee0-47cb-aeb9-dc9bcf3df801 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:32.794600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:32.799898 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dc50c-f6e9-4885-9cc2-405443a58305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:32.800905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dc50c-f6e9-4885-9cc2-405443a58305 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:32.801187 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dc50c-f6e9-4885-9cc2-405443a58305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:32.801538 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dc50c-f6e9-4885-9cc2-405443a58305 admin admin] PATH_INFO: `/v3/projects/67723c5356f048a19027682b12081a19/users/75e7a352b8ea4868a12fa64a24d7a51c/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:32.822213 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781dc50c-f6e9-4885-9cc2-405443a58305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67723c5356f048a19027682b12081a19, user_id=75e7a352b8ea4868a12fa64a24d7a51c, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:32.824918 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781dc50c-f6e9-4885-9cc2-405443a58305 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:32.891846 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1044/2074] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:32 2022] PUT /identity/v3/projects/7f36d038ead54ea19c5950c99039fbe9/users/b88a9574b2a34c7286b8316e624769f2/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:32.892793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5839e5-80b0-4266-9f9a-7463661e2cf2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:32.894676 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ee5839e5-80b0-4266-9f9a-7463661e2cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:32.902413 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1031/2075] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:32 2022] PUT /identity/v3/projects/67723c5356f048a19027682b12081a19/users/75e7a352b8ea4868a12fa64a24d7a51c/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:32.903319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dc50c-f6e9-4885-9cc2-405443a58305 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:32.979138 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:32.981638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dc50c-f6e9-4885-9cc2-405443a58305 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:32.989677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32aeff-acf8-45d0-9e73-8d50d835625f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:32.990367 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32aeff-acf8-45d0-9e73-8d50d835625f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:32.990656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32aeff-acf8-45d0-9e73-8d50d835625f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:32.991019 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32aeff-acf8-45d0-9e73-8d50d835625f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:32.991842 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32aeff-acf8-45d0-9e73-8d50d835625f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:32.994149 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32aeff-acf8-45d0-9e73-8d50d835625f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:33.002816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5839e5-80b0-4266-9f9a-7463661e2cf2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:33.013361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1032/2076] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:33.015307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eaf08-8b0d-4667-af69-362d4713b734 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:33.015777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eaf08-8b0d-4667-af69-362d4713b734 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:33.016087 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eaf08-8b0d-4667-af69-362d4713b734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:33.052845 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3f2eaf08-8b0d-4667-af69-362d4713b734 None None] MFA Rules not processed for user `75e7a352b8ea4868a12fa64a24d7a51c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:33.054078 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3f2eaf08-8b0d-4667-af69-362d4713b734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:33.075921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:33.083864 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f29563-47df-4a81-bd42-209ccf22ca4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:33.083864 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f29563-47df-4a81-bd42-209ccf22ca4e service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:33.083864 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f29563-47df-4a81-bd42-209ccf22ca4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:33.083864 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f29563-47df-4a81-bd42-209ccf22ca4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:33.100162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f29563-47df-4a81-bd42-209ccf22ca4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:33.103202 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f29563-47df-4a81-bd42-209ccf22ca4e service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:33.119431 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1045/2077] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:33.120675 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f29563-47df-4a81-bd42-209ccf22ca4e service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:33.140115 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f29563-47df-4a81-bd42-209ccf22ca4e service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:33.156421 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87a625-048e-4609-b38c-bf6e0a8af80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:33.158213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87a625-048e-4609-b38c-bf6e0a8af80a admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:33.158834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87a625-048e-4609-b38c-bf6e0a8af80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:33.159429 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87a625-048e-4609-b38c-bf6e0a8af80a admin admin] PATH_INFO: `/v3/projects/7f36d038ead54ea19c5950c99039fbe9/users/b88a9574b2a34c7286b8316e624769f2/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:33.166936 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87a625-048e-4609-b38c-bf6e0a8af80a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f36d038ead54ea19c5950c99039fbe9, user_id=b88a9574b2a34c7286b8316e624769f2, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:33.169841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87a625-048e-4609-b38c-bf6e0a8af80a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:33.185156 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1046/2078] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:33 2022] PUT /identity/v3/projects/7f36d038ead54ea19c5950c99039fbe9/users/b88a9574b2a34c7286b8316e624769f2/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:33.196446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee095643-076b-4c9d-81e5-57f1994be22e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:33.196765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee095643-076b-4c9d-81e5-57f1994be22e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:33.197093 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee095643-076b-4c9d-81e5-57f1994be22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:33.202072 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1033/2079] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:33.218254 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2eaf08-8b0d-4667-af69-362d4713b734 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:33.220146 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3f2eaf08-8b0d-4667-af69-362d4713b734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:33.239200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ee095643-076b-4c9d-81e5-57f1994be22e None None] MFA Rules not processed for user `b88a9574b2a34c7286b8316e624769f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:33.241541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ee095643-076b-4c9d-81e5-57f1994be22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:33.295554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:33.368828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1047/2080] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:55:33.374051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2eaf08-8b0d-4667-af69-362d4713b734 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:33.383599 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee095643-076b-4c9d-81e5-57f1994be22e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:33.385660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ee095643-076b-4c9d-81e5-57f1994be22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:33.389784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:33.440404 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc54a11-ef6a-4d61-b0ce-8ff9b4b47167 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7701907eb3b24c3681352c91ad6a3aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:33.441062 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc54a11-ef6a-4d61-b0ce-8ff9b4b47167 service glance] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:33.441373 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc54a11-ef6a-4d61-b0ce-8ff9b4b47167 service glance] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:33.441654 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc54a11-ef6a-4d61-b0ce-8ff9b4b47167 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:33.459650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee095643-076b-4c9d-81e5-57f1994be22e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:33.477834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c2c89-e66e-4f5c-905a-2ad1a362a846 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:33.477834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c2c89-e66e-4f5c-905a-2ad1a362a846 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:33.477834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c2c89-e66e-4f5c-905a-2ad1a362a846 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:33.477834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c2c89-e66e-4f5c-905a-2ad1a362a846 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:33.480567 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c2c89-e66e-4f5c-905a-2ad1a362a846 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:33.484665 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c2c89-e66e-4f5c-905a-2ad1a362a846 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:33.496121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1048/2081] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:33.516053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc54a11-ef6a-4d61-b0ce-8ff9b4b47167 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:33.517779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc54a11-ef6a-4d61-b0ce-8ff9b4b47167 service glance] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:33.530969 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c2c89-e66e-4f5c-905a-2ad1a362a846 service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:33.531406 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1034/2082] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:33.617981 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c2c89-e66e-4f5c-905a-2ad1a362a846 service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:33.636483 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f469cde-70a7-4560-8e98-b277d33fba8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:33.638145 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f469cde-70a7-4560-8e98-b277d33fba8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:33.638631 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f469cde-70a7-4560-8e98-b277d33fba8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:33.639159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f469cde-70a7-4560-8e98-b277d33fba8a admin admin] PATH_INFO: `/v3/users/db2e6631b83d47828574f81a77383554` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:33.643716 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f469cde-70a7-4560-8e98-b277d33fba8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=db2e6631b83d47828574f81a77383554)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:33.648979 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f469cde-70a7-4560-8e98-b277d33fba8a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:33.724431 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:33.841044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:33.972176 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6f469cde-70a7-4560-8e98-b277d33fba8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db2e6631b83d47828574f81a77383554'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:33.973431 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6f469cde-70a7-4560-8e98-b277d33fba8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db2e6631b83d47828574f81a77383554'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:33.987206 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6f469cde-70a7-4560-8e98-b277d33fba8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db2e6631b83d47828574f81a77383554'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:34.089556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6f469cde-70a7-4560-8e98-b277d33fba8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db2e6631b83d47828574f81a77383554'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:34.091552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6f469cde-70a7-4560-8e98-b277d33fba8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db2e6631b83d47828574f81a77383554'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:34.110748 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1049/2083] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:55:33 2022] DELETE /identity/v3/users/db2e6631b83d47828574f81a77383554 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:34.115720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958a8cd-4e08-4b26-9e36-dd980430df3a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:34.116237 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958a8cd-4e08-4b26-9e36-dd980430df3a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:34.116328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958a8cd-4e08-4b26-9e36-dd980430df3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:34.142898 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9958a8cd-4e08-4b26-9e36-dd980430df3a None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:34.142898 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9958a8cd-4e08-4b26-9e36-dd980430df3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:34.214016 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1035/2084] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:34.224243 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f469cde-70a7-4560-8e98-b277d33fba8a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:34.228441 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6f469cde-70a7-4560-8e98-b277d33fba8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:34.302644 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f469cde-70a7-4560-8e98-b277d33fba8a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:34.310098 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d293ee-62ca-4849-8bb9-6caa0405c84d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:34.310744 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d293ee-62ca-4849-8bb9-6caa0405c84d service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:34.311026 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d293ee-62ca-4849-8bb9-6caa0405c84d service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:34.311371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d293ee-62ca-4849-8bb9-6caa0405c84d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:34.328822 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d293ee-62ca-4849-8bb9-6caa0405c84d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:34.331138 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d293ee-62ca-4849-8bb9-6caa0405c84d service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:34.349849 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1050/2085] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:34.496927 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:35.042305 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958a8cd-4e08-4b26-9e36-dd980430df3a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:35.044638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9958a8cd-4e08-4b26-9e36-dd980430df3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:35.060713 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958a8cd-4e08-4b26-9e36-dd980430df3a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:35.070613 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c439dd2-9772-480e-bca5-7cd5b85a4b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:35.074422 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c439dd2-9772-480e-bca5-7cd5b85a4b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:35.078264 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c439dd2-9772-480e-bca5-7cd5b85a4b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:35.078264 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c439dd2-9772-480e-bca5-7cd5b85a4b14 admin admin] PATH_INFO: `/v3/projects/9e223395b3df4e18abfbc26ceaa5cccf` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:35.081348 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c439dd2-9772-480e-bca5-7cd5b85a4b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e223395b3df4e18abfbc26ceaa5cccf)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:35.084112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c439dd2-9772-480e-bca5-7cd5b85a4b14 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:35.109605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8a158-7229-4f86-a481-fd7f99fcdbbb None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:35.111027 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8a158-7229-4f86-a481-fd7f99fcdbbb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:35.111722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8a158-7229-4f86-a481-fd7f99fcdbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:35.158568 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6bb8a158-7229-4f86-a481-fd7f99fcdbbb None None] MFA Rules not processed for user `14b1aff9e40a44dbabe2766d3e51f914`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:35.160206 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6bb8a158-7229-4f86-a481-fd7f99fcdbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:35.271070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2c439dd2-9772-480e-bca5-7cd5b85a4b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e223395b3df4e18abfbc26ceaa5cccf', 'request_id': 'req-2c439dd2-9772-480e-bca5-7cd5b85a4b14'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:35.283127 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2c439dd2-9772-480e-bca5-7cd5b85a4b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e223395b3df4e18abfbc26ceaa5cccf', 'request_id': 'req-2c439dd2-9772-480e-bca5-7cd5b85a4b14'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:35.286490 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1051/2086] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:35.298450 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8a158-7229-4f86-a481-fd7f99fcdbbb None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:35.298693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2c439dd2-9772-480e-bca5-7cd5b85a4b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e223395b3df4e18abfbc26ceaa5cccf', 'request_id': 'req-2c439dd2-9772-480e-bca5-7cd5b85a4b14'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:35.300069 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6bb8a158-7229-4f86-a481-fd7f99fcdbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:35.302040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:35.377659 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8a158-7229-4f86-a481-fd7f99fcdbbb None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:35.386198 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2c439dd2-9772-480e-bca5-7cd5b85a4b14 admin admin] The token cache is being invalidate because project 9e223395b3df4e18abfbc26ceaa5cccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:55:35.386491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2c439dd2-9772-480e-bca5-7cd5b85a4b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:35.387178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2c439dd2-9772-480e-bca5-7cd5b85a4b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:35.389163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1036/2087] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:55:35 2022] DELETE /identity/v3/projects/9e223395b3df4e18abfbc26ceaa5cccf => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:35.393151 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c439dd2-9772-480e-bca5-7cd5b85a4b14 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:35.394645 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2c439dd2-9772-480e-bca5-7cd5b85a4b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:35.420147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:35.445875 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e474e-8210-454a-ba55-55569429e71f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:35.446559 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e474e-8210-454a-ba55-55569429e71f service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:35.446842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e474e-8210-454a-ba55-55569429e71f service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:35.447119 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e474e-8210-454a-ba55-55569429e71f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:35.449072 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8a7e474e-8210-454a-ba55-55569429e71f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:35.502204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c439dd2-9772-480e-bca5-7cd5b85a4b14 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:35.511241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee163851-8a77-4106-953b-9a69e67a1de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:35.513339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee163851-8a77-4106-953b-9a69e67a1de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:35.513832 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee163851-8a77-4106-953b-9a69e67a1de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:35.514227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee163851-8a77-4106-953b-9a69e67a1de8 admin admin] PATH_INFO: `/v3/users/b88a9574b2a34c7286b8316e624769f2` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:35.516289 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee163851-8a77-4106-953b-9a69e67a1de8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b88a9574b2a34c7286b8316e624769f2)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:35.517846 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e474e-8210-454a-ba55-55569429e71f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:35.519401 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e474e-8210-454a-ba55-55569429e71f service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:35.520053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee163851-8a77-4106-953b-9a69e67a1de8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:35.531447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1052/2088] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:55:35.907173 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ee163851-8a77-4106-953b-9a69e67a1de8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b88a9574b2a34c7286b8316e624769f2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:36.010252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ee163851-8a77-4106-953b-9a69e67a1de8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b88a9574b2a34c7286b8316e624769f2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:36.011055 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ee163851-8a77-4106-953b-9a69e67a1de8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b88a9574b2a34c7286b8316e624769f2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:36.011862 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ee163851-8a77-4106-953b-9a69e67a1de8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b88a9574b2a34c7286b8316e624769f2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:36.033480 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ee163851-8a77-4106-953b-9a69e67a1de8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b88a9574b2a34c7286b8316e624769f2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:36.058360 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1037/2089] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:55:35 2022] DELETE /identity/v3/users/b88a9574b2a34c7286b8316e624769f2 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:36.711326 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e474e-8210-454a-ba55-55569429e71f service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:36.736190 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e474e-8210-454a-ba55-55569429e71f service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:36.879595 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da9db0-36bc-4151-886c-fb67a40a5e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:36.886722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da9db0-36bc-4151-886c-fb67a40a5e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:36.886722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da9db0-36bc-4151-886c-fb67a40a5e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:36.886722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da9db0-36bc-4151-886c-fb67a40a5e99 admin admin] PATH_INFO: `/v3/projects/7f36d038ead54ea19c5950c99039fbe9` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:36.886722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da9db0-36bc-4151-886c-fb67a40a5e99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f36d038ead54ea19c5950c99039fbe9)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:36.886722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da9db0-36bc-4151-886c-fb67a40a5e99 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:37.073451 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e5da9db0-36bc-4151-886c-fb67a40a5e99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f36d038ead54ea19c5950c99039fbe9', 'request_id': 'req-e5da9db0-36bc-4151-886c-fb67a40a5e99'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:37.158745 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e5da9db0-36bc-4151-886c-fb67a40a5e99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f36d038ead54ea19c5950c99039fbe9', 'request_id': 'req-e5da9db0-36bc-4151-886c-fb67a40a5e99'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:37.175885 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e5da9db0-36bc-4151-886c-fb67a40a5e99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f36d038ead54ea19c5950c99039fbe9', 'request_id': 'req-e5da9db0-36bc-4151-886c-fb67a40a5e99'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:37.186315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:37.197164 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e5da9db0-36bc-4151-886c-fb67a40a5e99 admin admin] The token cache is being invalidate because project 7f36d038ead54ea19c5950c99039fbe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:55:37.197654 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e5da9db0-36bc-4151-886c-fb67a40a5e99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:37.198481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e5da9db0-36bc-4151-886c-fb67a40a5e99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:37.200107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1053/2090] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:55:36 2022] DELETE /identity/v3/projects/7f36d038ead54ea19c5950c99039fbe9 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:37.210576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ecca9-efe1-4b08-87af-b4913e6fc89e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:37.211227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ecca9-efe1-4b08-87af-b4913e6fc89e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:37.211615 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ecca9-efe1-4b08-87af-b4913e6fc89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:37.238877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f39ecca9-efe1-4b08-87af-b4913e6fc89e None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:37.240595 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f39ecca9-efe1-4b08-87af-b4913e6fc89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:37.324313 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1038/2091] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:37.333800 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efd76c-26c7-4c67-b13c-d143cecc7cfa None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:37.334254 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efd76c-26c7-4c67-b13c-d143cecc7cfa None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:37.334599 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efd76c-26c7-4c67-b13c-d143cecc7cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:37.358261 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-55efd76c-26c7-4c67-b13c-d143cecc7cfa None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:37.359516 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-55efd76c-26c7-4c67-b13c-d143cecc7cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:37.370436 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1054/2092] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:37.375215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ecca9-efe1-4b08-87af-b4913e6fc89e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:37.388817 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ecca9-efe1-4b08-87af-b4913e6fc89e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:37.397854 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d749b-3125-4f8f-9e77-18dee8ad5b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:37.398344 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d749b-3125-4f8f-9e77-18dee8ad5b3f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:37.398344 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d749b-3125-4f8f-9e77-18dee8ad5b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:37.398632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d749b-3125-4f8f-9e77-18dee8ad5b3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:37.399517 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d749b-3125-4f8f-9e77-18dee8ad5b3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:55:37.399734 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d749b-3125-4f8f-9e77-18dee8ad5b3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:37.401439 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d749b-3125-4f8f-9e77-18dee8ad5b3f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:37.410004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:37.419988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1039/2093] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:55:37.424296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efd76c-26c7-4c67-b13c-d143cecc7cfa None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:37.437507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efd76c-26c7-4c67-b13c-d143cecc7cfa None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:37.441614 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc60a7-6593-4ff1-9f41-134651f995f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:37.442411 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc60a7-6593-4ff1-9f41-134651f995f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:37.442935 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc60a7-6593-4ff1-9f41-134651f995f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:37.443272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc60a7-6593-4ff1-9f41-134651f995f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:37.444042 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc60a7-6593-4ff1-9f41-134651f995f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:37.446181 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc60a7-6593-4ff1-9f41-134651f995f5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:37.552663 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1dcab-63e3-4b45-81e0-5b356d5f7b1b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:37.552974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1dcab-63e3-4b45-81e0-5b356d5f7b1b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:37.553375 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1dcab-63e3-4b45-81e0-5b356d5f7b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:37.553495 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1055/2094] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:55:37 2022] POST /identity/v3/projects => generated 389 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:37.558869 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc60a7-6593-4ff1-9f41-134651f995f5 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:37.576784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-58f1dcab-63e3-4b45-81e0-5b356d5f7b1b None None] MFA Rules not processed for user `14b1aff9e40a44dbabe2766d3e51f914`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:37.578923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-58f1dcab-63e3-4b45-81e0-5b356d5f7b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:37.647128 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc60a7-6593-4ff1-9f41-134651f995f5 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:37.652821 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aae156-695b-48d9-ad7c-4664876919a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:37.654014 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aae156-695b-48d9-ad7c-4664876919a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:37.654704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aae156-695b-48d9-ad7c-4664876919a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:37.654704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aae156-695b-48d9-ad7c-4664876919a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:37.655519 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aae156-695b-48d9-ad7c-4664876919a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:37.657759 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aae156-695b-48d9-ad7c-4664876919a5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:37.672848 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1040/2095] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:37.805517 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1056/2096] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:55:37 2022] POST /identity/v3/users => generated 295 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:55:37.806066 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1dcab-63e3-4b45-81e0-5b356d5f7b1b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:37.818352 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1dcab-63e3-4b45-81e0-5b356d5f7b1b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:37.824266 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac028207-be9e-4f40-b9e5-9a1e98374827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:37.825099 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac028207-be9e-4f40-b9e5-9a1e98374827 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:37.825495 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac028207-be9e-4f40-b9e5-9a1e98374827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:37.825782 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac028207-be9e-4f40-b9e5-9a1e98374827 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:37.826554 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac028207-be9e-4f40-b9e5-9a1e98374827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:37.828188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac028207-be9e-4f40-b9e5-9a1e98374827 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:37.849308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1041/2097] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:55:37.853380 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aae156-695b-48d9-ad7c-4664876919a5 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:37.871847 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aae156-695b-48d9-ad7c-4664876919a5 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:37.883868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b832fd-ed36-44af-8306-18625e08cbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:37.885187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b832fd-ed36-44af-8306-18625e08cbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:37.885675 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b832fd-ed36-44af-8306-18625e08cbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:37.886179 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b832fd-ed36-44af-8306-18625e08cbb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:37.887138 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b832fd-ed36-44af-8306-18625e08cbb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:37.889141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b832fd-ed36-44af-8306-18625e08cbb5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:37.904696 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1057/2098] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:55:37.909952 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac028207-be9e-4f40-b9e5-9a1e98374827 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:37.922962 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac028207-be9e-4f40-b9e5-9a1e98374827 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:37.928445 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942c7a1-efda-41fd-880c-11c685e97f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:37.929575 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942c7a1-efda-41fd-880c-11c685e97f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:37.929905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942c7a1-efda-41fd-880c-11c685e97f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:37.930500 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942c7a1-efda-41fd-880c-11c685e97f3c admin admin] PATH_INFO: `/v3/projects/4416ef92d84346fa90a62ff4ab718313/users/aad9d229843b40d5bf5b4d950bdc3359/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:37.970478 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942c7a1-efda-41fd-880c-11c685e97f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4416ef92d84346fa90a62ff4ab718313, user_id=aad9d229843b40d5bf5b4d950bdc3359, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:37.977061 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942c7a1-efda-41fd-880c-11c685e97f3c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:38.079775 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1042/2099] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:37 2022] PUT /identity/v3/projects/4416ef92d84346fa90a62ff4ab718313/users/aad9d229843b40d5bf5b4d950bdc3359/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:38.084045 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3d0cf-eda1-499d-a271-0c50b2569c5c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:38.084045 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3d0cf-eda1-499d-a271-0c50b2569c5c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:38.084372 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3d0cf-eda1-499d-a271-0c50b2569c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:38.136553 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-cfe3d0cf-eda1-499d-a271-0c50b2569c5c None None] MFA Rules not processed for user `aad9d229843b40d5bf5b4d950bdc3359`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:38.139871 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cfe3d0cf-eda1-499d-a271-0c50b2569c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:38.280287 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1058/2100] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:38.281984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942c7a1-efda-41fd-880c-11c685e97f3c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:38.421449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942c7a1-efda-41fd-880c-11c685e97f3c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:38.429795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660db12-8f5e-4758-a77c-3cc7c4d616f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:38.431060 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660db12-8f5e-4758-a77c-3cc7c4d616f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:38.431367 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660db12-8f5e-4758-a77c-3cc7c4d616f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:38.431643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660db12-8f5e-4758-a77c-3cc7c4d616f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:38.432355 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660db12-8f5e-4758-a77c-3cc7c4d616f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:38.435127 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660db12-8f5e-4758-a77c-3cc7c4d616f6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:38.508386 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3d0cf-eda1-499d-a271-0c50b2569c5c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:38.510943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cfe3d0cf-eda1-499d-a271-0c50b2569c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:38.536188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3d0cf-eda1-499d-a271-0c50b2569c5c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:38.542212 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746ff34-42f1-498d-928e-910d5e65d2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:38.543165 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746ff34-42f1-498d-928e-910d5e65d2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:38.543476 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746ff34-42f1-498d-928e-910d5e65d2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:38.544131 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746ff34-42f1-498d-928e-910d5e65d2e0 admin admin] PATH_INFO: `/v3/users/9aa096e83bea4280806ab0b1fd9fc546` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:38.546444 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746ff34-42f1-498d-928e-910d5e65d2e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aa096e83bea4280806ab0b1fd9fc546)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:38.548889 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746ff34-42f1-498d-928e-910d5e65d2e0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:38.557673 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1043/2101] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:55:38 2022] POST /identity/v3/projects => generated 389 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:38.568647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660db12-8f5e-4758-a77c-3cc7c4d616f6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:38.684757 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:38.704766 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660db12-8f5e-4758-a77c-3cc7c4d616f6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:38.713360 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd294d-5bf3-46cc-9bc4-6321247e06f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:38.714099 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd294d-5bf3-46cc-9bc4-6321247e06f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:38.714388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd294d-5bf3-46cc-9bc4-6321247e06f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:38.714712 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd294d-5bf3-46cc-9bc4-6321247e06f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:38.715578 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd294d-5bf3-46cc-9bc4-6321247e06f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:38.718445 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd294d-5bf3-46cc-9bc4-6321247e06f6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:38.846441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1044/2102] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:55:38 2022] POST /identity/v3/users => generated 301 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:38.849384 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd294d-5bf3-46cc-9bc4-6321247e06f6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:38.863109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:38.863916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd294d-5bf3-46cc-9bc4-6321247e06f6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:38.870112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae578f-0e3a-47b4-89a8-36953667cd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:38.870952 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae578f-0e3a-47b4-89a8-36953667cd49 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:38.871186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae578f-0e3a-47b4-89a8-36953667cd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:38.871594 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae578f-0e3a-47b4-89a8-36953667cd49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:38.872468 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae578f-0e3a-47b4-89a8-36953667cd49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:38.874993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae578f-0e3a-47b4-89a8-36953667cd49 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:38.892464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c746ff34-42f1-498d-928e-910d5e65d2e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aa096e83bea4280806ab0b1fd9fc546'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:38.893864 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c746ff34-42f1-498d-928e-910d5e65d2e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aa096e83bea4280806ab0b1fd9fc546'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:38.895257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1045/2103] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:38.900149 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae578f-0e3a-47b4-89a8-36953667cd49 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:38.908629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c746ff34-42f1-498d-928e-910d5e65d2e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aa096e83bea4280806ab0b1fd9fc546'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:38.916060 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae578f-0e3a-47b4-89a8-36953667cd49 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:38.921519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7c461-c5ac-4df1-b835-d6520e44ea55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:38.922643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7c461-c5ac-4df1-b835-d6520e44ea55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:38.922941 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7c461-c5ac-4df1-b835-d6520e44ea55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:38.923229 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7c461-c5ac-4df1-b835-d6520e44ea55 admin admin] PATH_INFO: `/v3/projects/84431f423d5248a1a0a2e81442fd01af/users/d3793dafc6f74b9ba21efc2f4cc1305b/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:38.951227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7c461-c5ac-4df1-b835-d6520e44ea55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84431f423d5248a1a0a2e81442fd01af, user_id=d3793dafc6f74b9ba21efc2f4cc1305b, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:38.955121 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7c461-c5ac-4df1-b835-d6520e44ea55 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:38.977292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c746ff34-42f1-498d-928e-910d5e65d2e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aa096e83bea4280806ab0b1fd9fc546'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:38.977292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c746ff34-42f1-498d-928e-910d5e65d2e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aa096e83bea4280806ab0b1fd9fc546'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:39.006736 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1059/2104] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:55:38 2022] DELETE /identity/v3/users/9aa096e83bea4280806ab0b1fd9fc546 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:39.013034 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77225a0-67d1-4a10-af5b-6e2f29723236 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:39.013363 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77225a0-67d1-4a10-af5b-6e2f29723236 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:39.013905 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77225a0-67d1-4a10-af5b-6e2f29723236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:39.044034 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e77225a0-67d1-4a10-af5b-6e2f29723236 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:39.045643 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e77225a0-67d1-4a10-af5b-6e2f29723236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:39.056609 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1046/2105] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:38 2022] PUT /identity/v3/projects/84431f423d5248a1a0a2e81442fd01af/users/d3793dafc6f74b9ba21efc2f4cc1305b/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:39.062843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7c461-c5ac-4df1-b835-d6520e44ea55 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:39.087020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-83e7c461-c5ac-4df1-b835-d6520e44ea55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:39.213560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1060/2106] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:39.229239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77225a0-67d1-4a10-af5b-6e2f29723236 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:39.233161 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e77225a0-67d1-4a10-af5b-6e2f29723236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:39.258723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7c461-c5ac-4df1-b835-d6520e44ea55 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:39.268828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8aaf2-41e7-45fa-9b8a-e7bf3ffb092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:39.270034 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8aaf2-41e7-45fa-9b8a-e7bf3ffb092a admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:39.270471 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8aaf2-41e7-45fa-9b8a-e7bf3ffb092a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:39.270933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8aaf2-41e7-45fa-9b8a-e7bf3ffb092a admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:39.271888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8aaf2-41e7-45fa-9b8a-e7bf3ffb092a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:39.274568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8aaf2-41e7-45fa-9b8a-e7bf3ffb092a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:39.311236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1047/2107] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:39.317708 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8aaf2-41e7-45fa-9b8a-e7bf3ffb092a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:39.345107 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8aaf2-41e7-45fa-9b8a-e7bf3ffb092a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:39.363038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399fcf5-654f-41a5-8bce-9a636b8ec09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:39.364821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399fcf5-654f-41a5-8bce-9a636b8ec09f admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:39.365731 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399fcf5-654f-41a5-8bce-9a636b8ec09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:39.366309 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399fcf5-654f-41a5-8bce-9a636b8ec09f admin admin] PATH_INFO: `/v3/projects/84431f423d5248a1a0a2e81442fd01af/users/d3793dafc6f74b9ba21efc2f4cc1305b/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:39.371178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399fcf5-654f-41a5-8bce-9a636b8ec09f admin admin] RBAC: Authorizing `identity:create_grant(project_id=84431f423d5248a1a0a2e81442fd01af, user_id=d3793dafc6f74b9ba21efc2f4cc1305b, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:39.376713 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399fcf5-654f-41a5-8bce-9a636b8ec09f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:39.399079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77225a0-67d1-4a10-af5b-6e2f29723236 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:39.407606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1048/2108] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:39 2022] PUT /identity/v3/projects/84431f423d5248a1a0a2e81442fd01af/users/d3793dafc6f74b9ba21efc2f4cc1305b/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:55:39.430070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742128f-b4e9-49b2-bc7a-0e2dcf8efb06 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:39.430964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742128f-b4e9-49b2-bc7a-0e2dcf8efb06 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:39.431602 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742128f-b4e9-49b2-bc7a-0e2dcf8efb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:39.493230 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5742128f-b4e9-49b2-bc7a-0e2dcf8efb06 None None] MFA Rules not processed for user `d3793dafc6f74b9ba21efc2f4cc1305b`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:39.496392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5742128f-b4e9-49b2-bc7a-0e2dcf8efb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:39.534294 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d3e6c-0725-4f7e-a904-cdd1bbf13b7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:39.536363 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d3e6c-0725-4f7e-a904-cdd1bbf13b7a service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:39.536560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d3e6c-0725-4f7e-a904-cdd1bbf13b7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:39.537068 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d3e6c-0725-4f7e-a904-cdd1bbf13b7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:39.565995 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:39.639808 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d3e6c-0725-4f7e-a904-cdd1bbf13b7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:39.643279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d3e6c-0725-4f7e-a904-cdd1bbf13b7a service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:39.665751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1061/2109] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:39.666801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1049/2110] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:39.675803 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d3e6c-0725-4f7e-a904-cdd1bbf13b7a service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:39.678137 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-af4d3e6c-0725-4f7e-a904-cdd1bbf13b7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:39.786958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d3e6c-0725-4f7e-a904-cdd1bbf13b7a service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:39.793670 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e144cf6-2efe-40db-8e26-f9ad8521dc10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:39.794576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e144cf6-2efe-40db-8e26-f9ad8521dc10 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:39.794970 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e144cf6-2efe-40db-8e26-f9ad8521dc10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:39.795449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e144cf6-2efe-40db-8e26-f9ad8521dc10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:39.810570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e144cf6-2efe-40db-8e26-f9ad8521dc10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:39.812321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e144cf6-2efe-40db-8e26-f9ad8521dc10 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:39.827769 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1062/2111] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:39 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:40.018155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742128f-b4e9-49b2-bc7a-0e2dcf8efb06 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:40.034665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742128f-b4e9-49b2-bc7a-0e2dcf8efb06 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:40.043093 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568c6ef-dce7-4e6f-9e21-06afc6c5634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:40.043892 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568c6ef-dce7-4e6f-9e21-06afc6c5634b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:40.045439 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568c6ef-dce7-4e6f-9e21-06afc6c5634b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:40.045439 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568c6ef-dce7-4e6f-9e21-06afc6c5634b admin admin] PATH_INFO: `/v3/users/aad9d229843b40d5bf5b4d950bdc3359` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:40.046993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568c6ef-dce7-4e6f-9e21-06afc6c5634b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad9d229843b40d5bf5b4d950bdc3359)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:40.049862 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568c6ef-dce7-4e6f-9e21-06afc6c5634b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:40.075614 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:40.401791 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f568c6ef-dce7-4e6f-9e21-06afc6c5634b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad9d229843b40d5bf5b4d950bdc3359'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:40.479507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f568c6ef-dce7-4e6f-9e21-06afc6c5634b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad9d229843b40d5bf5b4d950bdc3359'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:40.480979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f568c6ef-dce7-4e6f-9e21-06afc6c5634b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad9d229843b40d5bf5b4d950bdc3359'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:40.481895 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f568c6ef-dce7-4e6f-9e21-06afc6c5634b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad9d229843b40d5bf5b4d950bdc3359'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:40.494339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f568c6ef-dce7-4e6f-9e21-06afc6c5634b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad9d229843b40d5bf5b4d950bdc3359'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:40.539826 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1050/2112] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:55:40 2022] DELETE /identity/v3/users/aad9d229843b40d5bf5b4d950bdc3359 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:40.563999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12590199-7115-4f3c-a26b-94a61c55bdad None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:40.564657 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12590199-7115-4f3c-a26b-94a61c55bdad None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:40.564657 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12590199-7115-4f3c-a26b-94a61c55bdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:40.609417 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-12590199-7115-4f3c-a26b-94a61c55bdad None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:40.611197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-12590199-7115-4f3c-a26b-94a61c55bdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:40.710703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1063/2113] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:40.723723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568c6ef-dce7-4e6f-9e21-06afc6c5634b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:40.725195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f568c6ef-dce7-4e6f-9e21-06afc6c5634b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:40.752963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12590199-7115-4f3c-a26b-94a61c55bdad None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:40.764061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-12590199-7115-4f3c-a26b-94a61c55bdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:40.806006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12590199-7115-4f3c-a26b-94a61c55bdad None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:40.817948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddf3ed-daf7-4e5f-90c2-7abc66af3c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:40.819001 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddf3ed-daf7-4e5f-90c2-7abc66af3c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:40.822737 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddf3ed-daf7-4e5f-90c2-7abc66af3c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:40.822737 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddf3ed-daf7-4e5f-90c2-7abc66af3c7d admin admin] PATH_INFO: `/v3/projects/56f65eb5205d4cdd949a6f3a6131ee7a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:40.822737 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddf3ed-daf7-4e5f-90c2-7abc66af3c7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=56f65eb5205d4cdd949a6f3a6131ee7a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:40.824324 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddf3ed-daf7-4e5f-90c2-7abc66af3c7d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:40.846489 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568c6ef-dce7-4e6f-9e21-06afc6c5634b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:40.852962 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880ccb0-e92a-439e-a04e-58147ffdbeca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:40.854041 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880ccb0-e92a-439e-a04e-58147ffdbeca service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:40.854601 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880ccb0-e92a-439e-a04e-58147ffdbeca service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:40.855345 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880ccb0-e92a-439e-a04e-58147ffdbeca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:40.869640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880ccb0-e92a-439e-a04e-58147ffdbeca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:40.871344 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880ccb0-e92a-439e-a04e-58147ffdbeca service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:40.886358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1051/2114] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:40.983213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cfddf3ed-daf7-4e5f-90c2-7abc66af3c7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56f65eb5205d4cdd949a6f3a6131ee7a', 'request_id': 'req-cfddf3ed-daf7-4e5f-90c2-7abc66af3c7d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:40.991389 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:41.067566 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cfddf3ed-daf7-4e5f-90c2-7abc66af3c7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56f65eb5205d4cdd949a6f3a6131ee7a', 'request_id': 'req-cfddf3ed-daf7-4e5f-90c2-7abc66af3c7d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:41.077431 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cfddf3ed-daf7-4e5f-90c2-7abc66af3c7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56f65eb5205d4cdd949a6f3a6131ee7a', 'request_id': 'req-cfddf3ed-daf7-4e5f-90c2-7abc66af3c7d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:41.102996 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cfddf3ed-daf7-4e5f-90c2-7abc66af3c7d admin admin] The token cache is being invalidate because project 56f65eb5205d4cdd949a6f3a6131ee7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:55:41.103877 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cfddf3ed-daf7-4e5f-90c2-7abc66af3c7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:41.105793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cfddf3ed-daf7-4e5f-90c2-7abc66af3c7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:41.116215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1064/2115] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:55:40 2022] DELETE /identity/v3/projects/56f65eb5205d4cdd949a6f3a6131ee7a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:41.117021 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e606036-7f39-4054-b67f-684e393efbbc None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:41.117682 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e606036-7f39-4054-b67f-684e393efbbc None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:41.118280 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e606036-7f39-4054-b67f-684e393efbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:41.153814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5e606036-7f39-4054-b67f-684e393efbbc None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:41.156581 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5e606036-7f39-4054-b67f-684e393efbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:41.336259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1052/2116] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:55:41.347892 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70a980-d7a3-40e8-afc5-e1bb1f9f08b2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:41.348186 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70a980-d7a3-40e8-afc5-e1bb1f9f08b2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:41.348462 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70a980-d7a3-40e8-afc5-e1bb1f9f08b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:41.386945 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ed70a980-d7a3-40e8-afc5-e1bb1f9f08b2 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:41.389068 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ed70a980-d7a3-40e8-afc5-e1bb1f9f08b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:41.409437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1065/2117] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:41.416293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e606036-7f39-4054-b67f-684e393efbbc None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:41.430061 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e606036-7f39-4054-b67f-684e393efbbc None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:41.443023 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d236f62-b626-455e-a462-e4c1fb068cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:41.444125 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d236f62-b626-455e-a462-e4c1fb068cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:41.445085 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d236f62-b626-455e-a462-e4c1fb068cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:41.445583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d236f62-b626-455e-a462-e4c1fb068cd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:41.446588 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d236f62-b626-455e-a462-e4c1fb068cd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:55:41.447273 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d236f62-b626-455e-a462-e4c1fb068cd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:41.448769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d236f62-b626-455e-a462-e4c1fb068cd4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:41.475317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1053/2118] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:55:41.479665 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70a980-d7a3-40e8-afc5-e1bb1f9f08b2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:41.491311 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70a980-d7a3-40e8-afc5-e1bb1f9f08b2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:41.511330 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7d230-d5c8-4503-8e49-fd5762b59284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:41.512658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7d230-d5c8-4503-8e49-fd5762b59284 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:41.513193 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7d230-d5c8-4503-8e49-fd5762b59284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:41.514130 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7d230-d5c8-4503-8e49-fd5762b59284 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:41.514457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7d230-d5c8-4503-8e49-fd5762b59284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:41.516465 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7d230-d5c8-4503-8e49-fd5762b59284 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:41.631093 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1066/2119] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:55:41 2022] POST /identity/v3/projects => generated 397 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:41.638051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d236f62-b626-455e-a462-e4c1fb068cd4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:41.663205 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7d230-d5c8-4503-8e49-fd5762b59284 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:41.665413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e0f7d230-d5c8-4503-8e49-fd5762b59284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:41.670583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d236f62-b626-455e-a462-e4c1fb068cd4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:41.698054 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:41.795800 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6c2b5-8f55-40ad-b4d4-87f5f1209a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:41.801622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6c2b5-8f55-40ad-b4d4-87f5f1209a5e admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:41.802475 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6c2b5-8f55-40ad-b4d4-87f5f1209a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:41.803200 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6c2b5-8f55-40ad-b4d4-87f5f1209a5e admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:41.805705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6c2b5-8f55-40ad-b4d4-87f5f1209a5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:41.812981 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6c2b5-8f55-40ad-b4d4-87f5f1209a5e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:41.847581 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7d230-d5c8-4503-8e49-fd5762b59284 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:41.861114 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125823cf-86f0-4547-b529-390d244fd1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:41.861114 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125823cf-86f0-4547-b529-390d244fd1e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:41.861114 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125823cf-86f0-4547-b529-390d244fd1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:41.861114 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125823cf-86f0-4547-b529-390d244fd1e1 admin admin] PATH_INFO: `/v3/projects/4416ef92d84346fa90a62ff4ab718313` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:41.861658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125823cf-86f0-4547-b529-390d244fd1e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4416ef92d84346fa90a62ff4ab718313)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:41.861658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125823cf-86f0-4547-b529-390d244fd1e1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:41.970287 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1054/2120] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:55:41 2022] POST /identity/v3/users => generated 299 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:41.975466 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6c2b5-8f55-40ad-b4d4-87f5f1209a5e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:41.997908 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6c2b5-8f55-40ad-b4d4-87f5f1209a5e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:42.014461 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-125823cf-86f0-4547-b529-390d244fd1e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4416ef92d84346fa90a62ff4ab718313', 'request_id': 'req-125823cf-86f0-4547-b529-390d244fd1e1'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:42.109522 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dbe8b-1a63-4c22-bbc6-9f62ab8c94cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:42.111070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dbe8b-1a63-4c22-bbc6-9f62ab8c94cf admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:42.111549 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dbe8b-1a63-4c22-bbc6-9f62ab8c94cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:42.112019 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dbe8b-1a63-4c22-bbc6-9f62ab8c94cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:42.113478 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dbe8b-1a63-4c22-bbc6-9f62ab8c94cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:42.117979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dbe8b-1a63-4c22-bbc6-9f62ab8c94cf admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:42.133608 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1055/2121] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:42.136206 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-125823cf-86f0-4547-b529-390d244fd1e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4416ef92d84346fa90a62ff4ab718313', 'request_id': 'req-125823cf-86f0-4547-b529-390d244fd1e1'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:42.138949 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dbe8b-1a63-4c22-bbc6-9f62ab8c94cf admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:42.152017 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dbe8b-1a63-4c22-bbc6-9f62ab8c94cf admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:42.155582 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-125823cf-86f0-4547-b529-390d244fd1e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4416ef92d84346fa90a62ff4ab718313', 'request_id': 'req-125823cf-86f0-4547-b529-390d244fd1e1'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:42.161738 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdbd96-3a91-49c9-ada1-995dac25000c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:42.162531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdbd96-3a91-49c9-ada1-995dac25000c admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:42.166746 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdbd96-3a91-49c9-ada1-995dac25000c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:42.166746 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdbd96-3a91-49c9-ada1-995dac25000c admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:42.166746 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fdbd96-3a91-49c9-ada1-995dac25000c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:42.166746 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fdbd96-3a91-49c9-ada1-995dac25000c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:42.189098 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1056/2122] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:42.190325 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdbd96-3a91-49c9-ada1-995dac25000c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:42.194790 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-125823cf-86f0-4547-b529-390d244fd1e1 admin admin] The token cache is being invalidate because project 4416ef92d84346fa90a62ff4ab718313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:55:42.195286 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-125823cf-86f0-4547-b529-390d244fd1e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:42.196688 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-125823cf-86f0-4547-b529-390d244fd1e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:42.199750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1067/2123] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:55:41 2022] DELETE /identity/v3/projects/4416ef92d84346fa90a62ff4ab718313 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:42.202692 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdbd96-3a91-49c9-ada1-995dac25000c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:42.205958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125823cf-86f0-4547-b529-390d244fd1e1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:42.208695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-125823cf-86f0-4547-b529-390d244fd1e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:42.210635 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c420dd-32f1-4718-aecb-81e9254c5016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:42.213573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c420dd-32f1-4718-aecb-81e9254c5016 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:42.213770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c420dd-32f1-4718-aecb-81e9254c5016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:42.214529 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c420dd-32f1-4718-aecb-81e9254c5016 admin admin] PATH_INFO: `/v3/projects/938418b980e34cd2b47128ed38499223/users/8ab3c9f6794246cdac73f565e6b74488/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:42.249539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125823cf-86f0-4547-b529-390d244fd1e1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:42.260387 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c420dd-32f1-4718-aecb-81e9254c5016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=938418b980e34cd2b47128ed38499223, user_id=8ab3c9f6794246cdac73f565e6b74488, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:42.262840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0de15-94b1-4b1c-8152-05aae2a682cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:42.264873 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0de15-94b1-4b1c-8152-05aae2a682cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:42.269116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c420dd-32f1-4718-aecb-81e9254c5016 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:42.277875 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0de15-94b1-4b1c-8152-05aae2a682cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:42.279045 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0de15-94b1-4b1c-8152-05aae2a682cf admin admin] PATH_INFO: `/v3/users/d3793dafc6f74b9ba21efc2f4cc1305b` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:42.290376 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0de15-94b1-4b1c-8152-05aae2a682cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3793dafc6f74b9ba21efc2f4cc1305b)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:42.294217 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0de15-94b1-4b1c-8152-05aae2a682cf admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:42.365934 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1057/2124] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:42 2022] PUT /identity/v3/projects/938418b980e34cd2b47128ed38499223/users/8ab3c9f6794246cdac73f565e6b74488/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:42.381231 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8b6c8-d361-4ba9-bfd4-ef7d11afb251 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:42.381688 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8b6c8-d361-4ba9-bfd4-ef7d11afb251 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:42.382254 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8b6c8-d361-4ba9-bfd4-ef7d11afb251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:42.435552 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-04a8b6c8-d361-4ba9-bfd4-ef7d11afb251 None None] MFA Rules not processed for user `8ab3c9f6794246cdac73f565e6b74488`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:42.437225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-04a8b6c8-d361-4ba9-bfd4-ef7d11afb251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:42.552604 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:42.571005 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:42.572541 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6ea0de15-94b1-4b1c-8152-05aae2a682cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3793dafc6f74b9ba21efc2f4cc1305b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:42.574974 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6ea0de15-94b1-4b1c-8152-05aae2a682cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3793dafc6f74b9ba21efc2f4cc1305b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:42.579270 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1058/2125] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:55:42.608705 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6ea0de15-94b1-4b1c-8152-05aae2a682cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3793dafc6f74b9ba21efc2f4cc1305b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:42.612338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8b6c8-d361-4ba9-bfd4-ef7d11afb251 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:42.614267 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-04a8b6c8-d361-4ba9-bfd4-ef7d11afb251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:42.691705 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6ea0de15-94b1-4b1c-8152-05aae2a682cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3793dafc6f74b9ba21efc2f4cc1305b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:42.693699 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6ea0de15-94b1-4b1c-8152-05aae2a682cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3793dafc6f74b9ba21efc2f4cc1305b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:42.698641 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8b6c8-d361-4ba9-bfd4-ef7d11afb251 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:42.703372 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7d475-fce3-49be-a880-1606e8b8bbb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:42.704359 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7d475-fce3-49be-a880-1606e8b8bbb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:42.704822 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7d475-fce3-49be-a880-1606e8b8bbb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:42.705296 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7d475-fce3-49be-a880-1606e8b8bbb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:42.708559 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6de7d475-fce3-49be-a880-1606e8b8bbb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:42.724606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7d475-fce3-49be-a880-1606e8b8bbb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:42.726213 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7d475-fce3-49be-a880-1606e8b8bbb1 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:42.738960 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1059/2126] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:42.746111 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1068/2127] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:55:42 2022] DELETE /identity/v3/users/d3793dafc6f74b9ba21efc2f4cc1305b => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:44.106373 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7d475-fce3-49be-a880-1606e8b8bbb1 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:44.109737 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6de7d475-fce3-49be-a880-1606e8b8bbb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:44.352711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7d475-fce3-49be-a880-1606e8b8bbb1 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:44.480468 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ec313-e3eb-4ae9-ad50-01ccd1913b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:44.481610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ec313-e3eb-4ae9-ad50-01ccd1913b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:44.481610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ec313-e3eb-4ae9-ad50-01ccd1913b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:44.481610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ec313-e3eb-4ae9-ad50-01ccd1913b51 admin admin] PATH_INFO: `/v3/projects/84431f423d5248a1a0a2e81442fd01af` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:44.485018 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ec313-e3eb-4ae9-ad50-01ccd1913b51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84431f423d5248a1a0a2e81442fd01af)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:44.488416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ec313-e3eb-4ae9-ad50-01ccd1913b51 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:44.685184 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f96ec313-e3eb-4ae9-ad50-01ccd1913b51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84431f423d5248a1a0a2e81442fd01af', 'request_id': 'req-f96ec313-e3eb-4ae9-ad50-01ccd1913b51'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:44.687710 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:44.700967 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f96ec313-e3eb-4ae9-ad50-01ccd1913b51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84431f423d5248a1a0a2e81442fd01af', 'request_id': 'req-f96ec313-e3eb-4ae9-ad50-01ccd1913b51'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:44.716457 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f96ec313-e3eb-4ae9-ad50-01ccd1913b51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84431f423d5248a1a0a2e81442fd01af', 'request_id': 'req-f96ec313-e3eb-4ae9-ad50-01ccd1913b51'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:44.850079 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f96ec313-e3eb-4ae9-ad50-01ccd1913b51 admin admin] The token cache is being invalidate because project 84431f423d5248a1a0a2e81442fd01af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:55:44.850436 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f96ec313-e3eb-4ae9-ad50-01ccd1913b51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:44.851606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f96ec313-e3eb-4ae9-ad50-01ccd1913b51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:44.855342 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1060/2128] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:55:44 2022] DELETE /identity/v3/projects/84431f423d5248a1a0a2e81442fd01af => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:44.862615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af281307-266d-47be-adb2-9143ce466f0e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:44.863493 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af281307-266d-47be-adb2-9143ce466f0e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:44.863664 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af281307-266d-47be-adb2-9143ce466f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:44.904045 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-af281307-266d-47be-adb2-9143ce466f0e None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:44.906205 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-af281307-266d-47be-adb2-9143ce466f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:45.021565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1069/2129] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:45.031525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e0634-5a7f-4ad5-9448-a044fcc1c596 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:45.032553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e0634-5a7f-4ad5-9448-a044fcc1c596 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:45.032986 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e0634-5a7f-4ad5-9448-a044fcc1c596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:45.068532 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d07e0634-5a7f-4ad5-9448-a044fcc1c596 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:45.071603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d07e0634-5a7f-4ad5-9448-a044fcc1c596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:45.087503 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1061/2130] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:45.093002 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af281307-266d-47be-adb2-9143ce466f0e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:45.113835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af281307-266d-47be-adb2-9143ce466f0e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:45.121947 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bfc2a-9587-4fea-9bf0-b84200f790f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:45.123238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bfc2a-9587-4fea-9bf0-b84200f790f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:45.123809 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bfc2a-9587-4fea-9bf0-b84200f790f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:45.124378 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bfc2a-9587-4fea-9bf0-b84200f790f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:45.125879 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0bfc2a-9587-4fea-9bf0-b84200f790f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:55:45.126447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0bfc2a-9587-4fea-9bf0-b84200f790f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:45.131570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0bfc2a-9587-4fea-9bf0-b84200f790f2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:45.166914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1070/2131] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:55:45.174367 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e0634-5a7f-4ad5-9448-a044fcc1c596 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:45.196828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e0634-5a7f-4ad5-9448-a044fcc1c596 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:45.203228 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421616bc-9180-4c2a-8690-4d9abe218f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:45.204142 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421616bc-9180-4c2a-8690-4d9abe218f29 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:45.204533 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421616bc-9180-4c2a-8690-4d9abe218f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:45.205029 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421616bc-9180-4c2a-8690-4d9abe218f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:45.206300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421616bc-9180-4c2a-8690-4d9abe218f29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:45.209581 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421616bc-9180-4c2a-8690-4d9abe218f29 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:45.400737 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1062/2132] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:55:45 2022] POST /identity/v3/projects => generated 409 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:55:45.403616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bfc2a-9587-4fea-9bf0-b84200f790f2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:45.429705 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bfc2a-9587-4fea-9bf0-b84200f790f2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:45.564579 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470ce57-41a9-41e0-8ee1-6a31f9fc7d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:45.565773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470ce57-41a9-41e0-8ee1-6a31f9fc7d4a admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:45.566277 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470ce57-41a9-41e0-8ee1-6a31f9fc7d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:45.566784 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470ce57-41a9-41e0-8ee1-6a31f9fc7d4a admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:45.568242 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470ce57-41a9-41e0-8ee1-6a31f9fc7d4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:45.573463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470ce57-41a9-41e0-8ee1-6a31f9fc7d4a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:45.735518 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1071/2133] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:55:45 2022] POST /identity/v3/users => generated 305 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:45.740107 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421616bc-9180-4c2a-8690-4d9abe218f29 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:45.759003 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421616bc-9180-4c2a-8690-4d9abe218f29 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:45.767167 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce614ba-87a5-4abe-8022-261c434aba29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:45.773637 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce614ba-87a5-4abe-8022-261c434aba29 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:45.774076 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce614ba-87a5-4abe-8022-261c434aba29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:45.774366 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce614ba-87a5-4abe-8022-261c434aba29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:45.775318 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce614ba-87a5-4abe-8022-261c434aba29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:45.777172 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce614ba-87a5-4abe-8022-261c434aba29 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:45.794276 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1063/2134] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:55:45.798241 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470ce57-41a9-41e0-8ee1-6a31f9fc7d4a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:45.815150 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470ce57-41a9-41e0-8ee1-6a31f9fc7d4a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:45.821440 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf470b-a024-426d-b4a3-9ebc89499be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:45.822194 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf470b-a024-426d-b4a3-9ebc89499be2 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:45.822481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf470b-a024-426d-b4a3-9ebc89499be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:45.822754 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf470b-a024-426d-b4a3-9ebc89499be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:45.823527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf470b-a024-426d-b4a3-9ebc89499be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:45.825221 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf470b-a024-426d-b4a3-9ebc89499be2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:45.840113 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1072/2135] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:45.848594 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce614ba-87a5-4abe-8022-261c434aba29 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:45.862830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce614ba-87a5-4abe-8022-261c434aba29 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:45.869184 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f431066-9c63-4f18-b762-ab0af8987f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:45.875365 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f431066-9c63-4f18-b762-ab0af8987f16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:45.875365 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f431066-9c63-4f18-b762-ab0af8987f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:45.875365 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f431066-9c63-4f18-b762-ab0af8987f16 admin admin] PATH_INFO: `/v3/projects/e8f219c4e3a54d03bb75aee0b23ec1d3/users/3317d7d8d0bf4b2087e89de85c7e2c7e/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:45.906218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f431066-9c63-4f18-b762-ab0af8987f16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f219c4e3a54d03bb75aee0b23ec1d3, user_id=3317d7d8d0bf4b2087e89de85c7e2c7e, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:45.908045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f431066-9c63-4f18-b762-ab0af8987f16 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:46.029738 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1064/2136] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:45 2022] PUT /identity/v3/projects/e8f219c4e3a54d03bb75aee0b23ec1d3/users/3317d7d8d0bf4b2087e89de85c7e2c7e/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:46.032753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96255633-2b92-4652-a560-7241025d2d54 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:46.033880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96255633-2b92-4652-a560-7241025d2d54 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:46.035207 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96255633-2b92-4652-a560-7241025d2d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:46.071785 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-96255633-2b92-4652-a560-7241025d2d54 None None] MFA Rules not processed for user `3317d7d8d0bf4b2087e89de85c7e2c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:46.073098 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-96255633-2b92-4652-a560-7241025d2d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:46.089480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:46.260446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1073/2137] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:55:46.263507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f431066-9c63-4f18-b762-ab0af8987f16 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:46.370194 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f431066-9c63-4f18-b762-ab0af8987f16 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:46.379001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8984d82-85fc-422d-896d-c3f038bc2bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:46.380649 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8984d82-85fc-422d-896d-c3f038bc2bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:46.381141 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8984d82-85fc-422d-896d-c3f038bc2bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:46.381701 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8984d82-85fc-422d-896d-c3f038bc2bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:46.383564 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8984d82-85fc-422d-896d-c3f038bc2bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:46.387316 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8984d82-85fc-422d-896d-c3f038bc2bb0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:46.533960 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96255633-2b92-4652-a560-7241025d2d54 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:46.536024 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1065/2138] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:55:46 2022] POST /identity/v3/projects => generated 407 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:46.553548 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96255633-2b92-4652-a560-7241025d2d54 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:46.705656 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d9ddb-cf63-4e17-b01b-aecdb781ab40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:46.710187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d9ddb-cf63-4e17-b01b-aecdb781ab40 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:46.711160 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d9ddb-cf63-4e17-b01b-aecdb781ab40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:46.711956 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d9ddb-cf63-4e17-b01b-aecdb781ab40 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:46.715097 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d9ddb-cf63-4e17-b01b-aecdb781ab40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:46.719614 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d9ddb-cf63-4e17-b01b-aecdb781ab40 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:46.865600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1074/2139] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:55:46 2022] POST /identity/v3/users => generated 310 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:46.873023 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8984d82-85fc-422d-896d-c3f038bc2bb0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:46.924830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8984d82-85fc-422d-896d-c3f038bc2bb0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:46.924984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a816d35-930a-4e03-ac0e-72c98e05672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:46.926437 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a816d35-930a-4e03-ac0e-72c98e05672b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:46.926921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a816d35-930a-4e03-ac0e-72c98e05672b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:46.927413 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a816d35-930a-4e03-ac0e-72c98e05672b admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:46.930479 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a816d35-930a-4e03-ac0e-72c98e05672b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:46.935010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a816d35-930a-4e03-ac0e-72c98e05672b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:46.977866 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1066/2140] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:46.983465 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d9ddb-cf63-4e17-b01b-aecdb781ab40 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:47.027709 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d9ddb-cf63-4e17-b01b-aecdb781ab40 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:47.038954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e85de5-f4b5-4fae-ac15-1e6c9f8a8199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:47.038954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e85de5-f4b5-4fae-ac15-1e6c9f8a8199 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:47.038954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e85de5-f4b5-4fae-ac15-1e6c9f8a8199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:47.038954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e85de5-f4b5-4fae-ac15-1e6c9f8a8199 admin admin] PATH_INFO: `/v3/projects/f4a33c8610874f76ba820b4ec080d910/users/bbaec484e1344e8d83070f80096dee6e/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:47.108647 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e85de5-f4b5-4fae-ac15-1e6c9f8a8199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a33c8610874f76ba820b4ec080d910, user_id=bbaec484e1344e8d83070f80096dee6e, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:47.115107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e85de5-f4b5-4fae-ac15-1e6c9f8a8199 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:47.323582 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1075/2141] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:46 2022] PUT /identity/v3/projects/f4a33c8610874f76ba820b4ec080d910/users/bbaec484e1344e8d83070f80096dee6e/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:47.325915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a816d35-930a-4e03-ac0e-72c98e05672b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:47.344769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a816d35-930a-4e03-ac0e-72c98e05672b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:47.453836 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:47.486055 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d0fc9-97be-4c2e-90b1-a518c4694b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:47.487416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d0fc9-97be-4c2e-90b1-a518c4694b58 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:47.487978 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d0fc9-97be-4c2e-90b1-a518c4694b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:47.488442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d0fc9-97be-4c2e-90b1-a518c4694b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:47.489920 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d0fc9-97be-4c2e-90b1-a518c4694b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:47.493783 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d0fc9-97be-4c2e-90b1-a518c4694b58 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:47.520913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1067/2142] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:55:47.530471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e85de5-f4b5-4fae-ac15-1e6c9f8a8199 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:47.547675 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e85de5-f4b5-4fae-ac15-1e6c9f8a8199 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:47.562360 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8d922-ce7e-43fe-b033-57d6ff965559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:47.563753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8d922-ce7e-43fe-b033-57d6ff965559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:47.564096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8d922-ce7e-43fe-b033-57d6ff965559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:47.564381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8d922-ce7e-43fe-b033-57d6ff965559 admin admin] PATH_INFO: `/v3/projects/f4a33c8610874f76ba820b4ec080d910/users/bbaec484e1344e8d83070f80096dee6e/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:47.567733 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8d922-ce7e-43fe-b033-57d6ff965559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a33c8610874f76ba820b4ec080d910, user_id=bbaec484e1344e8d83070f80096dee6e, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:47.573153 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8d922-ce7e-43fe-b033-57d6ff965559 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:47.590744 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1076/2143] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:55:47 2022] PUT /identity/v3/projects/f4a33c8610874f76ba820b4ec080d910/users/bbaec484e1344e8d83070f80096dee6e/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:47.610448 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07a58e-211e-4b11-b570-1158a9974658 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:47.610959 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07a58e-211e-4b11-b570-1158a9974658 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:47.611456 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07a58e-211e-4b11-b570-1158a9974658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:47.676448 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9d07a58e-211e-4b11-b570-1158a9974658 None None] MFA Rules not processed for user `bbaec484e1344e8d83070f80096dee6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:47.679051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9d07a58e-211e-4b11-b570-1158a9974658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:47.841056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1068/2144] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:47 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:47.855088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8d922-ce7e-43fe-b033-57d6ff965559 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:47.857186 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-44d8d922-ce7e-43fe-b033-57d6ff965559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:47.964604 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8d922-ce7e-43fe-b033-57d6ff965559 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:47.969670 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017813c8-20f4-4331-a900-0409e40a8042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:47.970477 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017813c8-20f4-4331-a900-0409e40a8042 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:47.970928 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017813c8-20f4-4331-a900-0409e40a8042 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:47.971554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017813c8-20f4-4331-a900-0409e40a8042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:47.984745 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017813c8-20f4-4331-a900-0409e40a8042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:47.987917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017813c8-20f4-4331-a900-0409e40a8042 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:48.005099 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1077/2145] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:47 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:55:48.568757 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07a58e-211e-4b11-b570-1158a9974658 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:48.571049 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9d07a58e-211e-4b11-b570-1158a9974658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:48.589958 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07a58e-211e-4b11-b570-1158a9974658 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:48.594594 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0393a1-9dff-40f6-94cb-ca4c9fc6e813 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:48.595754 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0393a1-9dff-40f6-94cb-ca4c9fc6e813 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:48.596745 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0393a1-9dff-40f6-94cb-ca4c9fc6e813 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:48.597458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0393a1-9dff-40f6-94cb-ca4c9fc6e813 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:48.709605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0393a1-9dff-40f6-94cb-ca4c9fc6e813 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:48.712495 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0393a1-9dff-40f6-94cb-ca4c9fc6e813 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:48.745331 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1069/2146] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:54.560460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b955e-ccbe-4484-9623-4f41d1d91426 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:54.561065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b955e-ccbe-4484-9623-4f41d1d91426 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:54.561587 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b955e-ccbe-4484-9623-4f41d1d91426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:54.576800 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:54.585684 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-911b955e-ccbe-4484-9623-4f41d1d91426 None None] MFA Rules not processed for user `1cf5ba73296e41c4ab58a6a962b578d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:54.587019 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-911b955e-ccbe-4484-9623-4f41d1d91426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:54.668417 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1078/2147] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:57.409338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0393a1-9dff-40f6-94cb-ca4c9fc6e813 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:57.411596 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-aa0393a1-9dff-40f6-94cb-ca4c9fc6e813 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:57.506761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0393a1-9dff-40f6-94cb-ca4c9fc6e813 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:57.511682 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a9818-c1ea-4b5e-a84c-ef7ebd385629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:57.512587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a9818-c1ea-4b5e-a84c-ef7ebd385629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:57.512869 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a9818-c1ea-4b5e-a84c-ef7ebd385629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:57.513143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a9818-c1ea-4b5e-a84c-ef7ebd385629 admin admin] PATH_INFO: `/v3/users/8ab3c9f6794246cdac73f565e6b74488` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:57.514401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a9818-c1ea-4b5e-a84c-ef7ebd385629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab3c9f6794246cdac73f565e6b74488)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:57.516426 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a9818-c1ea-4b5e-a84c-ef7ebd385629 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:57.528928 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:57.685961 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-627a9818-c1ea-4b5e-a84c-ef7ebd385629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab3c9f6794246cdac73f565e6b74488'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:57.770183 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-627a9818-c1ea-4b5e-a84c-ef7ebd385629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab3c9f6794246cdac73f565e6b74488'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:57.771029 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-627a9818-c1ea-4b5e-a84c-ef7ebd385629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab3c9f6794246cdac73f565e6b74488'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:57.771983 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-627a9818-c1ea-4b5e-a84c-ef7ebd385629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab3c9f6794246cdac73f565e6b74488'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:57.781968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-627a9818-c1ea-4b5e-a84c-ef7ebd385629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab3c9f6794246cdac73f565e6b74488'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:57.803212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1070/2148] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:55:57 2022] DELETE /identity/v3/users/8ab3c9f6794246cdac73f565e6b74488 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:57.810163 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80343235-d73c-4c95-82f1-74e8f11cad3a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:57.810980 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80343235-d73c-4c95-82f1-74e8f11cad3a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:57.811180 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80343235-d73c-4c95-82f1-74e8f11cad3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:57.833464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-80343235-d73c-4c95-82f1-74e8f11cad3a None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:57.835146 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-80343235-d73c-4c95-82f1-74e8f11cad3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:57.934207 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1079/2149] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:57.944981 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a9818-c1ea-4b5e-a84c-ef7ebd385629 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:57.946539 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-627a9818-c1ea-4b5e-a84c-ef7ebd385629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:58.052535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a9818-c1ea-4b5e-a84c-ef7ebd385629 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:58.057710 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801526b-ddaf-468e-ad48-01e05abf23a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:58.058631 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801526b-ddaf-468e-ad48-01e05abf23a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:58.059092 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801526b-ddaf-468e-ad48-01e05abf23a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:58.059224 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801526b-ddaf-468e-ad48-01e05abf23a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:58.094549 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801526b-ddaf-468e-ad48-01e05abf23a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:58.098052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801526b-ddaf-468e-ad48-01e05abf23a3 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:58.119282 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1071/2150] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:55:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:55:58.843940 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80343235-d73c-4c95-82f1-74e8f11cad3a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:58.846809 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-80343235-d73c-4c95-82f1-74e8f11cad3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:58.871733 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80343235-d73c-4c95-82f1-74e8f11cad3a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:58.880235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93728d-541a-446a-a341-050ec281d4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:58.881820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93728d-541a-446a-a341-050ec281d4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:58.882788 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93728d-541a-446a-a341-050ec281d4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:58.883520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93728d-541a-446a-a341-050ec281d4b7 admin admin] PATH_INFO: `/v3/projects/938418b980e34cd2b47128ed38499223` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:58.886179 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93728d-541a-446a-a341-050ec281d4b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=938418b980e34cd2b47128ed38499223)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:58.890773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93728d-541a-446a-a341-050ec281d4b7 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:59.125879 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bc93728d-541a-446a-a341-050ec281d4b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '938418b980e34cd2b47128ed38499223', 'request_id': 'req-bc93728d-541a-446a-a341-050ec281d4b7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:59.227360 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bc93728d-541a-446a-a341-050ec281d4b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '938418b980e34cd2b47128ed38499223', 'request_id': 'req-bc93728d-541a-446a-a341-050ec281d4b7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:59.248840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bc93728d-541a-446a-a341-050ec281d4b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '938418b980e34cd2b47128ed38499223', 'request_id': 'req-bc93728d-541a-446a-a341-050ec281d4b7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:59.265227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bc93728d-541a-446a-a341-050ec281d4b7 admin admin] The token cache is being invalidate because project 938418b980e34cd2b47128ed38499223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:55:59.265545 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bc93728d-541a-446a-a341-050ec281d4b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:59.266593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-bc93728d-541a-446a-a341-050ec281d4b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:55:59.269774 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1080/2151] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:55:58 2022] DELETE /identity/v3/projects/938418b980e34cd2b47128ed38499223 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:55:59.274812 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d841f5-932b-4f05-a0d0-b0cc0e937953 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:59.278824 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d841f5-932b-4f05-a0d0-b0cc0e937953 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:59.278824 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d841f5-932b-4f05-a0d0-b0cc0e937953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:59.318287 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c6d841f5-932b-4f05-a0d0-b0cc0e937953 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:59.320304 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c6d841f5-932b-4f05-a0d0-b0cc0e937953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:59.440365 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1072/2152] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:59.450145 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a63567-63d9-44ba-908c-865185a422f5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:59.450533 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a63567-63d9-44ba-908c-865185a422f5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:59.450839 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a63567-63d9-44ba-908c-865185a422f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:59.476903 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f9a63567-63d9-44ba-908c-865185a422f5 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:59.490668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f9a63567-63d9-44ba-908c-865185a422f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:59.491729 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1081/2153] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:59.496534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d841f5-932b-4f05-a0d0-b0cc0e937953 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:59.516890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d841f5-932b-4f05-a0d0-b0cc0e937953 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:59.523305 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c0115-df46-4f71-8fc3-e2df3844ca36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:59.523995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c0115-df46-4f71-8fc3-e2df3844ca36 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:59.524283 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c0115-df46-4f71-8fc3-e2df3844ca36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:59.524565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c0115-df46-4f71-8fc3-e2df3844ca36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:59.525564 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c0115-df46-4f71-8fc3-e2df3844ca36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:55:59.525913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c0115-df46-4f71-8fc3-e2df3844ca36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:59.527513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c0115-df46-4f71-8fc3-e2df3844ca36 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:59.546147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a63567-63d9-44ba-908c-865185a422f5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:59.555893 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1073/2154] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:55:59.558463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a63567-63d9-44ba-908c-865185a422f5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:59.563487 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c61496-a61d-475b-8bdf-f0fe33013396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:59.564168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c61496-a61d-475b-8bdf-f0fe33013396 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:59.564470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c61496-a61d-475b-8bdf-f0fe33013396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:59.564743 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c61496-a61d-475b-8bdf-f0fe33013396 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:59.565526 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c61496-a61d-475b-8bdf-f0fe33013396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:59.567687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c61496-a61d-475b-8bdf-f0fe33013396 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:59.698326 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1082/2155] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:55:59 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:55:59.702602 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c0115-df46-4f71-8fc3-e2df3844ca36 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:59.717757 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c0115-df46-4f71-8fc3-e2df3844ca36 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:59.743995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:59.848373 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9926a5-e9be-4da9-97d9-1b22da14138f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:59.849060 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9926a5-e9be-4da9-97d9-1b22da14138f admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:59.849385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9926a5-e9be-4da9-97d9-1b22da14138f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:59.849665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9926a5-e9be-4da9-97d9-1b22da14138f admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:59.850375 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9926a5-e9be-4da9-97d9-1b22da14138f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:59.853114 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9926a5-e9be-4da9-97d9-1b22da14138f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:59.964729 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1074/2156] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:55:59 2022] POST /identity/v3/users => generated 290 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:55:59.970759 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c61496-a61d-475b-8bdf-f0fe33013396 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:55:59.983045 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c61496-a61d-475b-8bdf-f0fe33013396 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:55:59.989826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050c37a-d7b5-4968-a9a0-3f11dbc6348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:55:59.990824 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050c37a-d7b5-4968-a9a0-3f11dbc6348f admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:59.991341 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050c37a-d7b5-4968-a9a0-3f11dbc6348f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:59.991781 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050c37a-d7b5-4968-a9a0-3f11dbc6348f admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:59.992532 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050c37a-d7b5-4968-a9a0-3f11dbc6348f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:55:59.994800 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050c37a-d7b5-4968-a9a0-3f11dbc6348f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:55:59.996372 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:00.015916 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1083/2157] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:56:00.020869 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9926a5-e9be-4da9-97d9-1b22da14138f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:00.034379 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9926a5-e9be-4da9-97d9-1b22da14138f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:00.041125 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2575910-c5a6-4a13-bc95-ee483f5e9de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:00.042317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2575910-c5a6-4a13-bc95-ee483f5e9de9 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:00.042901 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2575910-c5a6-4a13-bc95-ee483f5e9de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:00.043577 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2575910-c5a6-4a13-bc95-ee483f5e9de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:00.044526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2575910-c5a6-4a13-bc95-ee483f5e9de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:00.046573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2575910-c5a6-4a13-bc95-ee483f5e9de9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:00.062799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1075/2158] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:56:00.068993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050c37a-d7b5-4968-a9a0-3f11dbc6348f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:00.098872 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050c37a-d7b5-4968-a9a0-3f11dbc6348f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:00.119629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac8a99-511e-4ecd-9542-250b3a27575d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:00.140721 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac8a99-511e-4ecd-9542-250b3a27575d admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:00.140721 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac8a99-511e-4ecd-9542-250b3a27575d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:00.140721 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac8a99-511e-4ecd-9542-250b3a27575d admin admin] PATH_INFO: `/v3/projects/895a592d480548ddb6afdb1e7c45ed92/users/5d6ddab73db44710bcb5bba4c0cfbcfa/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:00.145964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2575910-c5a6-4a13-bc95-ee483f5e9de9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:00.149318 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d2575910-c5a6-4a13-bc95-ee483f5e9de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:00.162817 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac8a99-511e-4ecd-9542-250b3a27575d admin admin] RBAC: Authorizing `identity:create_grant(project_id=895a592d480548ddb6afdb1e7c45ed92, user_id=5d6ddab73db44710bcb5bba4c0cfbcfa, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:00.166416 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac8a99-511e-4ecd-9542-250b3a27575d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:00.169695 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2575910-c5a6-4a13-bc95-ee483f5e9de9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:00.177642 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac73e90-3216-4140-b2d6-e4162d33463c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:00.179566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac73e90-3216-4140-b2d6-e4162d33463c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:00.180103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac73e90-3216-4140-b2d6-e4162d33463c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:00.180799 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac73e90-3216-4140-b2d6-e4162d33463c admin admin] PATH_INFO: `/v3/users/3317d7d8d0bf4b2087e89de85c7e2c7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:00.184571 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac73e90-3216-4140-b2d6-e4162d33463c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3317d7d8d0bf4b2087e89de85c7e2c7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:00.189787 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac73e90-3216-4140-b2d6-e4162d33463c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:00.293842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1084/2159] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:56:00 2022] PUT /identity/v3/projects/895a592d480548ddb6afdb1e7c45ed92/users/5d6ddab73db44710bcb5bba4c0cfbcfa/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:56:00.293842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc34548-7efd-4fad-b3ba-d43d885d7a90 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:00.293842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc34548-7efd-4fad-b3ba-d43d885d7a90 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:00.294578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc34548-7efd-4fad-b3ba-d43d885d7a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:00.332456 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4fc34548-7efd-4fad-b3ba-d43d885d7a90 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:00.333870 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4fc34548-7efd-4fad-b3ba-d43d885d7a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:00.417307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1085/2160] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:00.430148 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc34548-7efd-4fad-b3ba-d43d885d7a90 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:00.432250 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4fc34548-7efd-4fad-b3ba-d43d885d7a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:00.432603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5ac73e90-3216-4140-b2d6-e4162d33463c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3317d7d8d0bf4b2087e89de85c7e2c7e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:00.498388 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc34548-7efd-4fad-b3ba-d43d885d7a90 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:00.503048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce314d5-6f49-4986-8c16-612969b09aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:00.503890 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce314d5-6f49-4986-8c16-612969b09aba service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:00.504152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce314d5-6f49-4986-8c16-612969b09aba service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:00.504442 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce314d5-6f49-4986-8c16-612969b09aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:00.515855 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce314d5-6f49-4986-8c16-612969b09aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:00.517333 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce314d5-6f49-4986-8c16-612969b09aba service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:00.531254 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1086/2161] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:56:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:56:00.542164 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5ac73e90-3216-4140-b2d6-e4162d33463c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3317d7d8d0bf4b2087e89de85c7e2c7e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:00.543576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5ac73e90-3216-4140-b2d6-e4162d33463c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3317d7d8d0bf4b2087e89de85c7e2c7e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:00.544881 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5ac73e90-3216-4140-b2d6-e4162d33463c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3317d7d8d0bf4b2087e89de85c7e2c7e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:00.558112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5ac73e90-3216-4140-b2d6-e4162d33463c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3317d7d8d0bf4b2087e89de85c7e2c7e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:00.593754 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1076/2162] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:56:00 2022] DELETE /identity/v3/users/3317d7d8d0bf4b2087e89de85c7e2c7e => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:56:00.599015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1f269-1790-4640-b7da-06cd8ec32bab None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:00.599307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1f269-1790-4640-b7da-06cd8ec32bab None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:00.599591 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1f269-1790-4640-b7da-06cd8ec32bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:00.620400 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e6a1f269-1790-4640-b7da-06cd8ec32bab None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:00.622274 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e6a1f269-1790-4640-b7da-06cd8ec32bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:00.739569 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1087/2163] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:00.752050 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac73e90-3216-4140-b2d6-e4162d33463c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:00.755318 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5ac73e90-3216-4140-b2d6-e4162d33463c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:00.850679 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac73e90-3216-4140-b2d6-e4162d33463c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:00.857112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd60fc1-cfa2-45b8-86c0-692907d215dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:00.858299 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd60fc1-cfa2-45b8-86c0-692907d215dc service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:00.858800 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd60fc1-cfa2-45b8-86c0-692907d215dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:00.859313 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd60fc1-cfa2-45b8-86c0-692907d215dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:00.876837 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd60fc1-cfa2-45b8-86c0-692907d215dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:00.878434 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd60fc1-cfa2-45b8-86c0-692907d215dc service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:00.898584 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1077/2164] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:56:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:02.659485 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1f269-1790-4640-b7da-06cd8ec32bab None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:02.661582 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e6a1f269-1790-4640-b7da-06cd8ec32bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:02.730808 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1f269-1790-4640-b7da-06cd8ec32bab None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:02.760446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb926e-3e4b-4d61-9e03-9b91ad11e0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:02.762164 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb926e-3e4b-4d61-9e03-9b91ad11e0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:02.762669 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb926e-3e4b-4d61-9e03-9b91ad11e0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:02.763165 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb926e-3e4b-4d61-9e03-9b91ad11e0c9 admin admin] PATH_INFO: `/v3/projects/e8f219c4e3a54d03bb75aee0b23ec1d3` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:02.766791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb926e-3e4b-4d61-9e03-9b91ad11e0c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f219c4e3a54d03bb75aee0b23ec1d3)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:02.771979 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb926e-3e4b-4d61-9e03-9b91ad11e0c9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:02.817837 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:03.024232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e4cb926e-3e4b-4d61-9e03-9b91ad11e0c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f219c4e3a54d03bb75aee0b23ec1d3', 'request_id': 'req-e4cb926e-3e4b-4d61-9e03-9b91ad11e0c9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:03.182415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e4cb926e-3e4b-4d61-9e03-9b91ad11e0c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f219c4e3a54d03bb75aee0b23ec1d3', 'request_id': 'req-e4cb926e-3e4b-4d61-9e03-9b91ad11e0c9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:03.231789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e4cb926e-3e4b-4d61-9e03-9b91ad11e0c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f219c4e3a54d03bb75aee0b23ec1d3', 'request_id': 'req-e4cb926e-3e4b-4d61-9e03-9b91ad11e0c9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:03.260037 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e4cb926e-3e4b-4d61-9e03-9b91ad11e0c9 admin admin] The token cache is being invalidate because project e8f219c4e3a54d03bb75aee0b23ec1d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:56:03.260480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e4cb926e-3e4b-4d61-9e03-9b91ad11e0c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:03.261311 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e4cb926e-3e4b-4d61-9e03-9b91ad11e0c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:03.265349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1088/2165] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:56:02 2022] DELETE /identity/v3/projects/e8f219c4e3a54d03bb75aee0b23ec1d3 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:56:03.268842 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd60fc1-cfa2-45b8-86c0-692907d215dc service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:03.306231 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd60fc1-cfa2-45b8-86c0-692907d215dc service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:03.335928 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:03.437960 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7964d31-2a43-4830-b276-a0d8bc6c5bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:03.439124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7964d31-2a43-4830-b276-a0d8bc6c5bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:03.439702 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7964d31-2a43-4830-b276-a0d8bc6c5bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:03.440135 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7964d31-2a43-4830-b276-a0d8bc6c5bb7 admin admin] PATH_INFO: `/v3/users/bbaec484e1344e8d83070f80096dee6e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:03.443171 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7964d31-2a43-4830-b276-a0d8bc6c5bb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbaec484e1344e8d83070f80096dee6e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:03.448338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7964d31-2a43-4830-b276-a0d8bc6c5bb7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:03.740519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a7964d31-2a43-4830-b276-a0d8bc6c5bb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbaec484e1344e8d83070f80096dee6e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:03.815796 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a7964d31-2a43-4830-b276-a0d8bc6c5bb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbaec484e1344e8d83070f80096dee6e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:03.816724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a7964d31-2a43-4830-b276-a0d8bc6c5bb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbaec484e1344e8d83070f80096dee6e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:03.817514 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a7964d31-2a43-4830-b276-a0d8bc6c5bb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbaec484e1344e8d83070f80096dee6e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:03.838094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a7964d31-2a43-4830-b276-a0d8bc6c5bb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbaec484e1344e8d83070f80096dee6e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:03.874453 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1078/2166] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:56:03 2022] DELETE /identity/v3/users/bbaec484e1344e8d83070f80096dee6e => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:56:04.605299 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb926e-3e4b-4d61-9e03-9b91ad11e0c9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:04.607701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e4cb926e-3e4b-4d61-9e03-9b91ad11e0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:04.658071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb926e-3e4b-4d61-9e03-9b91ad11e0c9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:04.819121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d92ec-ab85-4adc-82f3-e6575fe3950b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:04.820943 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d92ec-ab85-4adc-82f3-e6575fe3950b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:04.821388 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d92ec-ab85-4adc-82f3-e6575fe3950b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:04.821872 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d92ec-ab85-4adc-82f3-e6575fe3950b admin admin] PATH_INFO: `/v3/projects/f4a33c8610874f76ba820b4ec080d910` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:04.832857 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d92ec-ab85-4adc-82f3-e6575fe3950b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4a33c8610874f76ba820b4ec080d910)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:04.836099 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d92ec-ab85-4adc-82f3-e6575fe3950b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:04.987232 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-367d92ec-ab85-4adc-82f3-e6575fe3950b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4a33c8610874f76ba820b4ec080d910', 'request_id': 'req-367d92ec-ab85-4adc-82f3-e6575fe3950b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:05.098438 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-367d92ec-ab85-4adc-82f3-e6575fe3950b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4a33c8610874f76ba820b4ec080d910', 'request_id': 'req-367d92ec-ab85-4adc-82f3-e6575fe3950b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:05.114953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-367d92ec-ab85-4adc-82f3-e6575fe3950b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4a33c8610874f76ba820b4ec080d910', 'request_id': 'req-367d92ec-ab85-4adc-82f3-e6575fe3950b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:05.130416 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-367d92ec-ab85-4adc-82f3-e6575fe3950b admin admin] The token cache is being invalidate because project f4a33c8610874f76ba820b4ec080d910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:56:05.130755 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-367d92ec-ab85-4adc-82f3-e6575fe3950b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:05.131460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-367d92ec-ab85-4adc-82f3-e6575fe3950b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:05.133908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1089/2167] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:56:04 2022] DELETE /identity/v3/projects/f4a33c8610874f76ba820b4ec080d910 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:56:05.143197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ab5a2-4d95-43c3-8d6b-7431eba783a8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:05.144066 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ab5a2-4d95-43c3-8d6b-7431eba783a8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:05.144066 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ab5a2-4d95-43c3-8d6b-7431eba783a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:05.162677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-960ab5a2-4d95-43c3-8d6b-7431eba783a8 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:05.164405 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-960ab5a2-4d95-43c3-8d6b-7431eba783a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:05.264226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1079/2168] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:05.267525 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9172590-a06e-4a38-a3ae-f8c5b5047445 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:05.268727 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9172590-a06e-4a38-a3ae-f8c5b5047445 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:05.269478 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9172590-a06e-4a38-a3ae-f8c5b5047445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:05.305038 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f9172590-a06e-4a38-a3ae-f8c5b5047445 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:05.306348 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f9172590-a06e-4a38-a3ae-f8c5b5047445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:05.323056 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1090/2169] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:05.324877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ab5a2-4d95-43c3-8d6b-7431eba783a8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:05.347206 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ab5a2-4d95-43c3-8d6b-7431eba783a8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:05.363301 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b038b2-e1f1-4a8f-b34a-cadb3e2de06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:05.363301 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b038b2-e1f1-4a8f-b34a-cadb3e2de06f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:05.363301 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b038b2-e1f1-4a8f-b34a-cadb3e2de06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:05.363301 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b038b2-e1f1-4a8f-b34a-cadb3e2de06f admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:05.363659 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b038b2-e1f1-4a8f-b34a-cadb3e2de06f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:56:05.363745 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b038b2-e1f1-4a8f-b34a-cadb3e2de06f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:05.367708 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b038b2-e1f1-4a8f-b34a-cadb3e2de06f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:05.397580 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1080/2170] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:56:05.400225 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9172590-a06e-4a38-a3ae-f8c5b5047445 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:05.418807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9172590-a06e-4a38-a3ae-f8c5b5047445 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:05.435077 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed8279-e622-405b-a4b4-02f25be48343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:05.436340 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed8279-e622-405b-a4b4-02f25be48343 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:05.436750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed8279-e622-405b-a4b4-02f25be48343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:05.437236 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed8279-e622-405b-a4b4-02f25be48343 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:05.438718 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed8279-e622-405b-a4b4-02f25be48343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:05.442827 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed8279-e622-405b-a4b4-02f25be48343 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:05.573853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:05.590567 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1091/2171] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:56:05 2022] POST /identity/v3/projects => generated 371 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:56:05.592874 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b038b2-e1f1-4a8f-b34a-cadb3e2de06f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:05.607323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b038b2-e1f1-4a8f-b34a-cadb3e2de06f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:05.648391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:05.803876 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def26f8-8937-43c2-be90-7fb295481839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:05.805060 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def26f8-8937-43c2-be90-7fb295481839 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:05.805599 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def26f8-8937-43c2-be90-7fb295481839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:05.806098 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def26f8-8937-43c2-be90-7fb295481839 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:05.809023 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def26f8-8937-43c2-be90-7fb295481839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:05.815587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def26f8-8937-43c2-be90-7fb295481839 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:05.952125 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1081/2172] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:56:05 2022] POST /identity/v3/users => generated 286 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:56:05.956548 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed8279-e622-405b-a4b4-02f25be48343 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:05.978653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed8279-e622-405b-a4b4-02f25be48343 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:05.988015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9a8d1-b765-4bdd-9d91-20e1e9960aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:05.989252 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9a8d1-b765-4bdd-9d91-20e1e9960aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:05.989799 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9a8d1-b765-4bdd-9d91-20e1e9960aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:05.990313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9a8d1-b765-4bdd-9d91-20e1e9960aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:05.992109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9a8d1-b765-4bdd-9d91-20e1e9960aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:05.995486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9a8d1-b765-4bdd-9d91-20e1e9960aa9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:06.026178 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1092/2173] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:56:06.035449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def26f8-8937-43c2-be90-7fb295481839 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:06.052251 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def26f8-8937-43c2-be90-7fb295481839 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:06.057498 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfc3da-b301-4f6c-a2ec-030b82d6a5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:06.058464 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfc3da-b301-4f6c-a2ec-030b82d6a5dd admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:06.058876 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfc3da-b301-4f6c-a2ec-030b82d6a5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:06.073107 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfc3da-b301-4f6c-a2ec-030b82d6a5dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:06.073107 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfc3da-b301-4f6c-a2ec-030b82d6a5dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:06.073107 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfc3da-b301-4f6c-a2ec-030b82d6a5dd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:06.087160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1082/2174] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:56:06.089060 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9a8d1-b765-4bdd-9d91-20e1e9960aa9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:06.128002 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9a8d1-b765-4bdd-9d91-20e1e9960aa9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:06.136072 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fd294-245c-4b89-9ff3-b3cb41d3da58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:06.139127 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fd294-245c-4b89-9ff3-b3cb41d3da58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:06.139127 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fd294-245c-4b89-9ff3-b3cb41d3da58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:06.139127 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fd294-245c-4b89-9ff3-b3cb41d3da58 admin admin] PATH_INFO: `/v3/projects/898a9ebd67534591a5eaba4848d08614/users/ab9c7d630110499897e117706876a66e/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:06.172868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fd294-245c-4b89-9ff3-b3cb41d3da58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=898a9ebd67534591a5eaba4848d08614, user_id=ab9c7d630110499897e117706876a66e, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:06.175929 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fd294-245c-4b89-9ff3-b3cb41d3da58 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:06.245486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1093/2175] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:56:06 2022] PUT /identity/v3/projects/898a9ebd67534591a5eaba4848d08614/users/ab9c7d630110499897e117706876a66e/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:56:06.273165 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d904219-4b9d-49e6-9c65-d74bd0f25117 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:06.275192 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d904219-4b9d-49e6-9c65-d74bd0f25117 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:06.275488 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d904219-4b9d-49e6-9c65-d74bd0f25117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:06.347341 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7d904219-4b9d-49e6-9c65-d74bd0f25117 None None] MFA Rules not processed for user `ab9c7d630110499897e117706876a66e`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:06.352138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7d904219-4b9d-49e6-9c65-d74bd0f25117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:06.472026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1083/2176] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:56:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:06.488884 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fd294-245c-4b89-9ff3-b3cb41d3da58 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:06.492226 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4f5fd294-245c-4b89-9ff3-b3cb41d3da58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:06.594361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fd294-245c-4b89-9ff3-b3cb41d3da58 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:06.603764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029e2a2-1d81-4282-8262-ff04fa25a9c7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7701907eb3b24c3681352c91ad6a3aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:06.606114 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029e2a2-1d81-4282-8262-ff04fa25a9c7 service glance] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:06.606316 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029e2a2-1d81-4282-8262-ff04fa25a9c7 service glance] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:06.606777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029e2a2-1d81-4282-8262-ff04fa25a9c7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:06.628566 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029e2a2-1d81-4282-8262-ff04fa25a9c7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:06.631259 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029e2a2-1d81-4282-8262-ff04fa25a9c7 service glance] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:06.647255 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1094/2177] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:56:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:56:10.372639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5251fd1-a6d4-4c90-9c9a-c7c9298edea2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:10.373481 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5251fd1-a6d4-4c90-9c9a-c7c9298edea2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:10.373976 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5251fd1-a6d4-4c90-9c9a-c7c9298edea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:10.418969 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f5251fd1-a6d4-4c90-9c9a-c7c9298edea2 None None] MFA Rules not processed for user `5d6ddab73db44710bcb5bba4c0cfbcfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:10.420265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f5251fd1-a6d4-4c90-9c9a-c7c9298edea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:10.565230 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1084/2178] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:56:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:10.571591 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029e2a2-1d81-4282-8262-ff04fa25a9c7 service glance] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:10.574074 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7029e2a2-1d81-4282-8262-ff04fa25a9c7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:10.664918 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029e2a2-1d81-4282-8262-ff04fa25a9c7 service glance] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:10.670715 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bc2b0-bac1-47e7-aed8-b56e63748ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:10.671408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bc2b0-bac1-47e7-aed8-b56e63748ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:10.671700 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bc2b0-bac1-47e7-aed8-b56e63748ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:10.671973 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bc2b0-bac1-47e7-aed8-b56e63748ba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:10.672681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bc2b0-bac1-47e7-aed8-b56e63748ba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:10.674963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bc2b0-bac1-47e7-aed8-b56e63748ba0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:10.792614 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1095/2179] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:56:10 2022] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:56:10.795499 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5251fd1-a6d4-4c90-9c9a-c7c9298edea2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:10.816668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5251fd1-a6d4-4c90-9c9a-c7c9298edea2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:10.851997 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:10.973317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa83676-b456-487a-9c8a-d948ce68fd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:10.979961 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa83676-b456-487a-9c8a-d948ce68fd21 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:10.980391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa83676-b456-487a-9c8a-d948ce68fd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:10.981068 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa83676-b456-487a-9c8a-d948ce68fd21 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:10.982276 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa83676-b456-487a-9c8a-d948ce68fd21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:10.987475 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa83676-b456-487a-9c8a-d948ce68fd21 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:11.129368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1085/2180] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:56:10 2022] POST /identity/v3/users => generated 296 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:56:11.133179 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bc2b0-bac1-47e7-aed8-b56e63748ba0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:11.159475 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bc2b0-bac1-47e7-aed8-b56e63748ba0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:11.166043 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892af2a9-262e-4038-900b-4d3b147da3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:11.167813 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892af2a9-262e-4038-900b-4d3b147da3cc admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:11.167813 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892af2a9-262e-4038-900b-4d3b147da3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:11.167813 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892af2a9-262e-4038-900b-4d3b147da3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:11.168486 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892af2a9-262e-4038-900b-4d3b147da3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:11.170417 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892af2a9-262e-4038-900b-4d3b147da3cc admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:11.183685 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1096/2181] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:56:11.188721 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa83676-b456-487a-9c8a-d948ce68fd21 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:11.219936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa83676-b456-487a-9c8a-d948ce68fd21 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:11.239327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677e227-a463-450b-a2c8-739f56dd2afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:11.240562 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677e227-a463-450b-a2c8-739f56dd2afc admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:11.241732 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677e227-a463-450b-a2c8-739f56dd2afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:11.242161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677e227-a463-450b-a2c8-739f56dd2afc admin admin] PATH_INFO: `/v3/projects/dfa05196b0ec476999a9fd16c8307540/users/612d49337e10458792f7d999918e9547/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:11.280444 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677e227-a463-450b-a2c8-739f56dd2afc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa05196b0ec476999a9fd16c8307540, user_id=612d49337e10458792f7d999918e9547, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:11.284082 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677e227-a463-450b-a2c8-739f56dd2afc admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:11.367871 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1086/2182] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:56:11 2022] PUT /identity/v3/projects/dfa05196b0ec476999a9fd16c8307540/users/612d49337e10458792f7d999918e9547/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:56:11.372041 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892af2a9-262e-4038-900b-4d3b147da3cc admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:11.388188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892af2a9-262e-4038-900b-4d3b147da3cc admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:11.468860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:11.500364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39219c-99ff-4522-a987-b8f7b32e50e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:11.501183 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39219c-99ff-4522-a987-b8f7b32e50e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:11.501549 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39219c-99ff-4522-a987-b8f7b32e50e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:11.501944 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39219c-99ff-4522-a987-b8f7b32e50e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:11.502711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39219c-99ff-4522-a987-b8f7b32e50e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:11.506919 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39219c-99ff-4522-a987-b8f7b32e50e6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:11.532760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1097/2183] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:56:11.534571 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677e227-a463-450b-a2c8-739f56dd2afc admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:11.557816 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677e227-a463-450b-a2c8-739f56dd2afc admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:11.573659 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b25729-47d3-451b-8b37-4bb854969433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:11.574921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b25729-47d3-451b-8b37-4bb854969433 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:11.575301 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b25729-47d3-451b-8b37-4bb854969433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:11.575742 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b25729-47d3-451b-8b37-4bb854969433 admin admin] PATH_INFO: `/v3/projects/dfa05196b0ec476999a9fd16c8307540/users/612d49337e10458792f7d999918e9547/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:11.578861 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b25729-47d3-451b-8b37-4bb854969433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa05196b0ec476999a9fd16c8307540, user_id=612d49337e10458792f7d999918e9547, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:11.583913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b25729-47d3-451b-8b37-4bb854969433 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:11.613541 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1087/2184] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:56:11 2022] PUT /identity/v3/projects/dfa05196b0ec476999a9fd16c8307540/users/612d49337e10458792f7d999918e9547/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:56:17.580676 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ae76a-a3bc-4595-91b1-11769da6d1b4 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:17.581664 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ae76a-a3bc-4595-91b1-11769da6d1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:17.581664 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ae76a-a3bc-4595-91b1-11769da6d1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:17.614469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1a9ae76a-a3bc-4595-91b1-11769da6d1b4 None None] MFA Rules not processed for user `14b1aff9e40a44dbabe2766d3e51f914`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:17.616881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1a9ae76a-a3bc-4595-91b1-11769da6d1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:17.743023 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1098/2185] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:56:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:21.397897 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b25729-47d3-451b-8b37-4bb854969433 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:21.400573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-33b25729-47d3-451b-8b37-4bb854969433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:21.771329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575caa9-fefe-4fc8-a4f3-19b38c1e8837 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:21.772773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575caa9-fefe-4fc8-a4f3-19b38c1e8837 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:21.773480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575caa9-fefe-4fc8-a4f3-19b38c1e8837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:21.783613 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b25729-47d3-451b-8b37-4bb854969433 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:21.800658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf064cb-e637-4c58-96f0-c5927dfa8c5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beeefb9b8d394407a5e7a32f5a00ffad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:21.801470 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf064cb-e637-4c58-96f0-c5927dfa8c5f service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:21.802353 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf064cb-e637-4c58-96f0-c5927dfa8c5f service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:21.806449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf064cb-e637-4c58-96f0-c5927dfa8c5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:21.811278 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8cf064cb-e637-4c58-96f0-c5927dfa8c5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:21.868308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf064cb-e637-4c58-96f0-c5927dfa8c5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:21.872202 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf064cb-e637-4c58-96f0-c5927dfa8c5f service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:21.894842 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1088/2186] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:56:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:21.915568 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f575caa9-fefe-4fc8-a4f3-19b38c1e8837 None None] MFA Rules not processed for user `4d2ab3eeb5b44979956dd223ac6b7c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:21.919258 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f575caa9-fefe-4fc8-a4f3-19b38c1e8837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:22.053765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1099/2187] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 16:56:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:56:22.152184 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf064cb-e637-4c58-96f0-c5927dfa8c5f service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:22.155000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8cf064cb-e637-4c58-96f0-c5927dfa8c5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:22.272735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:22.355484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf064cb-e637-4c58-96f0-c5927dfa8c5f service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:22.370519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d3596-f766-44f7-8948-beae4f3cceb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cc455638fb4db4939af3657ab4203e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:22.371494 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d3596-f766-44f7-8948-beae4f3cceb4 service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:22.371790 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d3596-f766-44f7-8948-beae4f3cceb4 service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:22.372128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d3596-f766-44f7-8948-beae4f3cceb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:22.391615 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d3596-f766-44f7-8948-beae4f3cceb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:22.393801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d3596-f766-44f7-8948-beae4f3cceb4 service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:22.407006 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1089/2188] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 16:56:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:56:22.910137 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575caa9-fefe-4fc8-a4f3-19b38c1e8837 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:22.911831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f575caa9-fefe-4fc8-a4f3-19b38c1e8837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:23.090460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:23.098745 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575caa9-fefe-4fc8-a4f3-19b38c1e8837 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:23.106833 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af86070-2163-4397-a3e3-dd3e1bdb8803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:23.107878 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af86070-2163-4397-a3e3-dd3e1bdb8803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:23.108267 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af86070-2163-4397-a3e3-dd3e1bdb8803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:23.109140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af86070-2163-4397-a3e3-dd3e1bdb8803 admin admin] PATH_INFO: `/v3/users/75e7a352b8ea4868a12fa64a24d7a51c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:23.110930 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af86070-2163-4397-a3e3-dd3e1bdb8803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75e7a352b8ea4868a12fa64a24d7a51c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:23.113949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af86070-2163-4397-a3e3-dd3e1bdb8803 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:23.590400 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5af86070-2163-4397-a3e3-dd3e1bdb8803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75e7a352b8ea4868a12fa64a24d7a51c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:23.592167 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5af86070-2163-4397-a3e3-dd3e1bdb8803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75e7a352b8ea4868a12fa64a24d7a51c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:23.646196 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5af86070-2163-4397-a3e3-dd3e1bdb8803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75e7a352b8ea4868a12fa64a24d7a51c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:23.724276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5af86070-2163-4397-a3e3-dd3e1bdb8803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75e7a352b8ea4868a12fa64a24d7a51c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:23.725809 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5af86070-2163-4397-a3e3-dd3e1bdb8803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75e7a352b8ea4868a12fa64a24d7a51c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:23.807667 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1100/2189] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:56:22 2022] DELETE /identity/v3/users/75e7a352b8ea4868a12fa64a24d7a51c => generated 0 bytes in 896 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:56:23.810634 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a45645-206d-4cfc-b876-7d49c1c61233 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:23.811568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a45645-206d-4cfc-b876-7d49c1c61233 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:23.811568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a45645-206d-4cfc-b876-7d49c1c61233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:23.862304 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-70a45645-206d-4cfc-b876-7d49c1c61233 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:23.863582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-70a45645-206d-4cfc-b876-7d49c1c61233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:24.052420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1090/2190] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:24.109596 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af86070-2163-4397-a3e3-dd3e1bdb8803 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:24.114295 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5af86070-2163-4397-a3e3-dd3e1bdb8803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:24.351999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af86070-2163-4397-a3e3-dd3e1bdb8803 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:24.382322 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938c9ca-8f03-4f10-9769-195085b42bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:24.383405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938c9ca-8f03-4f10-9769-195085b42bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:24.383907 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938c9ca-8f03-4f10-9769-195085b42bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:24.384434 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938c9ca-8f03-4f10-9769-195085b42bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:24.419325 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938c9ca-8f03-4f10-9769-195085b42bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:24.421449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938c9ca-8f03-4f10-9769-195085b42bc5 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:24.435297 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1101/2191] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:24.735439 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e8874-250b-4481-9a80-170cefc8ed41 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:24.735974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e8874-250b-4481-9a80-170cefc8ed41 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:24.736431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e8874-250b-4481-9a80-170cefc8ed41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:24.943185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-717e8874-250b-4481-9a80-170cefc8ed41 None None] MFA Rules not processed for user `612d49337e10458792f7d999918e9547`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:24.954404 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-717e8874-250b-4481-9a80-170cefc8ed41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:25.114934 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1091/2192] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:56:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:25.153813 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938c9ca-8f03-4f10-9769-195085b42bc5 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:25.155535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b938c9ca-8f03-4f10-9769-195085b42bc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:25.326609 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938c9ca-8f03-4f10-9769-195085b42bc5 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:25.336039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea173a2b-30b4-4eeb-9ea3-6270dc3e1dbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:25.336952 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea173a2b-30b4-4eeb-9ea3-6270dc3e1dbc service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:25.337239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea173a2b-30b4-4eeb-9ea3-6270dc3e1dbc service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:25.338817 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea173a2b-30b4-4eeb-9ea3-6270dc3e1dbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:25.341112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ea173a2b-30b4-4eeb-9ea3-6270dc3e1dbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:25.381548 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:25.480071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea173a2b-30b4-4eeb-9ea3-6270dc3e1dbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:25.482657 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea173a2b-30b4-4eeb-9ea3-6270dc3e1dbc service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:25.499669 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1102/2193] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:56:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:26.121748 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e8874-250b-4481-9a80-170cefc8ed41 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:26.121748 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-717e8874-250b-4481-9a80-170cefc8ed41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:26.148856 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e8874-250b-4481-9a80-170cefc8ed41 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:26.176532 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3041140-c807-4487-b399-61ee2e10fe2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:26.179331 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3041140-c807-4487-b399-61ee2e10fe2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:26.186452 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3041140-c807-4487-b399-61ee2e10fe2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:26.187131 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3041140-c807-4487-b399-61ee2e10fe2f admin admin] PATH_INFO: `/v3/projects/67723c5356f048a19027682b12081a19` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:26.191391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3041140-c807-4487-b399-61ee2e10fe2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=67723c5356f048a19027682b12081a19)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:26.197432 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3041140-c807-4487-b399-61ee2e10fe2f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:26.396678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:26.401068 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e3041140-c807-4487-b399-61ee2e10fe2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67723c5356f048a19027682b12081a19', 'request_id': 'req-e3041140-c807-4487-b399-61ee2e10fe2f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:26.414410 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e3041140-c807-4487-b399-61ee2e10fe2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67723c5356f048a19027682b12081a19', 'request_id': 'req-e3041140-c807-4487-b399-61ee2e10fe2f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:26.431760 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e3041140-c807-4487-b399-61ee2e10fe2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67723c5356f048a19027682b12081a19', 'request_id': 'req-e3041140-c807-4487-b399-61ee2e10fe2f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:26.541958 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e3041140-c807-4487-b399-61ee2e10fe2f admin admin] The token cache is being invalidate because project 67723c5356f048a19027682b12081a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:56:26.542270 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e3041140-c807-4487-b399-61ee2e10fe2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:26.543608 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e3041140-c807-4487-b399-61ee2e10fe2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:26.550526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1092/2194] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:56:26 2022] DELETE /identity/v3/projects/67723c5356f048a19027682b12081a19 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:56:35.517635 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=21 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:36.773544 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=7,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:47.193704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea173a2b-30b4-4eeb-9ea3-6270dc3e1dbc service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:47.196568 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ea173a2b-30b4-4eeb-9ea3-6270dc3e1dbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:47.212254 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea173a2b-30b4-4eeb-9ea3-6270dc3e1dbc service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:47.295788 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35749c05-7735-472a-beb3-8002b9bc2b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:47.296680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35749c05-7735-472a-beb3-8002b9bc2b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:47.296964 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35749c05-7735-472a-beb3-8002b9bc2b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:47.297241 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35749c05-7735-472a-beb3-8002b9bc2b35 admin admin] PATH_INFO: `/v3/users/ab9c7d630110499897e117706876a66e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:47.298524 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35749c05-7735-472a-beb3-8002b9bc2b35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab9c7d630110499897e117706876a66e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:47.300894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35749c05-7735-472a-beb3-8002b9bc2b35 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:47.467746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-35749c05-7735-472a-beb3-8002b9bc2b35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab9c7d630110499897e117706876a66e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:47.468434 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-35749c05-7735-472a-beb3-8002b9bc2b35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab9c7d630110499897e117706876a66e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:47.478674 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-35749c05-7735-472a-beb3-8002b9bc2b35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab9c7d630110499897e117706876a66e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:47.557723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-35749c05-7735-472a-beb3-8002b9bc2b35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab9c7d630110499897e117706876a66e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:47.558388 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-35749c05-7735-472a-beb3-8002b9bc2b35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab9c7d630110499897e117706876a66e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:47.579370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1103/2195] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:56:47 2022] DELETE /identity/v3/users/ab9c7d630110499897e117706876a66e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:56:47.584006 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e56e3-eed2-412f-885c-b4f49926387c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:47.584558 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e56e3-eed2-412f-885c-b4f49926387c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:47.584894 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e56e3-eed2-412f-885c-b4f49926387c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:47.607809 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-db2e56e3-eed2-412f-885c-b4f49926387c None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:47.609037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-db2e56e3-eed2-412f-885c-b4f49926387c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:47.680560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1093/2196] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:47.692106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35749c05-7735-472a-beb3-8002b9bc2b35 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:47.695251 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-35749c05-7735-472a-beb3-8002b9bc2b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:47.761665 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35749c05-7735-472a-beb3-8002b9bc2b35 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:47.766418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209162f-fdf4-4f1c-95d3-2099715e635a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:47.767124 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209162f-fdf4-4f1c-95d3-2099715e635a service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:47.767414 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209162f-fdf4-4f1c-95d3-2099715e635a service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:47.767694 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209162f-fdf4-4f1c-95d3-2099715e635a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:47.779826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209162f-fdf4-4f1c-95d3-2099715e635a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:47.781213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209162f-fdf4-4f1c-95d3-2099715e635a service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:47.793108 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1104/2197] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:48.256356 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e56e3-eed2-412f-885c-b4f49926387c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:48.258260 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-db2e56e3-eed2-412f-885c-b4f49926387c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:48.272532 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e56e3-eed2-412f-885c-b4f49926387c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:48.277793 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37342f83-ab89-494a-8ab5-5f77f2021d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:48.279114 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37342f83-ab89-494a-8ab5-5f77f2021d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:48.279683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37342f83-ab89-494a-8ab5-5f77f2021d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:48.279968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37342f83-ab89-494a-8ab5-5f77f2021d29 admin admin] PATH_INFO: `/v3/projects/898a9ebd67534591a5eaba4848d08614` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:48.281681 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37342f83-ab89-494a-8ab5-5f77f2021d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=898a9ebd67534591a5eaba4848d08614)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:48.283949 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37342f83-ab89-494a-8ab5-5f77f2021d29 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:48.410576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-37342f83-ab89-494a-8ab5-5f77f2021d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '898a9ebd67534591a5eaba4848d08614', 'request_id': 'req-37342f83-ab89-494a-8ab5-5f77f2021d29'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:48.412832 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-37342f83-ab89-494a-8ab5-5f77f2021d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '898a9ebd67534591a5eaba4848d08614', 'request_id': 'req-37342f83-ab89-494a-8ab5-5f77f2021d29'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:48.420158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-37342f83-ab89-494a-8ab5-5f77f2021d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '898a9ebd67534591a5eaba4848d08614', 'request_id': 'req-37342f83-ab89-494a-8ab5-5f77f2021d29'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:48.506366 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-37342f83-ab89-494a-8ab5-5f77f2021d29 admin admin] The token cache is being invalidate because project 898a9ebd67534591a5eaba4848d08614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:56:48.506652 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-37342f83-ab89-494a-8ab5-5f77f2021d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:48.507343 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-37342f83-ab89-494a-8ab5-5f77f2021d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:56:48.508900 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1094/2198] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:56:48 2022] DELETE /identity/v3/projects/898a9ebd67534591a5eaba4848d08614 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:56:48.515716 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cde3f-20ea-481f-b3ff-7d631eb81697 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:48.516260 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cde3f-20ea-481f-b3ff-7d631eb81697 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:48.516615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cde3f-20ea-481f-b3ff-7d631eb81697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:48.542111 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-562cde3f-20ea-481f-b3ff-7d631eb81697 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:48.544019 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-562cde3f-20ea-481f-b3ff-7d631eb81697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:48.562323 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:48.613479 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1105/2199] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:48.621503 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd227bd-8020-45a5-8c3a-b7e264869111 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:48.622133 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd227bd-8020-45a5-8c3a-b7e264869111 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:48.622283 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd227bd-8020-45a5-8c3a-b7e264869111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:48.644102 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dcd227bd-8020-45a5-8c3a-b7e264869111 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:48.645345 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dcd227bd-8020-45a5-8c3a-b7e264869111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:48.654347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1095/2200] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:48.658663 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cde3f-20ea-481f-b3ff-7d631eb81697 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:48.669492 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cde3f-20ea-481f-b3ff-7d631eb81697 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:48.678348 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f36a7-7d64-4166-b90c-0008164d18a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:48.678348 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f36a7-7d64-4166-b90c-0008164d18a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:48.678348 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f36a7-7d64-4166-b90c-0008164d18a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:48.678348 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f36a7-7d64-4166-b90c-0008164d18a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:48.679665 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f36a7-7d64-4166-b90c-0008164d18a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:56:48.679665 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f36a7-7d64-4166-b90c-0008164d18a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:48.679665 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f36a7-7d64-4166-b90c-0008164d18a1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:48.701862 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1106/2201] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:56:48.708641 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd227bd-8020-45a5-8c3a-b7e264869111 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:48.720304 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd227bd-8020-45a5-8c3a-b7e264869111 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:48.725586 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7cb7c-912d-4530-b8ed-b640f03746c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:48.726253 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7cb7c-912d-4530-b8ed-b640f03746c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:48.726532 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7cb7c-912d-4530-b8ed-b640f03746c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:48.726806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7cb7c-912d-4530-b8ed-b640f03746c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:48.727529 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7cb7c-912d-4530-b8ed-b640f03746c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:48.729551 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7cb7c-912d-4530-b8ed-b640f03746c2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:48.853538 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1096/2202] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:56:48 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:56:48.854777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f36a7-7d64-4166-b90c-0008164d18a1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:48.865126 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f36a7-7d64-4166-b90c-0008164d18a1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:48.927459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73479878-ae65-4e8d-b632-38844b2f4016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:48.928141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73479878-ae65-4e8d-b632-38844b2f4016 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:48.928427 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73479878-ae65-4e8d-b632-38844b2f4016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:48.928705 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73479878-ae65-4e8d-b632-38844b2f4016 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:48.929432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73479878-ae65-4e8d-b632-38844b2f4016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:48.931358 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73479878-ae65-4e8d-b632-38844b2f4016 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:49.018224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1107/2203] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:56:48 2022] POST /identity/v3/users => generated 283 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:56:49.022938 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7cb7c-912d-4530-b8ed-b640f03746c2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:49.034449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7cb7c-912d-4530-b8ed-b640f03746c2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:49.039630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffe59a-0219-4300-b238-4ade1cb634a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:49.040330 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffe59a-0219-4300-b238-4ade1cb634a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:49.040614 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffe59a-0219-4300-b238-4ade1cb634a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:49.040888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffe59a-0219-4300-b238-4ade1cb634a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:49.041672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffe59a-0219-4300-b238-4ade1cb634a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:49.043395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffe59a-0219-4300-b238-4ade1cb634a5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:49.059917 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1097/2204] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:56:49.068588 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73479878-ae65-4e8d-b632-38844b2f4016 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:49.084364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73479878-ae65-4e8d-b632-38844b2f4016 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:49.090417 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a93325-512f-4aa4-a902-9499c8197205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:49.091492 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a93325-512f-4aa4-a902-9499c8197205 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:49.091986 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a93325-512f-4aa4-a902-9499c8197205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:49.092381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a93325-512f-4aa4-a902-9499c8197205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:49.093328 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a93325-512f-4aa4-a902-9499c8197205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:49.095675 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a93325-512f-4aa4-a902-9499c8197205 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:49.114288 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1108/2205] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:56:49.122422 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffe59a-0219-4300-b238-4ade1cb634a5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:49.134633 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffe59a-0219-4300-b238-4ade1cb634a5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:49.139934 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095278d-56c7-4626-940a-1f1761bdd7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:49.141010 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095278d-56c7-4626-940a-1f1761bdd7f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:49.141430 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095278d-56c7-4626-940a-1f1761bdd7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:49.141585 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095278d-56c7-4626-940a-1f1761bdd7f0 admin admin] PATH_INFO: `/v3/projects/be720914e6dd49fc8bf0ec70e5fcd36b/users/96bcbd9f807a47f990e2d0153788df23/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:49.159897 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095278d-56c7-4626-940a-1f1761bdd7f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be720914e6dd49fc8bf0ec70e5fcd36b, user_id=96bcbd9f807a47f990e2d0153788df23, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:49.162973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095278d-56c7-4626-940a-1f1761bdd7f0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:49.238410 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1098/2206] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:56:49 2022] PUT /identity/v3/projects/be720914e6dd49fc8bf0ec70e5fcd36b/users/96bcbd9f807a47f990e2d0153788df23/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:56:49.250247 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb6b06-1b2c-4934-9ce0-b0ab211b9f73 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:49.250627 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb6b06-1b2c-4934-9ce0-b0ab211b9f73 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:49.250927 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb6b06-1b2c-4934-9ce0-b0ab211b9f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:49.279236 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7aeb6b06-1b2c-4934-9ce0-b0ab211b9f73 None None] MFA Rules not processed for user `96bcbd9f807a47f990e2d0153788df23`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:49.280403 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7aeb6b06-1b2c-4934-9ce0-b0ab211b9f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:49.349723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1109/2207] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:56:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:49.361503 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095278d-56c7-4626-940a-1f1761bdd7f0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:49.363555 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1095278d-56c7-4626-940a-1f1761bdd7f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:49.387390 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:49.426304 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095278d-56c7-4626-940a-1f1761bdd7f0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:49.430724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10e496-a356-4a18-8cce-34f54cbf4656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:49.431369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10e496-a356-4a18-8cce-34f54cbf4656 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:49.431652 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10e496-a356-4a18-8cce-34f54cbf4656 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:49.431928 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10e496-a356-4a18-8cce-34f54cbf4656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:49.442217 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10e496-a356-4a18-8cce-34f54cbf4656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:49.444577 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10e496-a356-4a18-8cce-34f54cbf4656 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:49.465361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1099/2208] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:56:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:51.637911 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f036d9-c4c6-4119-b8e4-f3ed37d16a63 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:51.638834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f036d9-c4c6-4119-b8e4-f3ed37d16a63 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:51.639114 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f036d9-c4c6-4119-b8e4-f3ed37d16a63 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:51.640597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1110/2209] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 16:56:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:56:51.652194 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b020cf3-4214-4478-9fc0-c40f06077925 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:51.652865 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b020cf3-4214-4478-9fc0-c40f06077925 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:51.653511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b020cf3-4214-4478-9fc0-c40f06077925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:51.724917 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0b020cf3-4214-4478-9fc0-c40f06077925 None None] MFA Rules not processed for user `35c9fa9c29494ff9b1f749974dca2719`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:51.727316 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0b020cf3-4214-4478-9fc0-c40f06077925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:51.833692 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1100/2210] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 16:56:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:51.845468 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f036d9-c4c6-4119-b8e4-f3ed37d16a63 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:51.847467 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e9f036d9-c4c6-4119-b8e4-f3ed37d16a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:51.877818 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:51.941833 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f036d9-c4c6-4119-b8e4-f3ed37d16a63 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:51.947759 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc642c-956d-4ef2-b52d-969f0e2dc34b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7701907eb3b24c3681352c91ad6a3aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:51.948421 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc642c-956d-4ef2-b52d-969f0e2dc34b service glance] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:51.948709 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc642c-956d-4ef2-b52d-969f0e2dc34b service glance] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:51.949185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc642c-956d-4ef2-b52d-969f0e2dc34b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:51.961150 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc642c-956d-4ef2-b52d-969f0e2dc34b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:51.962852 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc642c-956d-4ef2-b52d-969f0e2dc34b service glance] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:51.976675 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1111/2211] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:56:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:52.245181 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1475cc2-28e1-4304-8f03-f22fb9543758 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:52.245702 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1475cc2-28e1-4304-8f03-f22fb9543758 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:52.246182 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1475cc2-28e1-4304-8f03-f22fb9543758 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:52.247911 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1101/2212] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 16:56:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:56:52.253580 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c5153-4d5a-41c5-a381-b01e271e78a8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:52.253946 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c5153-4d5a-41c5-a381-b01e271e78a8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:52.254316 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c5153-4d5a-41c5-a381-b01e271e78a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:52.283903 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-662c5153-4d5a-41c5-a381-b01e271e78a8 None None] MFA Rules not processed for user `d577b5295f9e4a4388bb6293d1c33d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:52.285289 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-662c5153-4d5a-41c5-a381-b01e271e78a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:52.359191 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1112/2213] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 16:56:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:52.372523 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1475cc2-28e1-4304-8f03-f22fb9543758 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:52.374817 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a1475cc2-28e1-4304-8f03-f22fb9543758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:52.408475 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1475cc2-28e1-4304-8f03-f22fb9543758 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:52.420895 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d5925-31cd-4f39-868c-97d924564e56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:52.420895 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d5925-31cd-4f39-868c-97d924564e56 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:52.420895 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d5925-31cd-4f39-868c-97d924564e56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:52.421351 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d5925-31cd-4f39-868c-97d924564e56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:52.430855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d5925-31cd-4f39-868c-97d924564e56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:52.432526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d5925-31cd-4f39-868c-97d924564e56 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:52.444865 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1102/2214] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:56:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:52.543970 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacefbfe-496c-4efd-b136-e539c3aeb363 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:52.545390 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacefbfe-496c-4efd-b136-e539c3aeb363 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:52.545390 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacefbfe-496c-4efd-b136-e539c3aeb363 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:52.545969 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1113/2215] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 16:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:56:52.553976 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3e9b7-1fea-4657-88e0-1cc3141779f6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:52.554579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3e9b7-1fea-4657-88e0-1cc3141779f6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:52.554975 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3e9b7-1fea-4657-88e0-1cc3141779f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:52.578483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-60e3e9b7-1fea-4657-88e0-1cc3141779f6 None None] MFA Rules not processed for user `35c9fa9c29494ff9b1f749974dca2719`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:52.579726 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-60e3e9b7-1fea-4657-88e0-1cc3141779f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:52.590672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1103/2216] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 16:56:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:52.615656 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacefbfe-496c-4efd-b136-e539c3aeb363 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:52.631651 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacefbfe-496c-4efd-b136-e539c3aeb363 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:52.636268 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9179c-bf27-4ccd-a921-5510f9696ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:52.637191 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9179c-bf27-4ccd-a921-5510f9696ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:52.637613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9179c-bf27-4ccd-a921-5510f9696ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:52.642905 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9179c-bf27-4ccd-a921-5510f9696ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:52.652106 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9179c-bf27-4ccd-a921-5510f9696ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:52.654944 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9179c-bf27-4ccd-a921-5510f9696ee8 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:52.677222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1114/2217] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:56:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:53.477916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490d6c2-fa19-4dbc-9f1f-a08569ff47ff None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:53.478471 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490d6c2-fa19-4dbc-9f1f-a08569ff47ff None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:53.478471 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490d6c2-fa19-4dbc-9f1f-a08569ff47ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:53.497309 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2490d6c2-fa19-4dbc-9f1f-a08569ff47ff None None] MFA Rules not processed for user `1551f28754a64d1d9010ed90b67c5dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:53.498614 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2490d6c2-fa19-4dbc-9f1f-a08569ff47ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:53.560939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1104/2218] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:56:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:58.744662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b68a5-5787-495f-90bc-c66b6c329bcb None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:58.745399 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b68a5-5787-495f-90bc-c66b6c329bcb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:58.745399 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b68a5-5787-495f-90bc-c66b6c329bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:58.763914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-079b68a5-5787-495f-90bc-c66b6c329bcb None None] MFA Rules not processed for user `4d2ab3eeb5b44979956dd223ac6b7c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:58.765142 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-079b68a5-5787-495f-90bc-c66b6c329bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:58.844582 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1115/2219] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 16:56:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:58.861499 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490d6c2-fa19-4dbc-9f1f-a08569ff47ff None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:58.866891 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2490d6c2-fa19-4dbc-9f1f-a08569ff47ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:58.919301 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:58.971849 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490d6c2-fa19-4dbc-9f1f-a08569ff47ff None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:58.986629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38f6c2-4399-403b-9d99-4ebfb50461a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cc455638fb4db4939af3657ab4203e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:58.988804 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38f6c2-4399-403b-9d99-4ebfb50461a3 service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:58.989307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38f6c2-4399-403b-9d99-4ebfb50461a3 service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:58.990750 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38f6c2-4399-403b-9d99-4ebfb50461a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:59.002121 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38f6c2-4399-403b-9d99-4ebfb50461a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:59.007684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38f6c2-4399-403b-9d99-4ebfb50461a3 service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:59.023581 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1105/2220] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 16:56:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:57:00.539390 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6b009-bb36-48e3-849d-a5b0be79526f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:00.540680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6b009-bb36-48e3-849d-a5b0be79526f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:00.541249 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6b009-bb36-48e3-849d-a5b0be79526f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:00.570029 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8cb6b009-bb36-48e3-849d-a5b0be79526f None None] MFA Rules not processed for user `5d6ddab73db44710bcb5bba4c0cfbcfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:00.571729 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8cb6b009-bb36-48e3-849d-a5b0be79526f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:00.674071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1116/2221] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:57:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:04.022404 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf9763-236e-4610-b50c-0c3c4c92e682 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:04.022989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf9763-236e-4610-b50c-0c3c4c92e682 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:04.022989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf9763-236e-4610-b50c-0c3c4c92e682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:04.042177 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-29bf9763-236e-4610-b50c-0c3c4c92e682 None None] MFA Rules not processed for user `4d2ab3eeb5b44979956dd223ac6b7c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:04.043312 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-29bf9763-236e-4610-b50c-0c3c4c92e682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:04.051777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1106/2222] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 16:57:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:04.068321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6b009-bb36-48e3-849d-a5b0be79526f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:04.091908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6b009-bb36-48e3-849d-a5b0be79526f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:04.097869 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c843f-f77a-485c-8191-a3a5b5d360a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cc455638fb4db4939af3657ab4203e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:04.098926 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c843f-f77a-485c-8191-a3a5b5d360a7 service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:04.099200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c843f-f77a-485c-8191-a3a5b5d360a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:04.099645 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c843f-f77a-485c-8191-a3a5b5d360a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:04.105668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:04.110627 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c843f-f77a-485c-8191-a3a5b5d360a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:04.112234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c843f-f77a-485c-8191-a3a5b5d360a7 service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:04.122033 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1117/2223] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 16:57:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:57:14.037302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=23 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:14.203226 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:22.108269 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14f322-0839-4973-a286-fda28b308647 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:22.109353 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14f322-0839-4973-a286-fda28b308647 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:22.109353 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14f322-0839-4973-a286-fda28b308647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:22.131875 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fe14f322-0839-4973-a286-fda28b308647 None None] MFA Rules not processed for user `4d2ab3eeb5b44979956dd223ac6b7c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:22.133298 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fe14f322-0839-4973-a286-fda28b308647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:22.142955 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1107/2224] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 26 16:57:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:22.171082 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c843f-f77a-485c-8191-a3a5b5d360a7 service swift] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:22.192093 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c843f-f77a-485c-8191-a3a5b5d360a7 service swift] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:22.198964 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fc527-9d3d-4b8b-b741-12b92383041f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cc455638fb4db4939af3657ab4203e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:22.199689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fc527-9d3d-4b8b-b741-12b92383041f service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:22.199964 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fc527-9d3d-4b8b-b741-12b92383041f service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:22.200242 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fc527-9d3d-4b8b-b741-12b92383041f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:22.211718 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fc527-9d3d-4b8b-b741-12b92383041f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:22.213631 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fc527-9d3d-4b8b-b741-12b92383041f service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:22.225935 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1118/2225] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 16:57:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:57:25.601627 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59083bdc-e3f1-44ae-bfbf-9383861add41 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:25.601627 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59083bdc-e3f1-44ae-bfbf-9383861add41 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:25.602136 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59083bdc-e3f1-44ae-bfbf-9383861add41 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:25.604448 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1108/2226] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 16:57:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 16:57:25.647107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede5252-f147-4b41-be4f-daf6930bade4 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:25.647675 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede5252-f147-4b41-be4f-daf6930bade4 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:25.648076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede5252-f147-4b41-be4f-daf6930bade4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:25.685240 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fede5252-f147-4b41-be4f-daf6930bade4 None None] MFA Rules not processed for user `beeefb9b8d394407a5e7a32f5a00ffad`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:25.686598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fede5252-f147-4b41-be4f-daf6930bade4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:25.795074 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59083bdc-e3f1-44ae-bfbf-9383861add41 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:25.797976 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-59083bdc-e3f1-44ae-bfbf-9383861add41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:25.799454 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1119/2227] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 16:57:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:25.834157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede5252-f147-4b41-be4f-daf6930bade4 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:25.837016 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fede5252-f147-4b41-be4f-daf6930bade4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:25.861938 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede5252-f147-4b41-be4f-daf6930bade4 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:25.870358 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f51dc5-617b-4ea6-9902-6c38619c992c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beeefb9b8d394407a5e7a32f5a00ffad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:25.871348 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f51dc5-617b-4ea6-9902-6c38619c992c service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:25.871675 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f51dc5-617b-4ea6-9902-6c38619c992c service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:25.871955 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f51dc5-617b-4ea6-9902-6c38619c992c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:25.881805 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f51dc5-617b-4ea6-9902-6c38619c992c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:25.883507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f51dc5-617b-4ea6-9902-6c38619c992c service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:25.894676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59083bdc-e3f1-44ae-bfbf-9383861add41 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:25.895745 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1120/2228] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:57:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:57:25.900647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdd686-a896-43c6-9f91-00344eb6f538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:25.901622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdd686-a896-43c6-9f91-00344eb6f538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:25.901888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdd686-a896-43c6-9f91-00344eb6f538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:25.907508 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdd686-a896-43c6-9f91-00344eb6f538 admin admin] PATH_INFO: `/v3/users/14b1aff9e40a44dbabe2766d3e51f914` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:25.907508 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdd686-a896-43c6-9f91-00344eb6f538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b1aff9e40a44dbabe2766d3e51f914)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:25.907508 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdd686-a896-43c6-9f91-00344eb6f538 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:26.104974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-74bdd686-a896-43c6-9f91-00344eb6f538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b1aff9e40a44dbabe2766d3e51f914'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:26.163083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-74bdd686-a896-43c6-9f91-00344eb6f538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b1aff9e40a44dbabe2766d3e51f914'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:26.163747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-74bdd686-a896-43c6-9f91-00344eb6f538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b1aff9e40a44dbabe2766d3e51f914'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:26.164403 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-74bdd686-a896-43c6-9f91-00344eb6f538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b1aff9e40a44dbabe2766d3e51f914'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:26.172406 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-74bdd686-a896-43c6-9f91-00344eb6f538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b1aff9e40a44dbabe2766d3e51f914'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:26.191628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1109/2229] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:57:25 2022] DELETE /identity/v3/users/14b1aff9e40a44dbabe2766d3e51f914 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:26.713666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f51dc5-617b-4ea6-9902-6c38619c992c service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:26.729666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f51dc5-617b-4ea6-9902-6c38619c992c service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:26.798441 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bef9b2-f762-49be-af3f-6ac7341d150d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:26.799303 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bef9b2-f762-49be-af3f-6ac7341d150d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:26.799579 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bef9b2-f762-49be-af3f-6ac7341d150d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:26.799849 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bef9b2-f762-49be-af3f-6ac7341d150d admin admin] PATH_INFO: `/v3/projects/dc9eb3074bcf4c8eb5ddec86dd21f676` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:26.801090 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bef9b2-f762-49be-af3f-6ac7341d150d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc9eb3074bcf4c8eb5ddec86dd21f676)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:26.803061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bef9b2-f762-49be-af3f-6ac7341d150d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:26.948620 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-86bef9b2-f762-49be-af3f-6ac7341d150d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'request_id': 'req-86bef9b2-f762-49be-af3f-6ac7341d150d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:27.077176 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-86bef9b2-f762-49be-af3f-6ac7341d150d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'request_id': 'req-86bef9b2-f762-49be-af3f-6ac7341d150d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:27.090185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-86bef9b2-f762-49be-af3f-6ac7341d150d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'request_id': 'req-86bef9b2-f762-49be-af3f-6ac7341d150d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:27.104168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:27.120689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-86bef9b2-f762-49be-af3f-6ac7341d150d admin admin] The token cache is being invalidate because project dc9eb3074bcf4c8eb5ddec86dd21f676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:57:27.121065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-86bef9b2-f762-49be-af3f-6ac7341d150d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:27.122070 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-86bef9b2-f762-49be-af3f-6ac7341d150d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:27.124435 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1121/2230] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:57:26 2022] DELETE /identity/v3/projects/dc9eb3074bcf4c8eb5ddec86dd21f676 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:27.131743 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8fdbf-d5e7-44ac-b9c1-cca9354f79f9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:27.132696 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8fdbf-d5e7-44ac-b9c1-cca9354f79f9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:27.132922 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8fdbf-d5e7-44ac-b9c1-cca9354f79f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:27.158139 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1dd8fdbf-d5e7-44ac-b9c1-cca9354f79f9 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:27.159520 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1dd8fdbf-d5e7-44ac-b9c1-cca9354f79f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:27.240945 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1110/2231] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:27.248993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3cfc3-0592-4413-a59a-a8d6ff76f0e1 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:27.249489 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3cfc3-0592-4413-a59a-a8d6ff76f0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:27.249792 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3cfc3-0592-4413-a59a-a8d6ff76f0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:27.285444 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c9f3cfc3-0592-4413-a59a-a8d6ff76f0e1 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:27.287068 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c9f3cfc3-0592-4413-a59a-a8d6ff76f0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:27.295514 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1122/2232] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:27.300043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8fdbf-d5e7-44ac-b9c1-cca9354f79f9 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:27.311155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8fdbf-d5e7-44ac-b9c1-cca9354f79f9 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:27.316213 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597edc2-a4b2-4900-8380-b4bb38834808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:27.316891 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597edc2-a4b2-4900-8380-b4bb38834808 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:27.317823 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597edc2-a4b2-4900-8380-b4bb38834808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:27.318103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597edc2-a4b2-4900-8380-b4bb38834808 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:27.318847 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597edc2-a4b2-4900-8380-b4bb38834808 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:57:27.319155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597edc2-a4b2-4900-8380-b4bb38834808 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:27.320778 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597edc2-a4b2-4900-8380-b4bb38834808 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:27.330892 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:27.334915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1111/2233] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:57:27.339479 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3cfc3-0592-4413-a59a-a8d6ff76f0e1 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:27.349921 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3cfc3-0592-4413-a59a-a8d6ff76f0e1 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:27.354888 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81306f-43dd-414f-b9dc-16c19ff6db02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:27.355613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81306f-43dd-414f-b9dc-16c19ff6db02 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:27.355899 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81306f-43dd-414f-b9dc-16c19ff6db02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:27.356179 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81306f-43dd-414f-b9dc-16c19ff6db02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:27.356880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81306f-43dd-414f-b9dc-16c19ff6db02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:27.358840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81306f-43dd-414f-b9dc-16c19ff6db02 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:27.479456 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1123/2234] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:57:27 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:27.484016 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597edc2-a4b2-4900-8380-b4bb38834808 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:27.495231 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597edc2-a4b2-4900-8380-b4bb38834808 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:27.562839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232209d1-a71d-4bf8-929e-c5eab201a25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:27.563533 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232209d1-a71d-4bf8-929e-c5eab201a25f admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:27.563814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232209d1-a71d-4bf8-929e-c5eab201a25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:27.564090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232209d1-a71d-4bf8-929e-c5eab201a25f admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:27.564854 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232209d1-a71d-4bf8-929e-c5eab201a25f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:27.566875 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232209d1-a71d-4bf8-929e-c5eab201a25f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:27.679367 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1112/2235] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:57:27 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:57:27.689133 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81306f-43dd-414f-b9dc-16c19ff6db02 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:27.700498 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81306f-43dd-414f-b9dc-16c19ff6db02 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:27.705905 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd0e30-11ca-43e6-8736-a34047f61ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:27.706590 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd0e30-11ca-43e6-8736-a34047f61ecb admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:27.706877 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd0e30-11ca-43e6-8736-a34047f61ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:27.707154 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd0e30-11ca-43e6-8736-a34047f61ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:27.708070 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd0e30-11ca-43e6-8736-a34047f61ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:27.709932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd0e30-11ca-43e6-8736-a34047f61ecb admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:27.722154 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1124/2236] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:27.727246 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232209d1-a71d-4bf8-929e-c5eab201a25f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:27.738295 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232209d1-a71d-4bf8-929e-c5eab201a25f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:27.743938 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6659ea-196f-4002-97c1-afae518cacb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:27.748749 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6659ea-196f-4002-97c1-afae518cacb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:27.748749 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6659ea-196f-4002-97c1-afae518cacb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:27.748749 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6659ea-196f-4002-97c1-afae518cacb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:27.748749 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6659ea-196f-4002-97c1-afae518cacb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:27.748749 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6659ea-196f-4002-97c1-afae518cacb7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:27.759253 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1113/2237] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:27.763556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd0e30-11ca-43e6-8736-a34047f61ecb admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:27.775565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd0e30-11ca-43e6-8736-a34047f61ecb admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:27.781162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c0b2b-d626-4333-8536-9cff756a0961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:27.782107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c0b2b-d626-4333-8536-9cff756a0961 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:27.782388 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c0b2b-d626-4333-8536-9cff756a0961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:27.783243 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c0b2b-d626-4333-8536-9cff756a0961 admin admin] PATH_INFO: `/v3/projects/e72d3d9c1bfa46c6b538eec4c55a6915/users/6692ddc3d5f74a779990a38c5d7629ad/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:27.800329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c0b2b-d626-4333-8536-9cff756a0961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e72d3d9c1bfa46c6b538eec4c55a6915, user_id=6692ddc3d5f74a779990a38c5d7629ad, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:27.803503 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c0b2b-d626-4333-8536-9cff756a0961 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:27.922951 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1125/2238] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:57:27 2022] PUT /identity/v3/projects/e72d3d9c1bfa46c6b538eec4c55a6915/users/6692ddc3d5f74a779990a38c5d7629ad/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:27.940245 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f1377-e4e1-4117-94ab-8109c797ac0b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:27.940569 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f1377-e4e1-4117-94ab-8109c797ac0b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:27.940857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f1377-e4e1-4117-94ab-8109c797ac0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:27.977114 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-cf6f1377-e4e1-4117-94ab-8109c797ac0b None None] MFA Rules not processed for user `6692ddc3d5f74a779990a38c5d7629ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:27.978385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cf6f1377-e4e1-4117-94ab-8109c797ac0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:28.052374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1114/2239] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:57:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:28.063009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c0b2b-d626-4333-8536-9cff756a0961 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:28.064683 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ed6c0b2b-d626-4333-8536-9cff756a0961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:28.143981 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c0b2b-d626-4333-8536-9cff756a0961 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:28.146238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74b6ee-0b48-4057-8b66-95c1f263eeda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:28.146917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74b6ee-0b48-4057-8b66-95c1f263eeda service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:28.147220 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74b6ee-0b48-4057-8b66-95c1f263eeda service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:28.147498 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74b6ee-0b48-4057-8b66-95c1f263eeda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:28.157851 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74b6ee-0b48-4057-8b66-95c1f263eeda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:28.159320 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74b6ee-0b48-4057-8b66-95c1f263eeda service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:28.172235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1126/2240] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:57:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:35.939192 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb80eb-7cd5-4669-9cb6-6ba1c16a843a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:35.939671 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb80eb-7cd5-4669-9cb6-6ba1c16a843a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:35.939982 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb80eb-7cd5-4669-9cb6-6ba1c16a843a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:35.959335 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3ddb80eb-7cd5-4669-9cb6-6ba1c16a843a None None] MFA Rules not processed for user `4d2ab3eeb5b44979956dd223ac6b7c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:35.960663 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3ddb80eb-7cd5-4669-9cb6-6ba1c16a843a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:36.021583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1115/2241] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 26 16:57:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:36.034570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74b6ee-0b48-4057-8b66-95c1f263eeda service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:36.036735 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0e74b6ee-0b48-4057-8b66-95c1f263eeda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:36.142715 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74b6ee-0b48-4057-8b66-95c1f263eeda service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:36.155817 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347a791-426e-4d53-b3b6-0a36d300c1e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cc455638fb4db4939af3657ab4203e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:36.156993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347a791-426e-4d53-b3b6-0a36d300c1e6 service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:36.157553 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347a791-426e-4d53-b3b6-0a36d300c1e6 service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:36.158007 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347a791-426e-4d53-b3b6-0a36d300c1e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:36.174624 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347a791-426e-4d53-b3b6-0a36d300c1e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:36.178732 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347a791-426e-4d53-b3b6-0a36d300c1e6 service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:36.205343 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1127/2242] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 16:57:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:57:40.096491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb80eb-7cd5-4669-9cb6-6ba1c16a843a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:40.120335 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:40.178872 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb80eb-7cd5-4669-9cb6-6ba1c16a843a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:40.184694 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a503b63-64ee-4957-9998-c01413790ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:40.185813 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a503b63-64ee-4957-9998-c01413790ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:40.186091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a503b63-64ee-4957-9998-c01413790ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:40.186379 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a503b63-64ee-4957-9998-c01413790ff9 admin admin] PATH_INFO: `/v3/users/6692ddc3d5f74a779990a38c5d7629ad` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:40.187676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a503b63-64ee-4957-9998-c01413790ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6692ddc3d5f74a779990a38c5d7629ad)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:40.189689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a503b63-64ee-4957-9998-c01413790ff9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:40.428699 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1a503b63-64ee-4957-9998-c01413790ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6692ddc3d5f74a779990a38c5d7629ad'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:40.579412 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1a503b63-64ee-4957-9998-c01413790ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6692ddc3d5f74a779990a38c5d7629ad'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:40.580020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1a503b63-64ee-4957-9998-c01413790ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6692ddc3d5f74a779990a38c5d7629ad'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:40.580649 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1a503b63-64ee-4957-9998-c01413790ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6692ddc3d5f74a779990a38c5d7629ad'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:40.589079 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1a503b63-64ee-4957-9998-c01413790ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6692ddc3d5f74a779990a38c5d7629ad'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:40.607512 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1116/2243] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:57:40 2022] DELETE /identity/v3/users/6692ddc3d5f74a779990a38c5d7629ad => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:40.612319 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0972867-9de9-4874-906a-3a54d3a3725b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:40.612970 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0972867-9de9-4874-906a-3a54d3a3725b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:40.612970 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0972867-9de9-4874-906a-3a54d3a3725b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:40.630786 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d0972867-9de9-4874-906a-3a54d3a3725b None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:40.632006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d0972867-9de9-4874-906a-3a54d3a3725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:40.657784 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:40.698972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1128/2244] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:40.709670 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a503b63-64ee-4957-9998-c01413790ff9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:40.711261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1a503b63-64ee-4957-9998-c01413790ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:40.776756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a503b63-64ee-4957-9998-c01413790ff9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:40.780651 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159323e6-95a6-46fa-952d-170343029bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:40.782563 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159323e6-95a6-46fa-952d-170343029bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:40.782690 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159323e6-95a6-46fa-952d-170343029bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:40.782997 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159323e6-95a6-46fa-952d-170343029bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:40.800485 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159323e6-95a6-46fa-952d-170343029bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:40.802600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159323e6-95a6-46fa-952d-170343029bc2 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:40.813587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1117/2245] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:41.279997 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0972867-9de9-4874-906a-3a54d3a3725b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:41.281869 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d0972867-9de9-4874-906a-3a54d3a3725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:41.295417 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0972867-9de9-4874-906a-3a54d3a3725b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:41.300550 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74216ec0-0fe5-4894-ae36-a62821eae33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:41.301487 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74216ec0-0fe5-4894-ae36-a62821eae33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:41.301858 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74216ec0-0fe5-4894-ae36-a62821eae33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:41.302034 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74216ec0-0fe5-4894-ae36-a62821eae33f admin admin] PATH_INFO: `/v3/projects/e72d3d9c1bfa46c6b538eec4c55a6915` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:41.303692 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74216ec0-0fe5-4894-ae36-a62821eae33f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e72d3d9c1bfa46c6b538eec4c55a6915)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:41.305749 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74216ec0-0fe5-4894-ae36-a62821eae33f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:41.444590 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-74216ec0-0fe5-4894-ae36-a62821eae33f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e72d3d9c1bfa46c6b538eec4c55a6915', 'request_id': 'req-74216ec0-0fe5-4894-ae36-a62821eae33f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:41.512416 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-74216ec0-0fe5-4894-ae36-a62821eae33f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e72d3d9c1bfa46c6b538eec4c55a6915', 'request_id': 'req-74216ec0-0fe5-4894-ae36-a62821eae33f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:41.526866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-74216ec0-0fe5-4894-ae36-a62821eae33f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e72d3d9c1bfa46c6b538eec4c55a6915', 'request_id': 'req-74216ec0-0fe5-4894-ae36-a62821eae33f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:41.541802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-74216ec0-0fe5-4894-ae36-a62821eae33f admin admin] The token cache is being invalidate because project e72d3d9c1bfa46c6b538eec4c55a6915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:57:41.542058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-74216ec0-0fe5-4894-ae36-a62821eae33f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:41.542762 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-74216ec0-0fe5-4894-ae36-a62821eae33f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:41.544410 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1129/2246] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:57:41 2022] DELETE /identity/v3/projects/e72d3d9c1bfa46c6b538eec4c55a6915 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:41.549556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53445f-11e2-4a43-aee6-816daa1ee390 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:41.550084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53445f-11e2-4a43-aee6-816daa1ee390 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:41.550084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53445f-11e2-4a43-aee6-816daa1ee390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:41.571693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-de53445f-11e2-4a43-aee6-816daa1ee390 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:41.573327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-de53445f-11e2-4a43-aee6-816daa1ee390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:41.615841 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:41.663197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1118/2247] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:41.674063 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2d473-3c70-454c-b4b8-ba5076acf044 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:41.674600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2d473-3c70-454c-b4b8-ba5076acf044 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:41.675116 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2d473-3c70-454c-b4b8-ba5076acf044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:41.706601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b9e2d473-3c70-454c-b4b8-ba5076acf044 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:41.708702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b9e2d473-3c70-454c-b4b8-ba5076acf044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:41.719403 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1130/2248] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:41.724116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53445f-11e2-4a43-aee6-816daa1ee390 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:41.734600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53445f-11e2-4a43-aee6-816daa1ee390 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:41.741958 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5b98c-865a-4264-81b3-783d1a2cb94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:41.742648 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5b98c-865a-4264-81b3-783d1a2cb94c admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:41.742931 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5b98c-865a-4264-81b3-783d1a2cb94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:41.743208 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5b98c-865a-4264-81b3-783d1a2cb94c admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:41.743949 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5b98c-865a-4264-81b3-783d1a2cb94c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:57:41.744251 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5b98c-865a-4264-81b3-783d1a2cb94c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:41.746031 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5b98c-865a-4264-81b3-783d1a2cb94c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:41.775239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1119/2249] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:57:41.785656 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2d473-3c70-454c-b4b8-ba5076acf044 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:41.796271 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5b98c-865a-4264-81b3-783d1a2cb94c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:41.798843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d1a5b98c-865a-4264-81b3-783d1a2cb94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:41.814055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2d473-3c70-454c-b4b8-ba5076acf044 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:41.819594 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da090c2-5059-4616-bbb0-b19f3260f47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:41.820277 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da090c2-5059-4616-bbb0-b19f3260f47c admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:41.820560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da090c2-5059-4616-bbb0-b19f3260f47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:41.820835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da090c2-5059-4616-bbb0-b19f3260f47c admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:41.821610 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da090c2-5059-4616-bbb0-b19f3260f47c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:41.823683 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da090c2-5059-4616-bbb0-b19f3260f47c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:41.900754 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5b98c-865a-4264-81b3-783d1a2cb94c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:41.905563 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616a2ce-51f0-404f-b3f2-db72eca23286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:41.906246 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616a2ce-51f0-404f-b3f2-db72eca23286 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:41.906524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616a2ce-51f0-404f-b3f2-db72eca23286 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:41.906962 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616a2ce-51f0-404f-b3f2-db72eca23286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:41.908923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3616a2ce-51f0-404f-b3f2-db72eca23286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:41.970215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1131/2250] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:57:41 2022] POST /identity/v3/projects => generated 389 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:57:41.975364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da090c2-5059-4616-bbb0-b19f3260f47c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:41.995677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616a2ce-51f0-404f-b3f2-db72eca23286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:41.997375 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616a2ce-51f0-404f-b3f2-db72eca23286 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:42.013395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1120/2251] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:57:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:57:42.052279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da090c2-5059-4616-bbb0-b19f3260f47c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:42.057615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263f6eb-a4d8-4032-918e-bbd54604e0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:42.058337 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263f6eb-a4d8-4032-918e-bbd54604e0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:42.058583 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263f6eb-a4d8-4032-918e-bbd54604e0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:42.058856 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263f6eb-a4d8-4032-918e-bbd54604e0c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:42.059555 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263f6eb-a4d8-4032-918e-bbd54604e0c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:42.061889 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263f6eb-a4d8-4032-918e-bbd54604e0c9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:42.213830 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1132/2252] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:57:41 2022] POST /identity/v3/users => generated 295 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:57:42.213972 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616a2ce-51f0-404f-b3f2-db72eca23286 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:42.230731 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616a2ce-51f0-404f-b3f2-db72eca23286 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:42.236284 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238f73b-2990-472f-9113-0813f77d5df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:42.236598 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238f73b-2990-472f-9113-0813f77d5df1 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:42.237219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238f73b-2990-472f-9113-0813f77d5df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:42.237433 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238f73b-2990-472f-9113-0813f77d5df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:42.238126 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238f73b-2990-472f-9113-0813f77d5df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:42.240391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238f73b-2990-472f-9113-0813f77d5df1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:42.254846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1121/2253] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:57:42.256235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263f6eb-a4d8-4032-918e-bbd54604e0c9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:42.268904 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263f6eb-a4d8-4032-918e-bbd54604e0c9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:42.275504 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742215c3-a94a-4d81-acf5-bed0aab57fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:42.276202 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742215c3-a94a-4d81-acf5-bed0aab57fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:42.276547 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742215c3-a94a-4d81-acf5-bed0aab57fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:42.276834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742215c3-a94a-4d81-acf5-bed0aab57fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:42.277652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742215c3-a94a-4d81-acf5-bed0aab57fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:42.279426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742215c3-a94a-4d81-acf5-bed0aab57fb3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:42.296629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1133/2254] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:57:42.297893 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238f73b-2990-472f-9113-0813f77d5df1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:42.309242 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238f73b-2990-472f-9113-0813f77d5df1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:42.314402 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03049a8e-c595-44dd-b010-0004bc83116e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:42.315375 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03049a8e-c595-44dd-b010-0004bc83116e admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:42.315642 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03049a8e-c595-44dd-b010-0004bc83116e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:42.315870 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03049a8e-c595-44dd-b010-0004bc83116e admin admin] PATH_INFO: `/v3/projects/e8351d28446e4bc2acaac3c284f803d1/users/f0524c79f2f9452bad8fb15d44196d79/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:42.344226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03049a8e-c595-44dd-b010-0004bc83116e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8351d28446e4bc2acaac3c284f803d1, user_id=f0524c79f2f9452bad8fb15d44196d79, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:42.346382 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03049a8e-c595-44dd-b010-0004bc83116e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:42.477298 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1122/2255] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:57:42 2022] PUT /identity/v3/projects/e8351d28446e4bc2acaac3c284f803d1/users/f0524c79f2f9452bad8fb15d44196d79/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:42.483140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753c193-c432-410f-9dee-80de1df78b5b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:42.483427 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753c193-c432-410f-9dee-80de1df78b5b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:42.483708 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753c193-c432-410f-9dee-80de1df78b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:42.491202 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:42.521285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e753c193-c432-410f-9dee-80de1df78b5b None None] MFA Rules not processed for user `f0524c79f2f9452bad8fb15d44196d79`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:42.524215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e753c193-c432-410f-9dee-80de1df78b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:42.615040 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1134/2256] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:57:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:42.626206 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03049a8e-c595-44dd-b010-0004bc83116e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:42.627982 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-03049a8e-c595-44dd-b010-0004bc83116e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:42.674296 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:42.692444 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03049a8e-c595-44dd-b010-0004bc83116e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:42.696461 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d49396-86cd-40e3-aa48-9598621123f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:42.697125 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d49396-86cd-40e3-aa48-9598621123f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:42.697436 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d49396-86cd-40e3-aa48-9598621123f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:42.697709 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d49396-86cd-40e3-aa48-9598621123f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:42.707915 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d49396-86cd-40e3-aa48-9598621123f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:42.709437 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d49396-86cd-40e3-aa48-9598621123f8 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:42.719563 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1123/2257] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:57:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:53.293884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=9 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:53.351454 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=31 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:01.875171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753c193-c432-410f-9dee-80de1df78b5b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:01.877238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e753c193-c432-410f-9dee-80de1df78b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:01.954229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753c193-c432-410f-9dee-80de1df78b5b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:01.962519 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9deca95-5c11-4199-9801-33644522f7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:01.963435 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9deca95-5c11-4199-9801-33644522f7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:01.963710 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9deca95-5c11-4199-9801-33644522f7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:01.963984 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9deca95-5c11-4199-9801-33644522f7e4 admin admin] PATH_INFO: `/v3/users/96bcbd9f807a47f990e2d0153788df23` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:01.965426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9deca95-5c11-4199-9801-33644522f7e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96bcbd9f807a47f990e2d0153788df23)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:01.967478 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9deca95-5c11-4199-9801-33644522f7e4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:02.221460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a9deca95-5c11-4199-9801-33644522f7e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96bcbd9f807a47f990e2d0153788df23'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:02.223300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a9deca95-5c11-4199-9801-33644522f7e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96bcbd9f807a47f990e2d0153788df23'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:02.231875 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a9deca95-5c11-4199-9801-33644522f7e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96bcbd9f807a47f990e2d0153788df23'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:02.305411 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a9deca95-5c11-4199-9801-33644522f7e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96bcbd9f807a47f990e2d0153788df23'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:02.306242 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a9deca95-5c11-4199-9801-33644522f7e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96bcbd9f807a47f990e2d0153788df23'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:02.329290 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1135/2258] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:58:01 2022] DELETE /identity/v3/users/96bcbd9f807a47f990e2d0153788df23 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:02.334499 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c32ca-c080-40b4-a050-52f9395ca97c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:02.335060 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c32ca-c080-40b4-a050-52f9395ca97c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:02.335060 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c32ca-c080-40b4-a050-52f9395ca97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:02.355038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-031c32ca-c080-40b4-a050-52f9395ca97c None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:02.356259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-031c32ca-c080-40b4-a050-52f9395ca97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:02.430794 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1124/2259] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:02.440559 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9deca95-5c11-4199-9801-33644522f7e4 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:02.442666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a9deca95-5c11-4199-9801-33644522f7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:02.516572 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9deca95-5c11-4199-9801-33644522f7e4 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:02.521343 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2dbbc-d75f-492c-86a4-e0123645ebd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:02.522024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2dbbc-d75f-492c-86a4-e0123645ebd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:02.522297 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2dbbc-d75f-492c-86a4-e0123645ebd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:02.522571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2dbbc-d75f-492c-86a4-e0123645ebd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:02.533147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2dbbc-d75f-492c-86a4-e0123645ebd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:02.534562 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2dbbc-d75f-492c-86a4-e0123645ebd1 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:02.545522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1136/2260] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:58:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:03.045319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c32ca-c080-40b4-a050-52f9395ca97c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:03.047113 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-031c32ca-c080-40b4-a050-52f9395ca97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:03.060780 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c32ca-c080-40b4-a050-52f9395ca97c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:03.068027 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c65b46-119d-4d68-ab6e-db004cb6598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:03.068921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c65b46-119d-4d68-ab6e-db004cb6598b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:03.069287 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c65b46-119d-4d68-ab6e-db004cb6598b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:03.069513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c65b46-119d-4d68-ab6e-db004cb6598b admin admin] PATH_INFO: `/v3/projects/be720914e6dd49fc8bf0ec70e5fcd36b` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:03.071003 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c65b46-119d-4d68-ab6e-db004cb6598b admin admin] RBAC: Authorizing `identity:delete_project(project_id=be720914e6dd49fc8bf0ec70e5fcd36b)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:03.073343 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c65b46-119d-4d68-ab6e-db004cb6598b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:03.192554 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b5c65b46-119d-4d68-ab6e-db004cb6598b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be720914e6dd49fc8bf0ec70e5fcd36b', 'request_id': 'req-b5c65b46-119d-4d68-ab6e-db004cb6598b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:03.201574 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b5c65b46-119d-4d68-ab6e-db004cb6598b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be720914e6dd49fc8bf0ec70e5fcd36b', 'request_id': 'req-b5c65b46-119d-4d68-ab6e-db004cb6598b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:03.213456 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b5c65b46-119d-4d68-ab6e-db004cb6598b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be720914e6dd49fc8bf0ec70e5fcd36b', 'request_id': 'req-b5c65b46-119d-4d68-ab6e-db004cb6598b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:03.287735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b5c65b46-119d-4d68-ab6e-db004cb6598b admin admin] The token cache is being invalidate because project be720914e6dd49fc8bf0ec70e5fcd36b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:58:03.288023 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b5c65b46-119d-4d68-ab6e-db004cb6598b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:03.288702 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b5c65b46-119d-4d68-ab6e-db004cb6598b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:03.290385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1125/2261] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:58:03 2022] DELETE /identity/v3/projects/be720914e6dd49fc8bf0ec70e5fcd36b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:03.295344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e90ca-6de0-44d4-a076-6dbe9a29caa8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:03.295845 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e90ca-6de0-44d4-a076-6dbe9a29caa8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:03.295959 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e90ca-6de0-44d4-a076-6dbe9a29caa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:03.321571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b93e90ca-6de0-44d4-a076-6dbe9a29caa8 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:03.324785 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b93e90ca-6de0-44d4-a076-6dbe9a29caa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:03.345459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:03.389729 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1137/2262] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:03.397416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0460f-3faa-419c-bd11-0161148050cf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:03.397965 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0460f-3faa-419c-bd11-0161148050cf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:03.398063 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0460f-3faa-419c-bd11-0161148050cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:03.416929 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4ed0460f-3faa-419c-bd11-0161148050cf None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:03.418190 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4ed0460f-3faa-419c-bd11-0161148050cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:03.427495 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1126/2263] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:03.432539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e90ca-6de0-44d4-a076-6dbe9a29caa8 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:03.443560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e90ca-6de0-44d4-a076-6dbe9a29caa8 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:03.448868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09da422-0cea-41b6-b48f-21f3dbf5001e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:03.449587 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09da422-0cea-41b6-b48f-21f3dbf5001e admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:03.449873 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09da422-0cea-41b6-b48f-21f3dbf5001e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:03.450145 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09da422-0cea-41b6-b48f-21f3dbf5001e admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:03.450975 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09da422-0cea-41b6-b48f-21f3dbf5001e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:58:03.451286 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09da422-0cea-41b6-b48f-21f3dbf5001e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:03.453081 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09da422-0cea-41b6-b48f-21f3dbf5001e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:03.469596 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1138/2264] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:58:03.473972 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0460f-3faa-419c-bd11-0161148050cf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:03.484856 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0460f-3faa-419c-bd11-0161148050cf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:03.490677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a6fd1-8427-4dca-9e21-35d60a06b500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:03.491660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a6fd1-8427-4dca-9e21-35d60a06b500 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:03.492143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a6fd1-8427-4dca-9e21-35d60a06b500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:03.492654 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a6fd1-8427-4dca-9e21-35d60a06b500 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:03.493486 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a6fd1-8427-4dca-9e21-35d60a06b500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:03.495415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a6fd1-8427-4dca-9e21-35d60a06b500 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:03.581665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1127/2265] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:58:03 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:03.589014 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09da422-0cea-41b6-b48f-21f3dbf5001e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:03.601063 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09da422-0cea-41b6-b48f-21f3dbf5001e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:03.666015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8da989-7b03-4357-96c0-27765c6697d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:03.666709 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8da989-7b03-4357-96c0-27765c6697d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:03.666994 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8da989-7b03-4357-96c0-27765c6697d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:03.667276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8da989-7b03-4357-96c0-27765c6697d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:03.667965 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8da989-7b03-4357-96c0-27765c6697d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:03.669969 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8da989-7b03-4357-96c0-27765c6697d5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:03.747135 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1139/2266] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:58:03 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:03.751508 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a6fd1-8427-4dca-9e21-35d60a06b500 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:03.762734 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a6fd1-8427-4dca-9e21-35d60a06b500 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:03.773513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95232c75-1ef8-4409-a45f-14b6e2d3143c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:03.774151 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95232c75-1ef8-4409-a45f-14b6e2d3143c admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:03.774427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95232c75-1ef8-4409-a45f-14b6e2d3143c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:03.774720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95232c75-1ef8-4409-a45f-14b6e2d3143c admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:03.775536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95232c75-1ef8-4409-a45f-14b6e2d3143c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:03.777068 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95232c75-1ef8-4409-a45f-14b6e2d3143c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:03.789200 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1128/2267] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:58:03.793665 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8da989-7b03-4357-96c0-27765c6697d5 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:03.805614 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8da989-7b03-4357-96c0-27765c6697d5 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:03.810395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6dc46-dd01-4044-b93e-8140222643da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:03.811063 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6dc46-dd01-4044-b93e-8140222643da admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:03.811489 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6dc46-dd01-4044-b93e-8140222643da admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:03.811778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6dc46-dd01-4044-b93e-8140222643da admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:03.812507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6dc46-dd01-4044-b93e-8140222643da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:03.814156 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6dc46-dd01-4044-b93e-8140222643da admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:03.826120 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1140/2268] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:03.830615 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95232c75-1ef8-4409-a45f-14b6e2d3143c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:03.841648 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95232c75-1ef8-4409-a45f-14b6e2d3143c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:03.846592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbeb917-ecf9-47a7-85d0-b7f5c4c78fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:03.859725 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbeb917-ecf9-47a7-85d0-b7f5c4c78fad admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:03.859725 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbeb917-ecf9-47a7-85d0-b7f5c4c78fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:03.859725 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbeb917-ecf9-47a7-85d0-b7f5c4c78fad admin admin] PATH_INFO: `/v3/projects/50e64843ef614594bee72fa76aa68917/users/206d5b84340946aaad7a2b0cf05636e4/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:03.867217 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbeb917-ecf9-47a7-85d0-b7f5c4c78fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e64843ef614594bee72fa76aa68917, user_id=206d5b84340946aaad7a2b0cf05636e4, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:03.870086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbeb917-ecf9-47a7-85d0-b7f5c4c78fad admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:03.981499 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1129/2269] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:58:03 2022] PUT /identity/v3/projects/50e64843ef614594bee72fa76aa68917/users/206d5b84340946aaad7a2b0cf05636e4/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:03.992856 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237fff6-d351-4312-a0c1-1f7aa7efe82c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:03.993155 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237fff6-d351-4312-a0c1-1f7aa7efe82c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:03.993456 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237fff6-d351-4312-a0c1-1f7aa7efe82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:04.023671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e237fff6-d351-4312-a0c1-1f7aa7efe82c None None] MFA Rules not processed for user `206d5b84340946aaad7a2b0cf05636e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:04.024890 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e237fff6-d351-4312-a0c1-1f7aa7efe82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:04.132723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1141/2270] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:58:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:58:04.145202 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbeb917-ecf9-47a7-85d0-b7f5c4c78fad admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:04.147164 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cbbeb917-ecf9-47a7-85d0-b7f5c4c78fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:04.182985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:04.224007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbeb917-ecf9-47a7-85d0-b7f5c4c78fad admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:04.228248 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dec17a-3d95-4693-8bfc-01ebbcff68c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:04.228965 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dec17a-3d95-4693-8bfc-01ebbcff68c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:04.229366 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dec17a-3d95-4693-8bfc-01ebbcff68c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:04.229654 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dec17a-3d95-4693-8bfc-01ebbcff68c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:04.239988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dec17a-3d95-4693-8bfc-01ebbcff68c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:04.241826 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dec17a-3d95-4693-8bfc-01ebbcff68c7 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:04.251811 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1130/2271] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:58:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:04.288789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237fff6-d351-4312-a0c1-1f7aa7efe82c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:04.328901 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:04.388346 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237fff6-d351-4312-a0c1-1f7aa7efe82c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:04.393729 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ad076-10ee-4e82-ac39-497907d6413a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:04.394723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ad076-10ee-4e82-ac39-497907d6413a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:04.395135 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ad076-10ee-4e82-ac39-497907d6413a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:04.395407 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ad076-10ee-4e82-ac39-497907d6413a admin admin] PATH_INFO: `/v3/users/206d5b84340946aaad7a2b0cf05636e4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:04.397104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ad076-10ee-4e82-ac39-497907d6413a admin admin] RBAC: Authorizing `identity:delete_user(user_id=206d5b84340946aaad7a2b0cf05636e4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:04.399334 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ad076-10ee-4e82-ac39-497907d6413a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:04.644083 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f09ad076-10ee-4e82-ac39-497907d6413a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '206d5b84340946aaad7a2b0cf05636e4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:04.644948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f09ad076-10ee-4e82-ac39-497907d6413a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '206d5b84340946aaad7a2b0cf05636e4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:04.660640 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f09ad076-10ee-4e82-ac39-497907d6413a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '206d5b84340946aaad7a2b0cf05636e4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:04.734009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f09ad076-10ee-4e82-ac39-497907d6413a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '206d5b84340946aaad7a2b0cf05636e4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:04.734706 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f09ad076-10ee-4e82-ac39-497907d6413a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '206d5b84340946aaad7a2b0cf05636e4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:04.756712 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1142/2272] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:58:04 2022] DELETE /identity/v3/users/206d5b84340946aaad7a2b0cf05636e4 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:04.761505 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19189a3b-3ac7-4466-9fb6-47397c445b4b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:04.762053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19189a3b-3ac7-4466-9fb6-47397c445b4b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:04.762053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19189a3b-3ac7-4466-9fb6-47397c445b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:04.782495 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-19189a3b-3ac7-4466-9fb6-47397c445b4b None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:04.783790 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-19189a3b-3ac7-4466-9fb6-47397c445b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:04.853423 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1131/2273] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:04.863965 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ad076-10ee-4e82-ac39-497907d6413a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:04.865789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f09ad076-10ee-4e82-ac39-497907d6413a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:04.944683 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ad076-10ee-4e82-ac39-497907d6413a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:04.948832 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05645a29-7f22-471c-a9d9-731c0ea09c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:04.949595 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05645a29-7f22-471c-a9d9-731c0ea09c35 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:04.949880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05645a29-7f22-471c-a9d9-731c0ea09c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:04.950157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05645a29-7f22-471c-a9d9-731c0ea09c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:04.960983 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05645a29-7f22-471c-a9d9-731c0ea09c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:04.962478 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05645a29-7f22-471c-a9d9-731c0ea09c35 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:04.972661 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1143/2274] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:05.440507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19189a3b-3ac7-4466-9fb6-47397c445b4b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:05.442705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-19189a3b-3ac7-4466-9fb6-47397c445b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:05.457939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19189a3b-3ac7-4466-9fb6-47397c445b4b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:05.479628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0e0f2-9cd1-4da7-a32a-8529ce8880fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:05.479628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0e0f2-9cd1-4da7-a32a-8529ce8880fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:05.479628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0e0f2-9cd1-4da7-a32a-8529ce8880fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:05.479628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0e0f2-9cd1-4da7-a32a-8529ce8880fa admin admin] PATH_INFO: `/v3/projects/50e64843ef614594bee72fa76aa68917` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:05.480824 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0e0f2-9cd1-4da7-a32a-8529ce8880fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=50e64843ef614594bee72fa76aa68917)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:05.484459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0e0f2-9cd1-4da7-a32a-8529ce8880fa admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:05.636160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fab0e0f2-9cd1-4da7-a32a-8529ce8880fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50e64843ef614594bee72fa76aa68917', 'request_id': 'req-fab0e0f2-9cd1-4da7-a32a-8529ce8880fa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:05.642311 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fab0e0f2-9cd1-4da7-a32a-8529ce8880fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50e64843ef614594bee72fa76aa68917', 'request_id': 'req-fab0e0f2-9cd1-4da7-a32a-8529ce8880fa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:05.648817 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fab0e0f2-9cd1-4da7-a32a-8529ce8880fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50e64843ef614594bee72fa76aa68917', 'request_id': 'req-fab0e0f2-9cd1-4da7-a32a-8529ce8880fa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:05.728348 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fab0e0f2-9cd1-4da7-a32a-8529ce8880fa admin admin] The token cache is being invalidate because project 50e64843ef614594bee72fa76aa68917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:58:05.728656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fab0e0f2-9cd1-4da7-a32a-8529ce8880fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:05.729330 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fab0e0f2-9cd1-4da7-a32a-8529ce8880fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:05.731253 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1132/2275] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:58:05 2022] DELETE /identity/v3/projects/50e64843ef614594bee72fa76aa68917 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:07.143554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05645a29-7f22-471c-a9d9-731c0ea09c35 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:07.145658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-05645a29-7f22-471c-a9d9-731c0ea09c35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:07.160883 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05645a29-7f22-471c-a9d9-731c0ea09c35 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:07.207220 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:07.230670 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe6d98-686f-449c-84e0-58b52eb80ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:07.231347 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6d98-686f-449c-84e0-58b52eb80ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:07.231632 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6d98-686f-449c-84e0-58b52eb80ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:07.231904 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6d98-686f-449c-84e0-58b52eb80ef6 admin admin] PATH_INFO: `/v3/users/f0524c79f2f9452bad8fb15d44196d79` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:07.233174 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe6d98-686f-449c-84e0-58b52eb80ef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0524c79f2f9452bad8fb15d44196d79)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:07.235273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe6d98-686f-449c-84e0-58b52eb80ef6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:07.491837 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5ffe6d98-686f-449c-84e0-58b52eb80ef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0524c79f2f9452bad8fb15d44196d79'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:07.492552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5ffe6d98-686f-449c-84e0-58b52eb80ef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0524c79f2f9452bad8fb15d44196d79'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:07.501085 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5ffe6d98-686f-449c-84e0-58b52eb80ef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0524c79f2f9452bad8fb15d44196d79'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:07.567860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5ffe6d98-686f-449c-84e0-58b52eb80ef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0524c79f2f9452bad8fb15d44196d79'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:07.568610 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5ffe6d98-686f-449c-84e0-58b52eb80ef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0524c79f2f9452bad8fb15d44196d79'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:07.590028 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1144/2276] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:58:07 2022] DELETE /identity/v3/users/f0524c79f2f9452bad8fb15d44196d79 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:07.594546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47103682-75ff-4f63-b5a1-cc6738cf139b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:07.595082 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47103682-75ff-4f63-b5a1-cc6738cf139b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:07.595082 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47103682-75ff-4f63-b5a1-cc6738cf139b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:07.616185 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-47103682-75ff-4f63-b5a1-cc6738cf139b None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:07.617100 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-47103682-75ff-4f63-b5a1-cc6738cf139b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:07.662653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:07.685700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1133/2277] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:07.696561 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe6d98-686f-449c-84e0-58b52eb80ef6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:07.698099 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5ffe6d98-686f-449c-84e0-58b52eb80ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:07.768887 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe6d98-686f-449c-84e0-58b52eb80ef6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:07.773397 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf3a57-097b-493f-b3b1-bba80de20ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:07.774084 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf3a57-097b-493f-b3b1-bba80de20ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:07.774371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf3a57-097b-493f-b3b1-bba80de20ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:07.774651 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf3a57-097b-493f-b3b1-bba80de20ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:07.786570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf3a57-097b-493f-b3b1-bba80de20ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:07.788533 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf3a57-097b-493f-b3b1-bba80de20ec0 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:07.800936 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1145/2278] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:58:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:08.304322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47103682-75ff-4f63-b5a1-cc6738cf139b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:08.305847 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-47103682-75ff-4f63-b5a1-cc6738cf139b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:08.324776 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47103682-75ff-4f63-b5a1-cc6738cf139b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:08.330411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a9b35-81ba-492a-91c9-6787315f7c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:08.332979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9b35-81ba-492a-91c9-6787315f7c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:08.333355 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9b35-81ba-492a-91c9-6787315f7c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:08.334138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9b35-81ba-492a-91c9-6787315f7c3d admin admin] PATH_INFO: `/v3/projects/e8351d28446e4bc2acaac3c284f803d1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:08.335603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a9b35-81ba-492a-91c9-6787315f7c3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8351d28446e4bc2acaac3c284f803d1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:08.337674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a9b35-81ba-492a-91c9-6787315f7c3d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:08.471328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-852a9b35-81ba-492a-91c9-6787315f7c3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8351d28446e4bc2acaac3c284f803d1', 'request_id': 'req-852a9b35-81ba-492a-91c9-6787315f7c3d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:08.480879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-852a9b35-81ba-492a-91c9-6787315f7c3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8351d28446e4bc2acaac3c284f803d1', 'request_id': 'req-852a9b35-81ba-492a-91c9-6787315f7c3d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:08.491055 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-852a9b35-81ba-492a-91c9-6787315f7c3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8351d28446e4bc2acaac3c284f803d1', 'request_id': 'req-852a9b35-81ba-492a-91c9-6787315f7c3d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:08.570843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-852a9b35-81ba-492a-91c9-6787315f7c3d admin admin] The token cache is being invalidate because project e8351d28446e4bc2acaac3c284f803d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:58:08.571066 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-852a9b35-81ba-492a-91c9-6787315f7c3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:08.571704 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-852a9b35-81ba-492a-91c9-6787315f7c3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:58:08.573353 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1134/2279] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:58:08 2022] DELETE /identity/v3/projects/e8351d28446e4bc2acaac3c284f803d1 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:08.578590 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec31041-fefa-43ae-815f-2c982b28f355 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:08.579111 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec31041-fefa-43ae-815f-2c982b28f355 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:08.579222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec31041-fefa-43ae-815f-2c982b28f355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:08.599183 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-cec31041-fefa-43ae-815f-2c982b28f355 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:08.600629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cec31041-fefa-43ae-815f-2c982b28f355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:08.665420 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1146/2280] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:08.673318 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bc2ea-80f8-4fac-86c0-2dba5fc3f1d3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:08.673830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bc2ea-80f8-4fac-86c0-2dba5fc3f1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:08.673946 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bc2ea-80f8-4fac-86c0-2dba5fc3f1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:08.694552 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5c5bc2ea-80f8-4fac-86c0-2dba5fc3f1d3 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:08.695776 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5c5bc2ea-80f8-4fac-86c0-2dba5fc3f1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:08.704647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1135/2281] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:08.709012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec31041-fefa-43ae-815f-2c982b28f355 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:08.714032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:08.719409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec31041-fefa-43ae-815f-2c982b28f355 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:08.724568 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdaf74d-356c-45d2-9a43-883e5fbbdfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:08.729564 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdaf74d-356c-45d2-9a43-883e5fbbdfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:08.729564 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdaf74d-356c-45d2-9a43-883e5fbbdfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:08.729564 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdaf74d-356c-45d2-9a43-883e5fbbdfd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:08.729564 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdaf74d-356c-45d2-9a43-883e5fbbdfd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:58:08.729564 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdaf74d-356c-45d2-9a43-883e5fbbdfd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:08.729564 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdaf74d-356c-45d2-9a43-883e5fbbdfd2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:08.742050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1147/2282] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:58:08.747786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bc2ea-80f8-4fac-86c0-2dba5fc3f1d3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:08.761153 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bc2ea-80f8-4fac-86c0-2dba5fc3f1d3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:08.764956 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83335b55-c32a-4aad-a1a9-c2fb3043762a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:08.765676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83335b55-c32a-4aad-a1a9-c2fb3043762a admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:08.765964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83335b55-c32a-4aad-a1a9-c2fb3043762a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:08.766242 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83335b55-c32a-4aad-a1a9-c2fb3043762a admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:08.767006 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83335b55-c32a-4aad-a1a9-c2fb3043762a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:08.769008 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83335b55-c32a-4aad-a1a9-c2fb3043762a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:08.901419 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1136/2283] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:58:08 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:08.911202 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdaf74d-356c-45d2-9a43-883e5fbbdfd2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:08.922277 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdaf74d-356c-45d2-9a43-883e5fbbdfd2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:08.982122 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15cfa6-fc15-4a99-bf32-7fea3cda1091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:08.982810 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15cfa6-fc15-4a99-bf32-7fea3cda1091 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:08.983119 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15cfa6-fc15-4a99-bf32-7fea3cda1091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:08.983479 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15cfa6-fc15-4a99-bf32-7fea3cda1091 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:08.984113 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15cfa6-fc15-4a99-bf32-7fea3cda1091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:08.986099 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15cfa6-fc15-4a99-bf32-7fea3cda1091 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:09.072660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1148/2284] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:58:08 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:09.074028 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83335b55-c32a-4aad-a1a9-c2fb3043762a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:09.088050 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83335b55-c32a-4aad-a1a9-c2fb3043762a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:09.093091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9439fa-24b2-4fbb-a0ae-043db9d296a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:09.093834 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9439fa-24b2-4fbb-a0ae-043db9d296a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:09.094446 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9439fa-24b2-4fbb-a0ae-043db9d296a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:09.094735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9439fa-24b2-4fbb-a0ae-043db9d296a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:09.095513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9439fa-24b2-4fbb-a0ae-043db9d296a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:09.097795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9439fa-24b2-4fbb-a0ae-043db9d296a5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:09.111122 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1137/2285] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:09.119264 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15cfa6-fc15-4a99-bf32-7fea3cda1091 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:09.129837 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15cfa6-fc15-4a99-bf32-7fea3cda1091 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:09.135523 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62690983-d2ef-417b-9ee6-172ce31503c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:09.136323 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62690983-d2ef-417b-9ee6-172ce31503c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:09.136791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62690983-d2ef-417b-9ee6-172ce31503c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:09.137169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62690983-d2ef-417b-9ee6-172ce31503c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:09.138006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62690983-d2ef-417b-9ee6-172ce31503c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:09.139696 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62690983-d2ef-417b-9ee6-172ce31503c5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:09.152592 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1149/2286] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:09.156728 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9439fa-24b2-4fbb-a0ae-043db9d296a5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:09.168940 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9439fa-24b2-4fbb-a0ae-043db9d296a5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:09.177532 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c21cc-b4b7-42ed-acad-fb67ad42da82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:09.179918 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c21cc-b4b7-42ed-acad-fb67ad42da82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:09.181019 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c21cc-b4b7-42ed-acad-fb67ad42da82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:09.181529 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c21cc-b4b7-42ed-acad-fb67ad42da82 admin admin] PATH_INFO: `/v3/projects/b9562e9c747f4808a67c01436d9ede47/users/4e68c10e83634018b70ca664e1e8f08c/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:09.201957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c21cc-b4b7-42ed-acad-fb67ad42da82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9562e9c747f4808a67c01436d9ede47, user_id=4e68c10e83634018b70ca664e1e8f08c, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:09.204813 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c21cc-b4b7-42ed-acad-fb67ad42da82 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:09.290160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1138/2287] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:58:09 2022] PUT /identity/v3/projects/b9562e9c747f4808a67c01436d9ede47/users/4e68c10e83634018b70ca664e1e8f08c/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:09.295745 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c77b1-2048-44ca-8342-b74ef9caded6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:09.296087 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c77b1-2048-44ca-8342-b74ef9caded6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:09.300518 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c77b1-2048-44ca-8342-b74ef9caded6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:09.317176 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-515c77b1-2048-44ca-8342-b74ef9caded6 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:09.318582 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-515c77b1-2048-44ca-8342-b74ef9caded6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:09.387240 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1150/2288] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:09.397868 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c21cc-b4b7-42ed-acad-fb67ad42da82 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:09.399778 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4f7c21cc-b4b7-42ed-acad-fb67ad42da82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:09.459989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c21cc-b4b7-42ed-acad-fb67ad42da82 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:09.464432 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5e449-c846-4a64-aefb-633471949d34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:09.465098 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5e449-c846-4a64-aefb-633471949d34 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:09.465413 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5e449-c846-4a64-aefb-633471949d34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:09.465686 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5e449-c846-4a64-aefb-633471949d34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:09.477238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5e449-c846-4a64-aefb-633471949d34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:09.478718 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5e449-c846-4a64-aefb-633471949d34 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:09.489568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1139/2289] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:58:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:11.714723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72d6c9-1870-4c75-b3cc-63b0e4963898 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:11.715392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72d6c9-1870-4c75-b3cc-63b0e4963898 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:11.715795 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72d6c9-1870-4c75-b3cc-63b0e4963898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:11.750102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0b72d6c9-1870-4c75-b3cc-63b0e4963898 None None] MFA Rules not processed for user `1cf5ba73296e41c4ab58a6a962b578d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:11.752124 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0b72d6c9-1870-4c75-b3cc-63b0e4963898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:11.877157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1151/2290] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:58:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:16.523388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0c4cb-a557-412b-84ee-74ac35181ffd None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:16.525896 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0c4cb-a557-412b-84ee-74ac35181ffd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:16.525896 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0c4cb-a557-412b-84ee-74ac35181ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:16.569909 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:16.587629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-38f0c4cb-a557-412b-84ee-74ac35181ffd None None] MFA Rules not processed for user `4e68c10e83634018b70ca664e1e8f08c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:16.588920 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-38f0c4cb-a557-412b-84ee-74ac35181ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:16.663426 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1140/2291] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:58:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:16.668011 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72d6c9-1870-4c75-b3cc-63b0e4963898 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:16.680319 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72d6c9-1870-4c75-b3cc-63b0e4963898 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:16.685203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a210cfb-4871-418f-85c1-ac98ccdcc2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:16.685982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a210cfb-4871-418f-85c1-ac98ccdcc2ef admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:16.686316 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a210cfb-4871-418f-85c1-ac98ccdcc2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:16.686802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a210cfb-4871-418f-85c1-ac98ccdcc2ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:16.687506 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a210cfb-4871-418f-85c1-ac98ccdcc2ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:16.689466 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a210cfb-4871-418f-85c1-ac98ccdcc2ef admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:16.701751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:16.805838 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1152/2292] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:58:16 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:16.810265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0c4cb-a557-412b-84ee-74ac35181ffd None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:16.829493 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0c4cb-a557-412b-84ee-74ac35181ffd None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:16.942966 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550efe3e-83b3-4321-8e87-953a6918977b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:16.943669 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550efe3e-83b3-4321-8e87-953a6918977b admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:16.944026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550efe3e-83b3-4321-8e87-953a6918977b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:16.944381 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550efe3e-83b3-4321-8e87-953a6918977b admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:16.945291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550efe3e-83b3-4321-8e87-953a6918977b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:16.947698 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550efe3e-83b3-4321-8e87-953a6918977b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:17.090827 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1141/2293] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:58:16 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:58:17.091397 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a210cfb-4871-418f-85c1-ac98ccdcc2ef admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:17.121210 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a210cfb-4871-418f-85c1-ac98ccdcc2ef admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:17.125873 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98855f-ad88-4967-a14d-107571a1eae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:17.126767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98855f-ad88-4967-a14d-107571a1eae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:17.127131 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98855f-ad88-4967-a14d-107571a1eae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:17.127470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98855f-ad88-4967-a14d-107571a1eae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:17.129339 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98855f-ad88-4967-a14d-107571a1eae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:17.131056 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98855f-ad88-4967-a14d-107571a1eae4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:17.144704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1153/2294] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:58:17.148624 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550efe3e-83b3-4321-8e87-953a6918977b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:17.162705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550efe3e-83b3-4321-8e87-953a6918977b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:17.175067 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8236ea-f9af-4aac-a8fe-c3102d5f2a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:17.175984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8236ea-f9af-4aac-a8fe-c3102d5f2a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:17.176263 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8236ea-f9af-4aac-a8fe-c3102d5f2a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:17.176538 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8236ea-f9af-4aac-a8fe-c3102d5f2a16 admin admin] PATH_INFO: `/v3/projects/c47b3f47f4274f978c20a051237a844f/users/e45a747f756b46b982b4ab6091a592cf/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:17.194444 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8236ea-f9af-4aac-a8fe-c3102d5f2a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c47b3f47f4274f978c20a051237a844f, user_id=e45a747f756b46b982b4ab6091a592cf, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:17.197275 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8236ea-f9af-4aac-a8fe-c3102d5f2a16 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:17.317138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1142/2295] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:58:17 2022] PUT /identity/v3/projects/c47b3f47f4274f978c20a051237a844f/users/e45a747f756b46b982b4ab6091a592cf/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:17.321580 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98855f-ad88-4967-a14d-107571a1eae4 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:17.332739 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98855f-ad88-4967-a14d-107571a1eae4 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:17.399664 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36d148-520b-4843-ab56-c67c953c3623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:17.400347 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36d148-520b-4843-ab56-c67c953c3623 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:17.400695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36d148-520b-4843-ab56-c67c953c3623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:17.400977 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36d148-520b-4843-ab56-c67c953c3623 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:17.401744 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36d148-520b-4843-ab56-c67c953c3623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:17.403420 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36d148-520b-4843-ab56-c67c953c3623 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:17.414738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1154/2296] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:58:17.419167 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8236ea-f9af-4aac-a8fe-c3102d5f2a16 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:17.430464 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8236ea-f9af-4aac-a8fe-c3102d5f2a16 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:17.435216 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b3672-3d25-4e87-8baa-45ce98c0f682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:17.436133 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b3672-3d25-4e87-8baa-45ce98c0f682 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:17.436425 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b3672-3d25-4e87-8baa-45ce98c0f682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:17.436701 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b3672-3d25-4e87-8baa-45ce98c0f682 admin admin] PATH_INFO: `/v3/projects/c47b3f47f4274f978c20a051237a844f/users/e45a747f756b46b982b4ab6091a592cf/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:17.438758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b3672-3d25-4e87-8baa-45ce98c0f682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c47b3f47f4274f978c20a051237a844f, user_id=e45a747f756b46b982b4ab6091a592cf, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:17.441459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b3672-3d25-4e87-8baa-45ce98c0f682 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:17.452575 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1143/2297] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:58:17 2022] PUT /identity/v3/projects/c47b3f47f4274f978c20a051237a844f/users/e45a747f756b46b982b4ab6091a592cf/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:58:17.878678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36d148-520b-4843-ab56-c67c953c3623 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:17.959828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36d148-520b-4843-ab56-c67c953c3623 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:18.020732 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314817b1-f84c-4add-89e6-37f9d136e953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:18.021440 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314817b1-f84c-4add-89e6-37f9d136e953 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:18.021802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314817b1-f84c-4add-89e6-37f9d136e953 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:18.022062 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314817b1-f84c-4add-89e6-37f9d136e953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:18.024109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-314817b1-f84c-4add-89e6-37f9d136e953 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:18.088761 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:18.119572 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314817b1-f84c-4add-89e6-37f9d136e953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:18.121329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314817b1-f84c-4add-89e6-37f9d136e953 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:18.134877 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1155/2298] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:58:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:23.935456 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50ed4b-8b2d-44dd-b57d-5c4d8f1642a2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:23.936022 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50ed4b-8b2d-44dd-b57d-5c4d8f1642a2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:23.936151 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50ed4b-8b2d-44dd-b57d-5c4d8f1642a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:23.965640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2c50ed4b-8b2d-44dd-b57d-5c4d8f1642a2 None None] MFA Rules not processed for user `e45a747f756b46b982b4ab6091a592cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:23.966801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2c50ed4b-8b2d-44dd-b57d-5c4d8f1642a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:24.018261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:24.048049 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1144/2299] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:58:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:24.062954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314817b1-f84c-4add-89e6-37f9d136e953 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:24.066536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-314817b1-f84c-4add-89e6-37f9d136e953 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:24.102127 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314817b1-f84c-4add-89e6-37f9d136e953 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:24.107738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157cbb3-fdb6-44ea-85c8-346440d0aa1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:24.108394 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157cbb3-fdb6-44ea-85c8-346440d0aa1f service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:24.108679 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157cbb3-fdb6-44ea-85c8-346440d0aa1f service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:24.108958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157cbb3-fdb6-44ea-85c8-346440d0aa1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:24.184511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157cbb3-fdb6-44ea-85c8-346440d0aa1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:24.187317 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157cbb3-fdb6-44ea-85c8-346440d0aa1f service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:24.216990 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1156/2300] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:58:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:25.484618 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50ed4b-8b2d-44dd-b57d-5c4d8f1642a2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:25.495863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50ed4b-8b2d-44dd-b57d-5c4d8f1642a2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:25.499787 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d264c-7956-4647-abb9-64f3bb7c2630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:25.500588 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d264c-7956-4647-abb9-64f3bb7c2630 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:25.500969 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d264c-7956-4647-abb9-64f3bb7c2630 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:25.501405 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d264c-7956-4647-abb9-64f3bb7c2630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:25.503480 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-011d264c-7956-4647-abb9-64f3bb7c2630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:25.519619 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d264c-7956-4647-abb9-64f3bb7c2630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:25.521227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d264c-7956-4647-abb9-64f3bb7c2630 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:25.537408 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1145/2301] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:58:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:27.141406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdb0d2-fb0f-492d-8c3e-ccdd8ba34b11 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:27.141406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdb0d2-fb0f-492d-8c3e-ccdd8ba34b11 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:27.141406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdb0d2-fb0f-492d-8c3e-ccdd8ba34b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:27.160904 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-78cdb0d2-fb0f-492d-8c3e-ccdd8ba34b11 None None] MFA Rules not processed for user `4e68c10e83634018b70ca664e1e8f08c`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:27.162449 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-78cdb0d2-fb0f-492d-8c3e-ccdd8ba34b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:27.179410 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1157/2302] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:58:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:35.529708 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=17 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:36.913242 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d264c-7956-4647-abb9-64f3bb7c2630 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:36.914711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-011d264c-7956-4647-abb9-64f3bb7c2630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:36.929236 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d264c-7956-4647-abb9-64f3bb7c2630 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:36.939263 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c120c2e-bc9e-45a8-8778-c86a97a58efc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:36.954908 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c120c2e-bc9e-45a8-8778-c86a97a58efc service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:36.954908 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c120c2e-bc9e-45a8-8778-c86a97a58efc service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:36.954908 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c120c2e-bc9e-45a8-8778-c86a97a58efc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:36.954908 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7c120c2e-bc9e-45a8-8778-c86a97a58efc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:37.008392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c120c2e-bc9e-45a8-8778-c86a97a58efc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:37.017916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c120c2e-bc9e-45a8-8778-c86a97a58efc service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:37.020543 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1146/2303] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:58:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:37.153608 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=43 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:41.666413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c573210-3f8a-4055-948a-47f6488e0298 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:41.666980 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c573210-3f8a-4055-948a-47f6488e0298 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:41.666980 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c573210-3f8a-4055-948a-47f6488e0298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:41.689383 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8c573210-3f8a-4055-948a-47f6488e0298 None None] MFA Rules not processed for user `1551f28754a64d1d9010ed90b67c5dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:41.690658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8c573210-3f8a-4055-948a-47f6488e0298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:41.750094 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1158/2304] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:58:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:42.062018 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c120c2e-bc9e-45a8-8778-c86a97a58efc service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:42.072900 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c120c2e-bc9e-45a8-8778-c86a97a58efc service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:42.076592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2f20d-53e2-4ca0-b7d3-598ab058fd0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:42.077471 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2f20d-53e2-4ca0-b7d3-598ab058fd0d service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:42.077747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2f20d-53e2-4ca0-b7d3-598ab058fd0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:42.078018 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2f20d-53e2-4ca0-b7d3-598ab058fd0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:42.079820 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-47b2f20d-53e2-4ca0-b7d3-598ab058fd0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:42.091978 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2f20d-53e2-4ca0-b7d3-598ab058fd0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:42.093484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2f20d-53e2-4ca0-b7d3-598ab058fd0d service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:42.104477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1147/2305] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:58:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:42.520233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c573210-3f8a-4055-948a-47f6488e0298 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:42.521745 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8c573210-3f8a-4055-948a-47f6488e0298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:42.605803 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c573210-3f8a-4055-948a-47f6488e0298 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:42.610823 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd566ab-38fd-4b23-bdae-93b94442595e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beeefb9b8d394407a5e7a32f5a00ffad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:42.611494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd566ab-38fd-4b23-bdae-93b94442595e service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:42.612300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd566ab-38fd-4b23-bdae-93b94442595e service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:42.612573 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd566ab-38fd-4b23-bdae-93b94442595e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:42.614431 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ddd566ab-38fd-4b23-bdae-93b94442595e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:42.626282 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd566ab-38fd-4b23-bdae-93b94442595e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:42.628442 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd566ab-38fd-4b23-bdae-93b94442595e service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:42.639333 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1159/2306] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:58:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:47.024067 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2f20d-53e2-4ca0-b7d3-598ab058fd0d service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:47.025660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-47b2f20d-53e2-4ca0-b7d3-598ab058fd0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:47.047201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2f20d-53e2-4ca0-b7d3-598ab058fd0d service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:47.047201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd514e3-85a8-4b64-8dd2-770d19637be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:47.047201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd514e3-85a8-4b64-8dd2-770d19637be4 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:47.047201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd514e3-85a8-4b64-8dd2-770d19637be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:47.047606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd514e3-85a8-4b64-8dd2-770d19637be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:47.047606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3cd514e3-85a8-4b64-8dd2-770d19637be4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:47.056719 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd514e3-85a8-4b64-8dd2-770d19637be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:47.058213 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd514e3-85a8-4b64-8dd2-770d19637be4 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:47.067670 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1148/2307] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:58:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:49.839036 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055c089-d74c-47e3-947c-00ce63054b89 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:49.839578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055c089-d74c-47e3-947c-00ce63054b89 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:49.839675 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055c089-d74c-47e3-947c-00ce63054b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:49.859009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c055c089-d74c-47e3-947c-00ce63054b89 None None] MFA Rules not processed for user `89f20368c3a747a49a3aaa556115d169`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:49.860438 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c055c089-d74c-47e3-947c-00ce63054b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:49.868294 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1160/2308] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:58:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:50.183761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd514e3-85a8-4b64-8dd2-770d19637be4 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:50.193245 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd514e3-85a8-4b64-8dd2-770d19637be4 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:50.197670 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3f0ee-ee72-43dd-b977-af78ecbefd3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:50.198329 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3f0ee-ee72-43dd-b977-af78ecbefd3d service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:50.198620 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3f0ee-ee72-43dd-b977-af78ecbefd3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:50.198900 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3f0ee-ee72-43dd-b977-af78ecbefd3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:50.200713 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b2b3f0ee-ee72-43dd-b977-af78ecbefd3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:50.211373 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3f0ee-ee72-43dd-b977-af78ecbefd3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:50.212804 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3f0ee-ee72-43dd-b977-af78ecbefd3d service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:50.220759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1149/2309] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:58:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:53.465866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055c089-d74c-47e3-947c-00ce63054b89 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:53.501330 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055c089-d74c-47e3-947c-00ce63054b89 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:53.511385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a55b0-35b4-4fb2-b3c0-6bd9bfcb0f6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:53.512398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a55b0-35b4-4fb2-b3c0-6bd9bfcb0f6e service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:53.512780 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a55b0-35b4-4fb2-b3c0-6bd9bfcb0f6e service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:53.513090 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a55b0-35b4-4fb2-b3c0-6bd9bfcb0f6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:53.525794 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8c2a55b0-35b4-4fb2-b3c0-6bd9bfcb0f6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:53.537564 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a55b0-35b4-4fb2-b3c0-6bd9bfcb0f6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:53.547206 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a55b0-35b4-4fb2-b3c0-6bd9bfcb0f6e service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:53.559591 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1161/2310] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:58:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:59.009953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3f0ee-ee72-43dd-b977-af78ecbefd3d service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:59.011706 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b2b3f0ee-ee72-43dd-b977-af78ecbefd3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:59.082813 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3f0ee-ee72-43dd-b977-af78ecbefd3d service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:59.086416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501278e-c236-4ba3-9742-c109358028cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:59.087112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501278e-c236-4ba3-9742-c109358028cb service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:59.087391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501278e-c236-4ba3-9742-c109358028cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:59.087664 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501278e-c236-4ba3-9742-c109358028cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:59.089683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b501278e-c236-4ba3-9742-c109358028cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:59.154640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501278e-c236-4ba3-9742-c109358028cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:59.156103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501278e-c236-4ba3-9742-c109358028cb service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:59.166164 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1150/2311] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:58:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:00.038451 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a55b0-35b4-4fb2-b3c0-6bd9bfcb0f6e service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:00.043840 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501278e-c236-4ba3-9742-c109358028cb service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:00.051161 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a55b0-35b4-4fb2-b3c0-6bd9bfcb0f6e service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:00.054772 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501278e-c236-4ba3-9742-c109358028cb service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:00.057741 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357837b-b6ac-498f-957e-f7a70ea4b5f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:00.058463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357837b-b6ac-498f-957e-f7a70ea4b5f3 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:00.058781 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14c45e-9468-40ab-9cb5-f294834352c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:00.059591 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357837b-b6ac-498f-957e-f7a70ea4b5f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:00.059591 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357837b-b6ac-498f-957e-f7a70ea4b5f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:00.059942 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14c45e-9468-40ab-9cb5-f294834352c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:00.060401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14c45e-9468-40ab-9cb5-f294834352c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:00.060840 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14c45e-9468-40ab-9cb5-f294834352c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:00.061839 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e357837b-b6ac-498f-957e-f7a70ea4b5f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:00.062886 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ea14c45e-9468-40ab-9cb5-f294834352c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:00.077627 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357837b-b6ac-498f-957e-f7a70ea4b5f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:00.079349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357837b-b6ac-498f-957e-f7a70ea4b5f3 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:00.084661 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:00.091381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1162/2312] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:59:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:00.141490 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14c45e-9468-40ab-9cb5-f294834352c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:00.143186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14c45e-9468-40ab-9cb5-f294834352c7 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:00.155207 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1151/2313] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:59:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:03.550358 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357837b-b6ac-498f-957e-f7a70ea4b5f3 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:03.562362 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357837b-b6ac-498f-957e-f7a70ea4b5f3 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:03.568416 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d3694-80e8-4092-9dc1-092cb18c1cc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:03.569072 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3694-80e8-4092-9dc1-092cb18c1cc7 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:03.569428 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3694-80e8-4092-9dc1-092cb18c1cc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:03.569709 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3694-80e8-4092-9dc1-092cb18c1cc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:03.571543 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-746d3694-80e8-4092-9dc1-092cb18c1cc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:03.585442 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d3694-80e8-4092-9dc1-092cb18c1cc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:03.587160 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d3694-80e8-4092-9dc1-092cb18c1cc7 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:03.599439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1163/2314] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:59:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:10.167465 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=22 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:12.401612 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14c45e-9468-40ab-9cb5-f294834352c7 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:12.411755 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14c45e-9468-40ab-9cb5-f294834352c7 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:12.415336 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f113dc9-f780-46c0-b4f2-cab674f93d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:12.416000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f113dc9-f780-46c0-b4f2-cab674f93d30 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:12.416280 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f113dc9-f780-46c0-b4f2-cab674f93d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:12.416555 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f113dc9-f780-46c0-b4f2-cab674f93d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:12.426616 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f113dc9-f780-46c0-b4f2-cab674f93d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:12.428149 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f113dc9-f780-46c0-b4f2-cab674f93d30 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:12.438451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1152/2315] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:59:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:13.593698 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=78 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:14.661498 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea1ded-de88-4448-8ab1-7fee589387b6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:14.662138 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea1ded-de88-4448-8ab1-7fee589387b6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:14.662138 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea1ded-de88-4448-8ab1-7fee589387b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:14.681035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-38ea1ded-de88-4448-8ab1-7fee589387b6 None None] MFA Rules not processed for user `d5684eb0dd3141f5a25b61aafedbe865`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:14.682366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-38ea1ded-de88-4448-8ab1-7fee589387b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:14.689952 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1164/2316] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:59:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:22.433989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:24.675657 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:31.421019 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f113dc9-f780-46c0-b4f2-cab674f93d30 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:31.430612 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f113dc9-f780-46c0-b4f2-cab674f93d30 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:31.435138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a1b64-54a7-4557-9260-4739f84fe7d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:31.435826 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a1b64-54a7-4557-9260-4739f84fe7d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:31.436108 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a1b64-54a7-4557-9260-4739f84fe7d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:31.436563 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a1b64-54a7-4557-9260-4739f84fe7d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:31.438509 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a68a1b64-54a7-4557-9260-4739f84fe7d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:31.505310 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a1b64-54a7-4557-9260-4739f84fe7d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:31.506752 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a1b64-54a7-4557-9260-4739f84fe7d5 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:31.516664 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1153/2317] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:59:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:35.957054 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea1ded-de88-4448-8ab1-7fee589387b6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:35.958695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-38ea1ded-de88-4448-8ab1-7fee589387b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:35.975395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea1ded-de88-4448-8ab1-7fee589387b6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:35.980040 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be0cc0-97e5-4bdd-ab2a-8c14ad6d8c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:35.980924 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be0cc0-97e5-4bdd-ab2a-8c14ad6d8c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:35.981203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be0cc0-97e5-4bdd-ab2a-8c14ad6d8c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:35.981519 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be0cc0-97e5-4bdd-ab2a-8c14ad6d8c06 admin admin] PATH_INFO: `/v3/users/1cf5ba73296e41c4ab58a6a962b578d3` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:35.982748 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be0cc0-97e5-4bdd-ab2a-8c14ad6d8c06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cf5ba73296e41c4ab58a6a962b578d3)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:35.984684 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be0cc0-97e5-4bdd-ab2a-8c14ad6d8c06 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:36.141536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-56be0cc0-97e5-4bdd-ab2a-8c14ad6d8c06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cf5ba73296e41c4ab58a6a962b578d3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:36.142114 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-56be0cc0-97e5-4bdd-ab2a-8c14ad6d8c06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cf5ba73296e41c4ab58a6a962b578d3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:36.149493 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-56be0cc0-97e5-4bdd-ab2a-8c14ad6d8c06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cf5ba73296e41c4ab58a6a962b578d3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:36.252944 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-56be0cc0-97e5-4bdd-ab2a-8c14ad6d8c06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cf5ba73296e41c4ab58a6a962b578d3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:36.253717 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-56be0cc0-97e5-4bdd-ab2a-8c14ad6d8c06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cf5ba73296e41c4ab58a6a962b578d3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:36.273245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1165/2318] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:59:35 2022] DELETE /identity/v3/users/1cf5ba73296e41c4ab58a6a962b578d3 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:36.510981 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a1b64-54a7-4557-9260-4739f84fe7d5 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:36.523170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a1b64-54a7-4557-9260-4739f84fe7d5 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:36.590446 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88748af6-98e3-4203-90bf-68919063379f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:36.591505 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88748af6-98e3-4203-90bf-68919063379f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:36.591783 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88748af6-98e3-4203-90bf-68919063379f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:36.592058 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88748af6-98e3-4203-90bf-68919063379f admin admin] PATH_INFO: `/v3/projects/5150e5b054d34d09a3cb69e35f9c86dd` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:36.593366 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88748af6-98e3-4203-90bf-68919063379f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5150e5b054d34d09a3cb69e35f9c86dd)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:36.596107 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88748af6-98e3-4203-90bf-68919063379f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:36.690430 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-88748af6-98e3-4203-90bf-68919063379f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5150e5b054d34d09a3cb69e35f9c86dd', 'request_id': 'req-88748af6-98e3-4203-90bf-68919063379f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:36.698214 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-88748af6-98e3-4203-90bf-68919063379f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5150e5b054d34d09a3cb69e35f9c86dd', 'request_id': 'req-88748af6-98e3-4203-90bf-68919063379f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:36.705506 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-88748af6-98e3-4203-90bf-68919063379f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5150e5b054d34d09a3cb69e35f9c86dd', 'request_id': 'req-88748af6-98e3-4203-90bf-68919063379f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:36.783398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-88748af6-98e3-4203-90bf-68919063379f admin admin] The token cache is being invalidate because project 5150e5b054d34d09a3cb69e35f9c86dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:36.783689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-88748af6-98e3-4203-90bf-68919063379f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:36.784367 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-88748af6-98e3-4203-90bf-68919063379f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:36.785954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1154/2319] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:59:36 2022] DELETE /identity/v3/projects/5150e5b054d34d09a3cb69e35f9c86dd => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:36.790874 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3121c0-465a-439e-9a89-87104de6b90e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:36.791155 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3121c0-465a-439e-9a89-87104de6b90e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:36.791428 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3121c0-465a-439e-9a89-87104de6b90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:36.809801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6b3121c0-465a-439e-9a89-87104de6b90e None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:36.811014 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6b3121c0-465a-439e-9a89-87104de6b90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:36.880160 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1166/2320] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:36.884575 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852a8a8-9338-4ed7-9489-8a370581763d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:36.884864 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852a8a8-9338-4ed7-9489-8a370581763d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:36.885144 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852a8a8-9338-4ed7-9489-8a370581763d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:36.910634 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3852a8a8-9338-4ed7-9489-8a370581763d None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:36.912108 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3852a8a8-9338-4ed7-9489-8a370581763d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:36.921003 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1155/2321] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:59:36.925316 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3121c0-465a-439e-9a89-87104de6b90e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:36.935253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3121c0-465a-439e-9a89-87104de6b90e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:36.940882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e664e-c776-4278-8279-4a1046f59bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:36.941525 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e664e-c776-4278-8279-4a1046f59bfb admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:36.941809 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e664e-c776-4278-8279-4a1046f59bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:36.942085 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e664e-c776-4278-8279-4a1046f59bfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:36.942819 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e664e-c776-4278-8279-4a1046f59bfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:59:36.943126 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e664e-c776-4278-8279-4a1046f59bfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:36.944756 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e664e-c776-4278-8279-4a1046f59bfb admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:36.957853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1167/2322] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:59:36.962540 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852a8a8-9338-4ed7-9489-8a370581763d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:36.972131 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852a8a8-9338-4ed7-9489-8a370581763d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:36.977119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3e627-c285-47b6-8655-a0b4428a4c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:36.977858 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3e627-c285-47b6-8655-a0b4428a4c09 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:36.978129 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3e627-c285-47b6-8655-a0b4428a4c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:36.978410 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3e627-c285-47b6-8655-a0b4428a4c09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:36.979139 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3e627-c285-47b6-8655-a0b4428a4c09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:36.981092 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3e627-c285-47b6-8655-a0b4428a4c09 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:36.996319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:37.094691 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1156/2323] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:59:36 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:37.099208 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e664e-c776-4278-8279-4a1046f59bfb admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:37.111255 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e664e-c776-4278-8279-4a1046f59bfb admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:37.171691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d00090-5def-41af-997a-eff9cd792a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:37.172373 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d00090-5def-41af-997a-eff9cd792a42 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:37.172684 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d00090-5def-41af-997a-eff9cd792a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:37.172964 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d00090-5def-41af-997a-eff9cd792a42 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:37.173685 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d00090-5def-41af-997a-eff9cd792a42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:37.175909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d00090-5def-41af-997a-eff9cd792a42 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:37.182830 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:37.298357 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1168/2324] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:59:37 2022] POST /identity/v3/users => generated 283 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:37.302563 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3e627-c285-47b6-8655-a0b4428a4c09 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:37.312870 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3e627-c285-47b6-8655-a0b4428a4c09 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:37.317415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18546231-f51a-4515-be89-18b72c0a08fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:37.318076 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18546231-f51a-4515-be89-18b72c0a08fe admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:37.318357 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18546231-f51a-4515-be89-18b72c0a08fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:37.318634 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18546231-f51a-4515-be89-18b72c0a08fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:37.319352 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18546231-f51a-4515-be89-18b72c0a08fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:37.320940 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18546231-f51a-4515-be89-18b72c0a08fe admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:37.331719 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1157/2325] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:37.335909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d00090-5def-41af-997a-eff9cd792a42 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:37.346656 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d00090-5def-41af-997a-eff9cd792a42 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:37.351600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6761f04-7062-463b-b4cd-3810d7170866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:37.352271 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6761f04-7062-463b-b4cd-3810d7170866 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:37.352551 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6761f04-7062-463b-b4cd-3810d7170866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:37.352826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6761f04-7062-463b-b4cd-3810d7170866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:37.353603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6761f04-7062-463b-b4cd-3810d7170866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:37.355908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6761f04-7062-463b-b4cd-3810d7170866 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:37.367923 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1169/2326] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:37.372403 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18546231-f51a-4515-be89-18b72c0a08fe admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:37.383138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18546231-f51a-4515-be89-18b72c0a08fe admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:37.387733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe3dee-8427-470f-893c-35e45579b046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:37.388653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe3dee-8427-470f-893c-35e45579b046 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:37.388927 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe3dee-8427-470f-893c-35e45579b046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:37.389197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe3dee-8427-470f-893c-35e45579b046 admin admin] PATH_INFO: `/v3/projects/8706eb52dde94e3f8768b37eda72692c/users/638cbc3c15ce480d808dae325fa7f8c7/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:37.405291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe3dee-8427-470f-893c-35e45579b046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8706eb52dde94e3f8768b37eda72692c, user_id=638cbc3c15ce480d808dae325fa7f8c7, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:37.408508 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe3dee-8427-470f-893c-35e45579b046 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:37.498151 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1158/2327] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:59:37 2022] PUT /identity/v3/projects/8706eb52dde94e3f8768b37eda72692c/users/638cbc3c15ce480d808dae325fa7f8c7/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:37.511016 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9de86-e52c-4090-ae32-a9da54d6f88b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:37.511329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9de86-e52c-4090-ae32-a9da54d6f88b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:37.511609 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9de86-e52c-4090-ae32-a9da54d6f88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:37.538466 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1ed9de86-e52c-4090-ae32-a9da54d6f88b None None] MFA Rules not processed for user `638cbc3c15ce480d808dae325fa7f8c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:37.539664 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1ed9de86-e52c-4090-ae32-a9da54d6f88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:37.605199 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1170/2328] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:59:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:59:37.609724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe3dee-8427-470f-893c-35e45579b046 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:37.671293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe3dee-8427-470f-893c-35e45579b046 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:37.676039 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44a203-6ad2-4c54-8330-9a16a1fef5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:37.676722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44a203-6ad2-4c54-8330-9a16a1fef5fa admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:37.677014 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44a203-6ad2-4c54-8330-9a16a1fef5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:37.677376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44a203-6ad2-4c54-8330-9a16a1fef5fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:37.678089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44a203-6ad2-4c54-8330-9a16a1fef5fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:37.679985 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44a203-6ad2-4c54-8330-9a16a1fef5fa admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:37.814909 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1159/2329] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:59:37 2022] POST /identity/v3/projects => generated 365 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:37.819089 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9de86-e52c-4090-ae32-a9da54d6f88b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:37.830033 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9de86-e52c-4090-ae32-a9da54d6f88b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:37.892568 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8520c51-c2a1-45cb-902c-92be6b5692d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:37.893293 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8520c51-c2a1-45cb-902c-92be6b5692d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:37.893586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8520c51-c2a1-45cb-902c-92be6b5692d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:37.893923 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8520c51-c2a1-45cb-902c-92be6b5692d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:37.894619 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8520c51-c2a1-45cb-902c-92be6b5692d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:37.896560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8520c51-c2a1-45cb-902c-92be6b5692d7 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:38.002301 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1171/2330] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:59:37 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:59:38.006285 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44a203-6ad2-4c54-8330-9a16a1fef5fa admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:38.017037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44a203-6ad2-4c54-8330-9a16a1fef5fa admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:38.021871 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cdfc2-bddd-4392-be10-e3ca90af3512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:38.022609 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cdfc2-bddd-4392-be10-e3ca90af3512 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:38.022897 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cdfc2-bddd-4392-be10-e3ca90af3512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:38.023171 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cdfc2-bddd-4392-be10-e3ca90af3512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:38.023888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cdfc2-bddd-4392-be10-e3ca90af3512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:38.025531 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cdfc2-bddd-4392-be10-e3ca90af3512 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:38.036739 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1160/2331] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:38.040986 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8520c51-c2a1-45cb-902c-92be6b5692d7 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:38.052196 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8520c51-c2a1-45cb-902c-92be6b5692d7 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:38.057057 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002f125-c0aa-4361-8e64-d3a0209989ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:38.057997 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002f125-c0aa-4361-8e64-d3a0209989ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:38.058279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002f125-c0aa-4361-8e64-d3a0209989ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:38.058556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002f125-c0aa-4361-8e64-d3a0209989ac admin admin] PATH_INFO: `/v3/projects/677b81a6da964888901330a32385bdb0/users/a339afb6c62d4b709c823a08e5af0fcc/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:38.076478 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002f125-c0aa-4361-8e64-d3a0209989ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=677b81a6da964888901330a32385bdb0, user_id=a339afb6c62d4b709c823a08e5af0fcc, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:38.079235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002f125-c0aa-4361-8e64-d3a0209989ac admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:38.150262 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1172/2332] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:59:38 2022] PUT /identity/v3/projects/677b81a6da964888901330a32385bdb0/users/a339afb6c62d4b709c823a08e5af0fcc/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:38.154124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cdfc2-bddd-4392-be10-e3ca90af3512 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:38.164593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cdfc2-bddd-4392-be10-e3ca90af3512 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:38.220607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48acc0-9d2e-49c8-a5e3-2d87bca03385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:38.221312 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48acc0-9d2e-49c8-a5e3-2d87bca03385 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:38.221589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48acc0-9d2e-49c8-a5e3-2d87bca03385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:38.221869 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48acc0-9d2e-49c8-a5e3-2d87bca03385 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:38.222604 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48acc0-9d2e-49c8-a5e3-2d87bca03385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:38.224473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48acc0-9d2e-49c8-a5e3-2d87bca03385 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:38.234320 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1161/2333] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:38.239246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002f125-c0aa-4361-8e64-d3a0209989ac admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:38.249659 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002f125-c0aa-4361-8e64-d3a0209989ac admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:38.254276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace93d97-b6b8-4de8-9aa4-8cebc13e9461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:38.255182 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace93d97-b6b8-4de8-9aa4-8cebc13e9461 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:38.255454 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace93d97-b6b8-4de8-9aa4-8cebc13e9461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:38.255720 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace93d97-b6b8-4de8-9aa4-8cebc13e9461 admin admin] PATH_INFO: `/v3/projects/677b81a6da964888901330a32385bdb0/users/a339afb6c62d4b709c823a08e5af0fcc/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:38.257706 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace93d97-b6b8-4de8-9aa4-8cebc13e9461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=677b81a6da964888901330a32385bdb0, user_id=a339afb6c62d4b709c823a08e5af0fcc, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:38.260332 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace93d97-b6b8-4de8-9aa4-8cebc13e9461 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:38.270793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1173/2334] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:59:38 2022] PUT /identity/v3/projects/677b81a6da964888901330a32385bdb0/users/a339afb6c62d4b709c823a08e5af0fcc/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:38.282838 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1968f-1250-475b-a9cc-064ecb029bb6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:38.283130 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1968f-1250-475b-a9cc-064ecb029bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:38.283446 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1968f-1250-475b-a9cc-064ecb029bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:38.313319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-98f1968f-1250-475b-a9cc-064ecb029bb6 None None] MFA Rules not processed for user `a339afb6c62d4b709c823a08e5af0fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:38.314596 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-98f1968f-1250-475b-a9cc-064ecb029bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:38.324603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:38.385639 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1162/2335] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:59:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:38.398711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace93d97-b6b8-4de8-9aa4-8cebc13e9461 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:38.400744 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ace93d97-b6b8-4de8-9aa4-8cebc13e9461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:38.424218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:38.464195 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace93d97-b6b8-4de8-9aa4-8cebc13e9461 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:38.468006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87efa99-10a1-4d68-8532-d8a5e7975a26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:38.468707 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87efa99-10a1-4d68-8532-d8a5e7975a26 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:38.468982 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87efa99-10a1-4d68-8532-d8a5e7975a26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:38.469445 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87efa99-10a1-4d68-8532-d8a5e7975a26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:38.479284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87efa99-10a1-4d68-8532-d8a5e7975a26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:38.481042 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87efa99-10a1-4d68-8532-d8a5e7975a26 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:38.491078 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1174/2336] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:59:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:39.446937 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1968f-1250-475b-a9cc-064ecb029bb6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:39.512311 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1968f-1250-475b-a9cc-064ecb029bb6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:39.517473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a1c89-cafe-4ec9-ad04-191021f15383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:39.518527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a1c89-cafe-4ec9-ad04-191021f15383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:39.518811 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a1c89-cafe-4ec9-ad04-191021f15383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:39.519090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a1c89-cafe-4ec9-ad04-191021f15383 admin admin] PATH_INFO: `/v3/users/638cbc3c15ce480d808dae325fa7f8c7` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:39.520287 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a1c89-cafe-4ec9-ad04-191021f15383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=638cbc3c15ce480d808dae325fa7f8c7)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:39.522252 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a1c89-cafe-4ec9-ad04-191021f15383 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:39.742794 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-842a1c89-cafe-4ec9-ad04-191021f15383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '638cbc3c15ce480d808dae325fa7f8c7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:39.823674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-842a1c89-cafe-4ec9-ad04-191021f15383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '638cbc3c15ce480d808dae325fa7f8c7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:39.824385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-842a1c89-cafe-4ec9-ad04-191021f15383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '638cbc3c15ce480d808dae325fa7f8c7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:39.824990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-842a1c89-cafe-4ec9-ad04-191021f15383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '638cbc3c15ce480d808dae325fa7f8c7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:39.839246 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-842a1c89-cafe-4ec9-ad04-191021f15383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '638cbc3c15ce480d808dae325fa7f8c7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:39.852654 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1163/2337] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:59:39 2022] DELETE /identity/v3/users/638cbc3c15ce480d808dae325fa7f8c7 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:39.857393 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75b735-ccec-4bc0-a481-05cb61c84248 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:39.857966 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75b735-ccec-4bc0-a481-05cb61c84248 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:39.857966 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75b735-ccec-4bc0-a481-05cb61c84248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:39.876949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-bc75b735-ccec-4bc0-a481-05cb61c84248 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:39.878238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bc75b735-ccec-4bc0-a481-05cb61c84248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:39.943482 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1175/2338] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:39.953317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a1c89-cafe-4ec9-ad04-191021f15383 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:39.954775 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-842a1c89-cafe-4ec9-ad04-191021f15383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:39.986314 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:40.011513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a1c89-cafe-4ec9-ad04-191021f15383 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:40.015108 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c478b-9957-4311-8062-233a88505cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:40.015751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c478b-9957-4311-8062-233a88505cdf service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:40.016037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c478b-9957-4311-8062-233a88505cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:40.016925 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c478b-9957-4311-8062-233a88505cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:40.026583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c478b-9957-4311-8062-233a88505cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:40.028028 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c478b-9957-4311-8062-233a88505cdf service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:40.038404 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1164/2339] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:59:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:40.505355 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75b735-ccec-4bc0-a481-05cb61c84248 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:40.506904 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bc75b735-ccec-4bc0-a481-05cb61c84248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:40.521391 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75b735-ccec-4bc0-a481-05cb61c84248 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:40.529623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7770f1a-537a-4597-a9de-7f6a2eb3e383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:40.530503 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7770f1a-537a-4597-a9de-7f6a2eb3e383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:40.530805 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7770f1a-537a-4597-a9de-7f6a2eb3e383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:40.531159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7770f1a-537a-4597-a9de-7f6a2eb3e383 admin admin] PATH_INFO: `/v3/projects/8706eb52dde94e3f8768b37eda72692c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:40.532873 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7770f1a-537a-4597-a9de-7f6a2eb3e383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8706eb52dde94e3f8768b37eda72692c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:40.534791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7770f1a-537a-4597-a9de-7f6a2eb3e383 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:40.636060 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b7770f1a-537a-4597-a9de-7f6a2eb3e383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8706eb52dde94e3f8768b37eda72692c', 'request_id': 'req-b7770f1a-537a-4597-a9de-7f6a2eb3e383'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:40.709462 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b7770f1a-537a-4597-a9de-7f6a2eb3e383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8706eb52dde94e3f8768b37eda72692c', 'request_id': 'req-b7770f1a-537a-4597-a9de-7f6a2eb3e383'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:40.716421 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b7770f1a-537a-4597-a9de-7f6a2eb3e383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8706eb52dde94e3f8768b37eda72692c', 'request_id': 'req-b7770f1a-537a-4597-a9de-7f6a2eb3e383'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:40.728820 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b7770f1a-537a-4597-a9de-7f6a2eb3e383 admin admin] The token cache is being invalidate because project 8706eb52dde94e3f8768b37eda72692c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:40.737055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b7770f1a-537a-4597-a9de-7f6a2eb3e383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:40.737055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b7770f1a-537a-4597-a9de-7f6a2eb3e383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:40.737055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1176/2340] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:59:40 2022] DELETE /identity/v3/projects/8706eb52dde94e3f8768b37eda72692c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:40.737408 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c478b-9957-4311-8062-233a88505cdf service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:40.746043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c478b-9957-4311-8062-233a88505cdf service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:40.801676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13faa037-9e1a-48dc-a3a2-f421d242ae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:40.802664 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faa037-9e1a-48dc-a3a2-f421d242ae96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:40.817325 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faa037-9e1a-48dc-a3a2-f421d242ae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:40.817325 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faa037-9e1a-48dc-a3a2-f421d242ae96 admin admin] PATH_INFO: `/v3/users/a339afb6c62d4b709c823a08e5af0fcc` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:40.817325 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13faa037-9e1a-48dc-a3a2-f421d242ae96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a339afb6c62d4b709c823a08e5af0fcc)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:40.817325 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13faa037-9e1a-48dc-a3a2-f421d242ae96 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:41.129462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-13faa037-9e1a-48dc-a3a2-f421d242ae96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a339afb6c62d4b709c823a08e5af0fcc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:41.252829 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-13faa037-9e1a-48dc-a3a2-f421d242ae96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a339afb6c62d4b709c823a08e5af0fcc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:41.253474 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-13faa037-9e1a-48dc-a3a2-f421d242ae96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a339afb6c62d4b709c823a08e5af0fcc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:41.254099 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-13faa037-9e1a-48dc-a3a2-f421d242ae96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a339afb6c62d4b709c823a08e5af0fcc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:41.261642 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-13faa037-9e1a-48dc-a3a2-f421d242ae96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a339afb6c62d4b709c823a08e5af0fcc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:41.279421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1165/2341] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:59:40 2022] DELETE /identity/v3/users/a339afb6c62d4b709c823a08e5af0fcc => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:41.717178 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7770f1a-537a-4597-a9de-7f6a2eb3e383 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:41.718771 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b7770f1a-537a-4597-a9de-7f6a2eb3e383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:41.734248 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7770f1a-537a-4597-a9de-7f6a2eb3e383 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:41.783598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:41.797064 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b2eb9-5dca-4898-acea-4a6cae993c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:41.798707 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b2eb9-5dca-4898-acea-4a6cae993c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:41.805953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b2eb9-5dca-4898-acea-4a6cae993c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:41.805953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b2eb9-5dca-4898-acea-4a6cae993c1e admin admin] PATH_INFO: `/v3/projects/677b81a6da964888901330a32385bdb0` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:41.805953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b2eb9-5dca-4898-acea-4a6cae993c1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=677b81a6da964888901330a32385bdb0)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:41.805953 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b2eb9-5dca-4898-acea-4a6cae993c1e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:41.946135 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5f1b2eb9-5dca-4898-acea-4a6cae993c1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '677b81a6da964888901330a32385bdb0', 'request_id': 'req-5f1b2eb9-5dca-4898-acea-4a6cae993c1e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:42.075256 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5f1b2eb9-5dca-4898-acea-4a6cae993c1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '677b81a6da964888901330a32385bdb0', 'request_id': 'req-5f1b2eb9-5dca-4898-acea-4a6cae993c1e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:42.083507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5f1b2eb9-5dca-4898-acea-4a6cae993c1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '677b81a6da964888901330a32385bdb0', 'request_id': 'req-5f1b2eb9-5dca-4898-acea-4a6cae993c1e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:42.094385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5f1b2eb9-5dca-4898-acea-4a6cae993c1e admin admin] The token cache is being invalidate because project 677b81a6da964888901330a32385bdb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:42.094670 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5f1b2eb9-5dca-4898-acea-4a6cae993c1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:42.095416 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5f1b2eb9-5dca-4898-acea-4a6cae993c1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:42.097199 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1177/2342] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:59:41 2022] DELETE /identity/v3/projects/677b81a6da964888901330a32385bdb0 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:42.102996 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291183c-b4dd-4b66-a643-06fa5db475ac None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:42.103490 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291183c-b4dd-4b66-a643-06fa5db475ac None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:42.103590 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291183c-b4dd-4b66-a643-06fa5db475ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:42.124339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e291183c-b4dd-4b66-a643-06fa5db475ac None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:42.126146 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e291183c-b4dd-4b66-a643-06fa5db475ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:42.171395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:42.187024 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1166/2343] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:42.195481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7225b8-044c-44c3-810e-937fb01aa4dc None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:42.195770 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7225b8-044c-44c3-810e-937fb01aa4dc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:42.196050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7225b8-044c-44c3-810e-937fb01aa4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:42.215164 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ec7225b8-044c-44c3-810e-937fb01aa4dc None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:42.216359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ec7225b8-044c-44c3-810e-937fb01aa4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:42.224839 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1178/2344] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:42.229105 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291183c-b4dd-4b66-a643-06fa5db475ac None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:42.239359 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291183c-b4dd-4b66-a643-06fa5db475ac None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:42.244009 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48466a28-9816-43c6-a8bd-67a808bceac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:42.244664 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48466a28-9816-43c6-a8bd-67a808bceac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:42.244947 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48466a28-9816-43c6-a8bd-67a808bceac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:42.246880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48466a28-9816-43c6-a8bd-67a808bceac8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:42.246880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48466a28-9816-43c6-a8bd-67a808bceac8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:59:42.246880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48466a28-9816-43c6-a8bd-67a808bceac8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:42.247853 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48466a28-9816-43c6-a8bd-67a808bceac8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:42.260225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1167/2345] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 16:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:59:42.264617 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7225b8-044c-44c3-810e-937fb01aa4dc None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:42.274995 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7225b8-044c-44c3-810e-937fb01aa4dc None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:42.279730 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d691f-3485-495f-88e6-3aaaa955de8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:42.280383 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d691f-3485-495f-88e6-3aaaa955de8e admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:42.280667 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d691f-3485-495f-88e6-3aaaa955de8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:42.280942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d691f-3485-495f-88e6-3aaaa955de8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:42.281679 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d691f-3485-495f-88e6-3aaaa955de8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:42.283720 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d691f-3485-495f-88e6-3aaaa955de8e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:42.381728 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1179/2346] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:59:42 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:42.385942 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48466a28-9816-43c6-a8bd-67a808bceac8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:42.396945 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48466a28-9816-43c6-a8bd-67a808bceac8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:42.456343 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c7964-345c-4055-8006-08db41495f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:42.457037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c7964-345c-4055-8006-08db41495f86 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:42.457360 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c7964-345c-4055-8006-08db41495f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:42.457645 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c7964-345c-4055-8006-08db41495f86 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:42.458346 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c7964-345c-4055-8006-08db41495f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:42.460301 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c7964-345c-4055-8006-08db41495f86 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:42.544845 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1168/2347] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:59:42 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:42.550649 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d691f-3485-495f-88e6-3aaaa955de8e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:42.569772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d691f-3485-495f-88e6-3aaaa955de8e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:42.577737 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87514e-ff8a-41bd-a00b-9f30ed0b9b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:42.578884 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87514e-ff8a-41bd-a00b-9f30ed0b9b29 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:42.579394 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87514e-ff8a-41bd-a00b-9f30ed0b9b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:42.579891 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87514e-ff8a-41bd-a00b-9f30ed0b9b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:42.581282 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87514e-ff8a-41bd-a00b-9f30ed0b9b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:42.584434 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87514e-ff8a-41bd-a00b-9f30ed0b9b29 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:42.606144 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1180/2348] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:42.613462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c7964-345c-4055-8006-08db41495f86 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:42.623929 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c7964-345c-4055-8006-08db41495f86 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:42.629096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00a0de-376c-4f81-b8dd-924c6a8706b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:42.629779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00a0de-376c-4f81-b8dd-924c6a8706b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:42.630061 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00a0de-376c-4f81-b8dd-924c6a8706b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:42.630330 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00a0de-376c-4f81-b8dd-924c6a8706b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:42.631039 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00a0de-376c-4f81-b8dd-924c6a8706b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:42.632679 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00a0de-376c-4f81-b8dd-924c6a8706b9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:42.642792 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1169/2349] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:42.646873 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87514e-ff8a-41bd-a00b-9f30ed0b9b29 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:42.657334 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87514e-ff8a-41bd-a00b-9f30ed0b9b29 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:42.662116 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60ebd4-dc84-4358-9213-cf58555de3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:42.662998 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60ebd4-dc84-4358-9213-cf58555de3b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:42.663336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60ebd4-dc84-4358-9213-cf58555de3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:42.663563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60ebd4-dc84-4358-9213-cf58555de3b6 admin admin] PATH_INFO: `/v3/projects/82236acce03c4c718830113cea699006/users/934842ea41784fea9f7be12aa914bddd/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:42.678945 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60ebd4-dc84-4358-9213-cf58555de3b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82236acce03c4c718830113cea699006, user_id=934842ea41784fea9f7be12aa914bddd, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:42.681637 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60ebd4-dc84-4358-9213-cf58555de3b6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:42.841286 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1181/2350] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:59:42 2022] PUT /identity/v3/projects/82236acce03c4c718830113cea699006/users/934842ea41784fea9f7be12aa914bddd/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:42.853761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911e5df-9d66-408e-a264-90919c4fa928 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:42.855741 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911e5df-9d66-408e-a264-90919c4fa928 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:42.855741 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911e5df-9d66-408e-a264-90919c4fa928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:42.882324 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5911e5df-9d66-408e-a264-90919c4fa928 None None] MFA Rules not processed for user `934842ea41784fea9f7be12aa914bddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:42.883598 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5911e5df-9d66-408e-a264-90919c4fa928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:42.948972 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1170/2351] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:59:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:42.953512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60ebd4-dc84-4358-9213-cf58555de3b6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:43.017360 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60ebd4-dc84-4358-9213-cf58555de3b6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:43.022145 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17741b61-a810-4ea0-bc13-10cbad867a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:43.022804 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17741b61-a810-4ea0-bc13-10cbad867a84 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:43.023088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17741b61-a810-4ea0-bc13-10cbad867a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:43.023365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17741b61-a810-4ea0-bc13-10cbad867a84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:43.024065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17741b61-a810-4ea0-bc13-10cbad867a84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:43.026015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17741b61-a810-4ea0-bc13-10cbad867a84 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:43.127143 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:43.135921 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1182/2352] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:59:42 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:43.138718 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911e5df-9d66-408e-a264-90919c4fa928 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:43.150624 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911e5df-9d66-408e-a264-90919c4fa928 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:43.191281 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:43.207334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e1006-8465-403c-9b36-72a0474ff559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:43.208064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e1006-8465-403c-9b36-72a0474ff559 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:43.208347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e1006-8465-403c-9b36-72a0474ff559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:43.208625 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e1006-8465-403c-9b36-72a0474ff559 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:43.209370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e1006-8465-403c-9b36-72a0474ff559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:43.211396 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e1006-8465-403c-9b36-72a0474ff559 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:43.345355 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1171/2353] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:59:43 2022] POST /identity/v3/users => generated 294 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:43.350322 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17741b61-a810-4ea0-bc13-10cbad867a84 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:43.360593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17741b61-a810-4ea0-bc13-10cbad867a84 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:43.365112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea94ab-b489-42d0-ba98-149013e6d688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:43.365818 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea94ab-b489-42d0-ba98-149013e6d688 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:43.366102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea94ab-b489-42d0-ba98-149013e6d688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:43.366380 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea94ab-b489-42d0-ba98-149013e6d688 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:43.367102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea94ab-b489-42d0-ba98-149013e6d688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:43.368700 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea94ab-b489-42d0-ba98-149013e6d688 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:43.379984 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1183/2354] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:59:43.384014 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e1006-8465-403c-9b36-72a0474ff559 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:43.395233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e1006-8465-403c-9b36-72a0474ff559 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:43.399847 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a99ed-afc8-41a5-a60e-105e89d4fd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:43.400511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a99ed-afc8-41a5-a60e-105e89d4fd05 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:43.400786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a99ed-afc8-41a5-a60e-105e89d4fd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:43.401071 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a99ed-afc8-41a5-a60e-105e89d4fd05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:43.401828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a99ed-afc8-41a5-a60e-105e89d4fd05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:43.403436 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a99ed-afc8-41a5-a60e-105e89d4fd05 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:43.414330 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1172/2355] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:43.418641 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea94ab-b489-42d0-ba98-149013e6d688 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:43.428574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea94ab-b489-42d0-ba98-149013e6d688 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:43.433238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e602b76-1ccf-42ce-9b3c-3499747c7357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:43.434148 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e602b76-1ccf-42ce-9b3c-3499747c7357 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:43.435562 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e602b76-1ccf-42ce-9b3c-3499747c7357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:43.435562 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e602b76-1ccf-42ce-9b3c-3499747c7357 admin admin] PATH_INFO: `/v3/projects/c4d6753a3ab247f7beb7acfbe1064640/users/7540655628a34a0bac57c2d6837277d3/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:43.450017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e602b76-1ccf-42ce-9b3c-3499747c7357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d6753a3ab247f7beb7acfbe1064640, user_id=7540655628a34a0bac57c2d6837277d3, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:43.452660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e602b76-1ccf-42ce-9b3c-3499747c7357 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:43.504660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1184/2356] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:59:43 2022] PUT /identity/v3/projects/c4d6753a3ab247f7beb7acfbe1064640/users/7540655628a34a0bac57c2d6837277d3/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:43.518897 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95be9b-b3ad-48cd-beaa-ecceca7ca3bb None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:43.519186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95be9b-b3ad-48cd-beaa-ecceca7ca3bb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:43.519466 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95be9b-b3ad-48cd-beaa-ecceca7ca3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:43.545614 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-aa95be9b-b3ad-48cd-beaa-ecceca7ca3bb None None] MFA Rules not processed for user `7540655628a34a0bac57c2d6837277d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:43.546824 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-aa95be9b-b3ad-48cd-beaa-ecceca7ca3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:43.611727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1173/2357] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:59:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:43.616273 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e602b76-1ccf-42ce-9b3c-3499747c7357 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:43.679788 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e602b76-1ccf-42ce-9b3c-3499747c7357 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:43.684389 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec750d-a600-4348-90ac-339c9fb6072a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:43.685057 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec750d-a600-4348-90ac-339c9fb6072a admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:43.685380 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec750d-a600-4348-90ac-339c9fb6072a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:43.685657 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec750d-a600-4348-90ac-339c9fb6072a admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:43.686361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec750d-a600-4348-90ac-339c9fb6072a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:43.688801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec750d-a600-4348-90ac-339c9fb6072a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:43.815219 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1185/2358] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 16:59:43 2022] POST /identity/v3/projects => generated 387 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:43.819047 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95be9b-b3ad-48cd-beaa-ecceca7ca3bb None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:43.830276 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95be9b-b3ad-48cd-beaa-ecceca7ca3bb None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:43.887486 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c73e59-bcef-4972-ab5a-e8a4b0ac48fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:43.888160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c73e59-bcef-4972-ab5a-e8a4b0ac48fe admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:43.888449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c73e59-bcef-4972-ab5a-e8a4b0ac48fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:43.888752 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c73e59-bcef-4972-ab5a-e8a4b0ac48fe admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:43.889514 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c73e59-bcef-4972-ab5a-e8a4b0ac48fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:43.891424 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c73e59-bcef-4972-ab5a-e8a4b0ac48fe admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:44.018498 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1174/2359] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 16:59:43 2022] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:59:44.022576 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec750d-a600-4348-90ac-339c9fb6072a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:44.033063 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec750d-a600-4348-90ac-339c9fb6072a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:44.037650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f6f31-c332-4e62-a7fa-e8957f94b632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:44.038310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f6f31-c332-4e62-a7fa-e8957f94b632 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:44.038594 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f6f31-c332-4e62-a7fa-e8957f94b632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:44.038867 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f6f31-c332-4e62-a7fa-e8957f94b632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:44.039587 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f6f31-c332-4e62-a7fa-e8957f94b632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:44.041183 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f6f31-c332-4e62-a7fa-e8957f94b632 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:44.052749 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1186/2360] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:44.057040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c73e59-bcef-4972-ab5a-e8a4b0ac48fe admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:44.070007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c73e59-bcef-4972-ab5a-e8a4b0ac48fe admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:44.075597 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509f0d1-f503-45c1-a7e4-251a2a834183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:44.076503 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509f0d1-f503-45c1-a7e4-251a2a834183 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:44.076785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509f0d1-f503-45c1-a7e4-251a2a834183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:44.077094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509f0d1-f503-45c1-a7e4-251a2a834183 admin admin] PATH_INFO: `/v3/projects/216d4b8111a441069e2a6f8a523ae555/users/f9f2d8e8b2d24dc1b09d68e53ef3ff45/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:44.092522 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6509f0d1-f503-45c1-a7e4-251a2a834183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=216d4b8111a441069e2a6f8a523ae555, user_id=f9f2d8e8b2d24dc1b09d68e53ef3ff45, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:44.095349 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6509f0d1-f503-45c1-a7e4-251a2a834183 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:44.212730 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1175/2361] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:59:44 2022] PUT /identity/v3/projects/216d4b8111a441069e2a6f8a523ae555/users/f9f2d8e8b2d24dc1b09d68e53ef3ff45/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:44.216676 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f6f31-c332-4e62-a7fa-e8957f94b632 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:44.227966 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f6f31-c332-4e62-a7fa-e8957f94b632 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:44.286414 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f6f11-c859-4b5f-8a1e-36a525ef9b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:44.287078 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f6f11-c859-4b5f-8a1e-36a525ef9b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:44.287364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f6f11-c859-4b5f-8a1e-36a525ef9b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:44.287642 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f6f11-c859-4b5f-8a1e-36a525ef9b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:44.288405 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f6f11-c859-4b5f-8a1e-36a525ef9b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:44.290161 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f6f11-c859-4b5f-8a1e-36a525ef9b60 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:44.300882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1187/2362] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 16:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:59:44.305124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509f0d1-f503-45c1-a7e4-251a2a834183 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:44.315990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509f0d1-f503-45c1-a7e4-251a2a834183 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:44.320642 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0992b3a-91a4-44ea-8c61-b247a3c550f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:44.321559 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0992b3a-91a4-44ea-8c61-b247a3c550f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:44.321838 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0992b3a-91a4-44ea-8c61-b247a3c550f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:44.322113 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0992b3a-91a4-44ea-8c61-b247a3c550f1 admin admin] PATH_INFO: `/v3/projects/216d4b8111a441069e2a6f8a523ae555/users/f9f2d8e8b2d24dc1b09d68e53ef3ff45/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:44.324105 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0992b3a-91a4-44ea-8c61-b247a3c550f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=216d4b8111a441069e2a6f8a523ae555, user_id=f9f2d8e8b2d24dc1b09d68e53ef3ff45, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:44.326942 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0992b3a-91a4-44ea-8c61-b247a3c550f1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:44.337716 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1176/2363] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 16:59:44 2022] PUT /identity/v3/projects/216d4b8111a441069e2a6f8a523ae555/users/f9f2d8e8b2d24dc1b09d68e53ef3ff45/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:44.350023 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45369c1-6d7e-4066-955f-edf459cb0ccf None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:44.350315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45369c1-6d7e-4066-955f-edf459cb0ccf None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:44.350594 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45369c1-6d7e-4066-955f-edf459cb0ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:44.378004 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d45369c1-6d7e-4066-955f-edf459cb0ccf None None] MFA Rules not processed for user `f9f2d8e8b2d24dc1b09d68e53ef3ff45`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:44.379225 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d45369c1-6d7e-4066-955f-edf459cb0ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:44.399359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:44.449818 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1188/2364] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:59:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:44.461022 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0992b3a-91a4-44ea-8c61-b247a3c550f1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:44.462760 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c0992b3a-91a4-44ea-8c61-b247a3c550f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:44.469938 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:44.522272 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0992b3a-91a4-44ea-8c61-b247a3c550f1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:44.526217 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579595a-e8c2-401e-bcfd-d9f81a4373a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:44.526876 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579595a-e8c2-401e-bcfd-d9f81a4373a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:44.527581 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579595a-e8c2-401e-bcfd-d9f81a4373a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:44.528199 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579595a-e8c2-401e-bcfd-d9f81a4373a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:44.538853 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579595a-e8c2-401e-bcfd-d9f81a4373a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:44.540246 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579595a-e8c2-401e-bcfd-d9f81a4373a0 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:44.549925 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1177/2365] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:59:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:45.833410 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45369c1-6d7e-4066-955f-edf459cb0ccf None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:45.834880 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d45369c1-6d7e-4066-955f-edf459cb0ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:45.848436 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45369c1-6d7e-4066-955f-edf459cb0ccf None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:45.852348 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc543029-c93e-427f-bba1-10cc61c040dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:45.852996 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc543029-c93e-427f-bba1-10cc61c040dd service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:45.853304 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc543029-c93e-427f-bba1-10cc61c040dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:45.853584 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc543029-c93e-427f-bba1-10cc61c040dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:45.911242 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc543029-c93e-427f-bba1-10cc61c040dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:45.912573 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc543029-c93e-427f-bba1-10cc61c040dd service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:45.921548 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1189/2366] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:59:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:59:52.398975 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579595a-e8c2-401e-bcfd-d9f81a4373a0 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:52.408132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579595a-e8c2-401e-bcfd-d9f81a4373a0 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:52.411802 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434ca6c-a3c5-4eb3-9891-c2204c585e55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:52.412439 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434ca6c-a3c5-4eb3-9891-c2204c585e55 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:52.412722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434ca6c-a3c5-4eb3-9891-c2204c585e55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:52.413004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434ca6c-a3c5-4eb3-9891-c2204c585e55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:52.478356 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434ca6c-a3c5-4eb3-9891-c2204c585e55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:52.479831 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434ca6c-a3c5-4eb3-9891-c2204c585e55 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:52.492482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1178/2367] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:59:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:55.917463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=47 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:57.518733 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc543029-c93e-427f-bba1-10cc61c040dd service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:57.585683 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc543029-c93e-427f-bba1-10cc61c040dd service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:57.590676 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7ed59-d0b8-4f17-8389-5891c7d737b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:57.591571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7ed59-d0b8-4f17-8389-5891c7d737b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:57.591853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7ed59-d0b8-4f17-8389-5891c7d737b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:57.592174 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7ed59-d0b8-4f17-8389-5891c7d737b8 admin admin] PATH_INFO: `/v3/users/934842ea41784fea9f7be12aa914bddd` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:57.593417 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7ed59-d0b8-4f17-8389-5891c7d737b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=934842ea41784fea9f7be12aa914bddd)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:57.595380 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7ed59-d0b8-4f17-8389-5891c7d737b8 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:57.837799 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8ee7ed59-d0b8-4f17-8389-5891c7d737b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '934842ea41784fea9f7be12aa914bddd'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:57.838515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8ee7ed59-d0b8-4f17-8389-5891c7d737b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '934842ea41784fea9f7be12aa914bddd'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:57.846345 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8ee7ed59-d0b8-4f17-8389-5891c7d737b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '934842ea41784fea9f7be12aa914bddd'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:57.943522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8ee7ed59-d0b8-4f17-8389-5891c7d737b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '934842ea41784fea9f7be12aa914bddd'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:57.947338 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8ee7ed59-d0b8-4f17-8389-5891c7d737b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '934842ea41784fea9f7be12aa914bddd'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:57.963735 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1190/2368] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:59:57 2022] DELETE /identity/v3/users/934842ea41784fea9f7be12aa914bddd => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:57.968093 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958eb05-d8ab-4028-96b5-0dcb562e661c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:57.968644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958eb05-d8ab-4028-96b5-0dcb562e661c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:57.968644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958eb05-d8ab-4028-96b5-0dcb562e661c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:57.988298 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8958eb05-d8ab-4028-96b5-0dcb562e661c None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:59:57.989538 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8958eb05-d8ab-4028-96b5-0dcb562e661c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:58.051368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1179/2369] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 16:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:59:58.060966 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7ed59-d0b8-4f17-8389-5891c7d737b8 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:58.062519 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8ee7ed59-d0b8-4f17-8389-5891c7d737b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:58.129840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7ed59-d0b8-4f17-8389-5891c7d737b8 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:58.133539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f39563-bb17-4a48-9af5-29ccded45ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:58.134191 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f39563-bb17-4a48-9af5-29ccded45ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:58.134472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f39563-bb17-4a48-9af5-29ccded45ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:58.134743 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f39563-bb17-4a48-9af5-29ccded45ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:58.146227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f39563-bb17-4a48-9af5-29ccded45ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:58.147798 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f39563-bb17-4a48-9af5-29ccded45ba6 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:58.158713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1191/2370] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 16:59:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:58.625604 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958eb05-d8ab-4028-96b5-0dcb562e661c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:58.630455 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8958eb05-d8ab-4028-96b5-0dcb562e661c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:58.641521 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958eb05-d8ab-4028-96b5-0dcb562e661c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:58.649300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d9377-2e6b-47e7-8ed1-add7ff6c8a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:58.650113 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d9377-2e6b-47e7-8ed1-add7ff6c8a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:58.650399 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d9377-2e6b-47e7-8ed1-add7ff6c8a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:58.650678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d9377-2e6b-47e7-8ed1-add7ff6c8a23 admin admin] PATH_INFO: `/v3/projects/82236acce03c4c718830113cea699006` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:58.652127 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d9377-2e6b-47e7-8ed1-add7ff6c8a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82236acce03c4c718830113cea699006)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:58.654139 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d9377-2e6b-47e7-8ed1-add7ff6c8a23 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:58.796060 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:58.802304 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-df7d9377-2e6b-47e7-8ed1-add7ff6c8a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82236acce03c4c718830113cea699006', 'request_id': 'req-df7d9377-2e6b-47e7-8ed1-add7ff6c8a23'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:58.807780 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-df7d9377-2e6b-47e7-8ed1-add7ff6c8a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82236acce03c4c718830113cea699006', 'request_id': 'req-df7d9377-2e6b-47e7-8ed1-add7ff6c8a23'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:58.814540 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-df7d9377-2e6b-47e7-8ed1-add7ff6c8a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82236acce03c4c718830113cea699006', 'request_id': 'req-df7d9377-2e6b-47e7-8ed1-add7ff6c8a23'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:59.121320 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-df7d9377-2e6b-47e7-8ed1-add7ff6c8a23 admin admin] The token cache is being invalidate because project 82236acce03c4c718830113cea699006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:59:59.122025 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-df7d9377-2e6b-47e7-8ed1-add7ff6c8a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:59.122378 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-df7d9377-2e6b-47e7-8ed1-add7ff6c8a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:59.124267 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1180/2371] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 16:59:58 2022] DELETE /identity/v3/projects/82236acce03c4c718830113cea699006 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:59:59.129223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f39563-bb17-4a48-9af5-29ccded45ba6 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:59.139294 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f39563-bb17-4a48-9af5-29ccded45ba6 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:59.159391 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:59.198690 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68278c9d-2eed-4f24-9c2f-b73397cae35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:59.199602 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68278c9d-2eed-4f24-9c2f-b73397cae35f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:59.199889 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68278c9d-2eed-4f24-9c2f-b73397cae35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:59.200166 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68278c9d-2eed-4f24-9c2f-b73397cae35f admin admin] PATH_INFO: `/v3/users/7540655628a34a0bac57c2d6837277d3` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:59.201413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68278c9d-2eed-4f24-9c2f-b73397cae35f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7540655628a34a0bac57c2d6837277d3)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:59.203386 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68278c9d-2eed-4f24-9c2f-b73397cae35f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:59.478190 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-68278c9d-2eed-4f24-9c2f-b73397cae35f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7540655628a34a0bac57c2d6837277d3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:59.479167 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-68278c9d-2eed-4f24-9c2f-b73397cae35f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7540655628a34a0bac57c2d6837277d3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:59.487703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-68278c9d-2eed-4f24-9c2f-b73397cae35f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7540655628a34a0bac57c2d6837277d3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:59.560960 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-68278c9d-2eed-4f24-9c2f-b73397cae35f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7540655628a34a0bac57c2d6837277d3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:59.561618 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-68278c9d-2eed-4f24-9c2f-b73397cae35f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7540655628a34a0bac57c2d6837277d3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:59:59.582136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1192/2372] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 16:59:59 2022] DELETE /identity/v3/users/7540655628a34a0bac57c2d6837277d3 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:00.048889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d9377-2e6b-47e7-8ed1-add7ff6c8a23 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:00.059360 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-df7d9377-2e6b-47e7-8ed1-add7ff6c8a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:00.081587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d9377-2e6b-47e7-8ed1-add7ff6c8a23 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:00.140735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfa64f-1ad1-49a0-b325-9e7edd658738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:00.141650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfa64f-1ad1-49a0-b325-9e7edd658738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:00.141933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfa64f-1ad1-49a0-b325-9e7edd658738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:00.142212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfa64f-1ad1-49a0-b325-9e7edd658738 admin admin] PATH_INFO: `/v3/projects/c4d6753a3ab247f7beb7acfbe1064640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:00.143415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfa64f-1ad1-49a0-b325-9e7edd658738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4d6753a3ab247f7beb7acfbe1064640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:00.145382 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfa64f-1ad1-49a0-b325-9e7edd658738 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:00.271281 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d5bfa64f-1ad1-49a0-b325-9e7edd658738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4d6753a3ab247f7beb7acfbe1064640', 'request_id': 'req-d5bfa64f-1ad1-49a0-b325-9e7edd658738'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:00.277485 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d5bfa64f-1ad1-49a0-b325-9e7edd658738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4d6753a3ab247f7beb7acfbe1064640', 'request_id': 'req-d5bfa64f-1ad1-49a0-b325-9e7edd658738'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:00.283821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d5bfa64f-1ad1-49a0-b325-9e7edd658738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4d6753a3ab247f7beb7acfbe1064640', 'request_id': 'req-d5bfa64f-1ad1-49a0-b325-9e7edd658738'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:00.367197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d5bfa64f-1ad1-49a0-b325-9e7edd658738 admin admin] The token cache is being invalidate because project c4d6753a3ab247f7beb7acfbe1064640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:00:00.367470 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d5bfa64f-1ad1-49a0-b325-9e7edd658738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:00.368097 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d5bfa64f-1ad1-49a0-b325-9e7edd658738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:00.369678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1181/2373] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:00:00 2022] DELETE /identity/v3/projects/c4d6753a3ab247f7beb7acfbe1064640 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:00.373662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68278c9d-2eed-4f24-9c2f-b73397cae35f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:00.376186 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-68278c9d-2eed-4f24-9c2f-b73397cae35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:00.389485 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68278c9d-2eed-4f24-9c2f-b73397cae35f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:00.445175 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf39db-8654-4407-8b8b-5b00c017ef6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:00.446082 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf39db-8654-4407-8b8b-5b00c017ef6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:00.446361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf39db-8654-4407-8b8b-5b00c017ef6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:00.446738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf39db-8654-4407-8b8b-5b00c017ef6d admin admin] PATH_INFO: `/v3/users/f9f2d8e8b2d24dc1b09d68e53ef3ff45` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:00.447823 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf39db-8654-4407-8b8b-5b00c017ef6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9f2d8e8b2d24dc1b09d68e53ef3ff45)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:00.449826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf39db-8654-4407-8b8b-5b00c017ef6d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:00.655246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:00.658718 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a1bf39db-8654-4407-8b8b-5b00c017ef6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9f2d8e8b2d24dc1b09d68e53ef3ff45'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:00.669130 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a1bf39db-8654-4407-8b8b-5b00c017ef6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9f2d8e8b2d24dc1b09d68e53ef3ff45'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:00.669130 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a1bf39db-8654-4407-8b8b-5b00c017ef6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9f2d8e8b2d24dc1b09d68e53ef3ff45'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:00.755023 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a1bf39db-8654-4407-8b8b-5b00c017ef6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9f2d8e8b2d24dc1b09d68e53ef3ff45'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:00.755704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a1bf39db-8654-4407-8b8b-5b00c017ef6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9f2d8e8b2d24dc1b09d68e53ef3ff45'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:00.773770 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1193/2374] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:00:00 2022] DELETE /identity/v3/users/f9f2d8e8b2d24dc1b09d68e53ef3ff45 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:01.220517 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfa64f-1ad1-49a0-b325-9e7edd658738 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:01.222265 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d5bfa64f-1ad1-49a0-b325-9e7edd658738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:01.241715 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfa64f-1ad1-49a0-b325-9e7edd658738 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:01.303543 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e007bb-4569-4e5f-9b24-b8eed7519402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:01.304417 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e007bb-4569-4e5f-9b24-b8eed7519402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:01.304700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e007bb-4569-4e5f-9b24-b8eed7519402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:01.304976 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e007bb-4569-4e5f-9b24-b8eed7519402 admin admin] PATH_INFO: `/v3/projects/216d4b8111a441069e2a6f8a523ae555` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:01.306258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e007bb-4569-4e5f-9b24-b8eed7519402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=216d4b8111a441069e2a6f8a523ae555)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:01.308248 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e007bb-4569-4e5f-9b24-b8eed7519402 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:01.310031 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:01.441732 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d6e007bb-4569-4e5f-9b24-b8eed7519402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216d4b8111a441069e2a6f8a523ae555', 'request_id': 'req-d6e007bb-4569-4e5f-9b24-b8eed7519402'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:01.448035 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d6e007bb-4569-4e5f-9b24-b8eed7519402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216d4b8111a441069e2a6f8a523ae555', 'request_id': 'req-d6e007bb-4569-4e5f-9b24-b8eed7519402'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:01.456150 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d6e007bb-4569-4e5f-9b24-b8eed7519402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216d4b8111a441069e2a6f8a523ae555', 'request_id': 'req-d6e007bb-4569-4e5f-9b24-b8eed7519402'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:01.567178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d6e007bb-4569-4e5f-9b24-b8eed7519402 admin admin] The token cache is being invalidate because project 216d4b8111a441069e2a6f8a523ae555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:00:01.567438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d6e007bb-4569-4e5f-9b24-b8eed7519402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:01.567979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d6e007bb-4569-4e5f-9b24-b8eed7519402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:01.569673 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1182/2375] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:00:01 2022] DELETE /identity/v3/projects/216d4b8111a441069e2a6f8a523ae555 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:01.576067 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a368733-9ab6-4676-8818-2b9320e099f3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:01.576773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a368733-9ab6-4676-8818-2b9320e099f3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:01.576773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a368733-9ab6-4676-8818-2b9320e099f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:01.596057 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5a368733-9ab6-4676-8818-2b9320e099f3 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:01.597312 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5a368733-9ab6-4676-8818-2b9320e099f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:01.658847 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1194/2376] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:00:01.668349 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ab014-452b-4707-a663-7256f1238b2f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:01.668632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ab014-452b-4707-a663-7256f1238b2f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:01.668910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ab014-452b-4707-a663-7256f1238b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:01.690541 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9d0ab014-452b-4707-a663-7256f1238b2f None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:01.691819 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9d0ab014-452b-4707-a663-7256f1238b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:01.699924 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1183/2377] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:01.705518 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a368733-9ab6-4676-8818-2b9320e099f3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:01.715191 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a368733-9ab6-4676-8818-2b9320e099f3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:01.719934 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ad152-a843-4de9-abcb-57726b348050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:01.720593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ad152-a843-4de9-abcb-57726b348050 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:01.720873 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ad152-a843-4de9-abcb-57726b348050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:01.721148 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ad152-a843-4de9-abcb-57726b348050 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:01.721911 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ad152-a843-4de9-abcb-57726b348050 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:00:01.722217 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ad152-a843-4de9-abcb-57726b348050 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:01.723835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ad152-a843-4de9-abcb-57726b348050 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:01.735985 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1195/2378] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:00:01.740576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ab014-452b-4707-a663-7256f1238b2f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:01.750888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ab014-452b-4707-a663-7256f1238b2f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:01.755702 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a26b91-315a-4417-badd-9bdd0037c5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:01.756390 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a26b91-315a-4417-badd-9bdd0037c5ce admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:01.756703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a26b91-315a-4417-badd-9bdd0037c5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:01.756982 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a26b91-315a-4417-badd-9bdd0037c5ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:01.757715 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a26b91-315a-4417-badd-9bdd0037c5ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:01.759922 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a26b91-315a-4417-badd-9bdd0037c5ce admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:01.842769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1184/2379] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:00:01 2022] POST /identity/v3/projects => generated 399 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:00:01.847727 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ad152-a843-4de9-abcb-57726b348050 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:01.857979 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ad152-a843-4de9-abcb-57726b348050 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:01.917531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ed5f9-733b-45ca-96bd-735b4f8e38f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:01.918209 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ed5f9-733b-45ca-96bd-735b4f8e38f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:01.918490 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ed5f9-733b-45ca-96bd-735b4f8e38f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:01.920690 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ed5f9-733b-45ca-96bd-735b4f8e38f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:01.920690 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ed5f9-733b-45ca-96bd-735b4f8e38f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:01.921439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ed5f9-733b-45ca-96bd-735b4f8e38f8 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:02.003443 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1196/2380] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:00:01 2022] POST /identity/v3/users => generated 300 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:00:02.007415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a26b91-315a-4417-badd-9bdd0037c5ce admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:02.018447 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a26b91-315a-4417-badd-9bdd0037c5ce admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:02.023514 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8514e-c1ee-44c5-a131-cba64bf08fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:02.024187 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8514e-c1ee-44c5-a131-cba64bf08fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:02.024473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8514e-c1ee-44c5-a131-cba64bf08fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:02.024753 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8514e-c1ee-44c5-a131-cba64bf08fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:02.025515 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8514e-c1ee-44c5-a131-cba64bf08fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:02.027243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8514e-c1ee-44c5-a131-cba64bf08fe1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:02.042705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1185/2381] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:00:02.047868 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ed5f9-733b-45ca-96bd-735b4f8e38f8 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:02.060052 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ed5f9-733b-45ca-96bd-735b4f8e38f8 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:02.066280 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8112e30-fa13-4213-8316-bd3e750c517b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:02.067054 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8112e30-fa13-4213-8316-bd3e750c517b admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:02.067452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8112e30-fa13-4213-8316-bd3e750c517b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:02.067970 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8112e30-fa13-4213-8316-bd3e750c517b admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:02.069044 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8112e30-fa13-4213-8316-bd3e750c517b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:02.070971 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8112e30-fa13-4213-8316-bd3e750c517b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:02.086287 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1197/2382] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:00:02.090532 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8514e-c1ee-44c5-a131-cba64bf08fe1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:02.101091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8514e-c1ee-44c5-a131-cba64bf08fe1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:02.105733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe9743-553c-4c45-8893-3da4e1cfb2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:02.106610 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe9743-553c-4c45-8893-3da4e1cfb2d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:02.106894 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe9743-553c-4c45-8893-3da4e1cfb2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:02.107171 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe9743-553c-4c45-8893-3da4e1cfb2d3 admin admin] PATH_INFO: `/v3/projects/1de57acd22ac46588dd42d0a29f83738/users/a5532532eb4845c2bb96c88ffbf9db7b/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:02.122496 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe9743-553c-4c45-8893-3da4e1cfb2d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de57acd22ac46588dd42d0a29f83738, user_id=a5532532eb4845c2bb96c88ffbf9db7b, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:02.125933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe9743-553c-4c45-8893-3da4e1cfb2d3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:02.218133 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1186/2383] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:00:02 2022] PUT /identity/v3/projects/1de57acd22ac46588dd42d0a29f83738/users/a5532532eb4845c2bb96c88ffbf9db7b/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:02.230144 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10254189-6978-486a-bbe5-5b85e06f21b1 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:02.230435 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10254189-6978-486a-bbe5-5b85e06f21b1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:02.230711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10254189-6978-486a-bbe5-5b85e06f21b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:02.259058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-10254189-6978-486a-bbe5-5b85e06f21b1 None None] MFA Rules not processed for user `a5532532eb4845c2bb96c88ffbf9db7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:02.260288 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-10254189-6978-486a-bbe5-5b85e06f21b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:02.282011 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:02.346453 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe9743-553c-4c45-8893-3da4e1cfb2d3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:02.347345 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1198/2384] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:00:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:02.420929 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe9743-553c-4c45-8893-3da4e1cfb2d3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:02.425920 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a764cd9-4b37-4a89-be2b-fb4d0ab979d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:02.426585 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a764cd9-4b37-4a89-be2b-fb4d0ab979d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:02.426867 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a764cd9-4b37-4a89-be2b-fb4d0ab979d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:02.427144 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a764cd9-4b37-4a89-be2b-fb4d0ab979d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:02.427853 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a764cd9-4b37-4a89-be2b-fb4d0ab979d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:02.429842 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a764cd9-4b37-4a89-be2b-fb4d0ab979d3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:02.550669 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1187/2385] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:00:02 2022] POST /identity/v3/projects => generated 401 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:00:02.551901 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10254189-6978-486a-bbe5-5b85e06f21b1 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:02.564125 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10254189-6978-486a-bbe5-5b85e06f21b1 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:02.626162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d2e3f-bbf9-4912-b6a4-dc2f1f69abc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:02.626894 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d2e3f-bbf9-4912-b6a4-dc2f1f69abc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:02.627249 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d2e3f-bbf9-4912-b6a4-dc2f1f69abc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:02.627606 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d2e3f-bbf9-4912-b6a4-dc2f1f69abc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:02.628382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d2e3f-bbf9-4912-b6a4-dc2f1f69abc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:02.630437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d2e3f-bbf9-4912-b6a4-dc2f1f69abc2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:02.792683 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1199/2386] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:00:02 2022] POST /identity/v3/users => generated 307 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:00:02.793944 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a764cd9-4b37-4a89-be2b-fb4d0ab979d3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:02.805053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a764cd9-4b37-4a89-be2b-fb4d0ab979d3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:02.809972 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c51af-8874-4775-b318-8e43e978c554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:02.810678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c51af-8874-4775-b318-8e43e978c554 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:02.810964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c51af-8874-4775-b318-8e43e978c554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:02.811241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c51af-8874-4775-b318-8e43e978c554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:02.811976 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c51af-8874-4775-b318-8e43e978c554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:02.814359 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c51af-8874-4775-b318-8e43e978c554 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:02.819960 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:02.826581 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1188/2387] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:00:02.831131 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d2e3f-bbf9-4912-b6a4-dc2f1f69abc2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:02.841932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d2e3f-bbf9-4912-b6a4-dc2f1f69abc2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:02.847091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a87fa0-c396-4bcd-974f-7899893507bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:02.848105 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a87fa0-c396-4bcd-974f-7899893507bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:02.848454 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a87fa0-c396-4bcd-974f-7899893507bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:02.848742 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a87fa0-c396-4bcd-974f-7899893507bb admin admin] PATH_INFO: `/v3/projects/167c736303824bb3bacca44e06d80459/users/a3bc672f9c984335ab37d3a37f4be773/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:02.867143 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a87fa0-c396-4bcd-974f-7899893507bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=167c736303824bb3bacca44e06d80459, user_id=a3bc672f9c984335ab37d3a37f4be773, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:02.869904 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a87fa0-c396-4bcd-974f-7899893507bb admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:03.042766 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1200/2388] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:00:02 2022] PUT /identity/v3/projects/167c736303824bb3bacca44e06d80459/users/a3bc672f9c984335ab37d3a37f4be773/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:03.049957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c51af-8874-4775-b318-8e43e978c554 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:03.058029 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c51af-8874-4775-b318-8e43e978c554 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:03.130116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2d513-d396-4ce2-8be2-8942e117516b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:03.136034 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2d513-d396-4ce2-8be2-8942e117516b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:03.136034 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2d513-d396-4ce2-8be2-8942e117516b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:03.136034 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2d513-d396-4ce2-8be2-8942e117516b admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:03.136034 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2d513-d396-4ce2-8be2-8942e117516b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:03.136034 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2d513-d396-4ce2-8be2-8942e117516b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:03.145035 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1189/2389] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:00:03.149476 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a87fa0-c396-4bcd-974f-7899893507bb admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:03.160706 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a87fa0-c396-4bcd-974f-7899893507bb admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:03.165424 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac4f0d-4a1c-4bfe-9cca-aed846b3c331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:03.166359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac4f0d-4a1c-4bfe-9cca-aed846b3c331 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:03.166639 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac4f0d-4a1c-4bfe-9cca-aed846b3c331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:03.166956 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac4f0d-4a1c-4bfe-9cca-aed846b3c331 admin admin] PATH_INFO: `/v3/projects/167c736303824bb3bacca44e06d80459/users/a3bc672f9c984335ab37d3a37f4be773/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:03.168965 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac4f0d-4a1c-4bfe-9cca-aed846b3c331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=167c736303824bb3bacca44e06d80459, user_id=a3bc672f9c984335ab37d3a37f4be773, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:03.171754 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac4f0d-4a1c-4bfe-9cca-aed846b3c331 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:03.183315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1201/2390] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:00:03 2022] PUT /identity/v3/projects/167c736303824bb3bacca44e06d80459/users/a3bc672f9c984335ab37d3a37f4be773/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:03.194376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67234aed-c0c0-4e0a-8798-99bdec57eef7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:03.194664 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67234aed-c0c0-4e0a-8798-99bdec57eef7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:03.194943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67234aed-c0c0-4e0a-8798-99bdec57eef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:03.222704 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-67234aed-c0c0-4e0a-8798-99bdec57eef7 None None] MFA Rules not processed for user `a3bc672f9c984335ab37d3a37f4be773`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:03.230781 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-67234aed-c0c0-4e0a-8798-99bdec57eef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:03.296430 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1190/2391] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:00:03 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:03.307981 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac4f0d-4a1c-4bfe-9cca-aed846b3c331 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:03.309945 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bdac4f0d-4a1c-4bfe-9cca-aed846b3c331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:03.425835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac4f0d-4a1c-4bfe-9cca-aed846b3c331 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:03.431709 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f394c-0ff5-48a3-8404-664a0f36e321 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:03.431709 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f394c-0ff5-48a3-8404-664a0f36e321 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:03.431709 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f394c-0ff5-48a3-8404-664a0f36e321 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:03.432123 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f394c-0ff5-48a3-8404-664a0f36e321 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:03.444484 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f394c-0ff5-48a3-8404-664a0f36e321 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:03.446370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f394c-0ff5-48a3-8404-664a0f36e321 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:03.458920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1202/2392] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:00:03 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:00:03.758956 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67234aed-c0c0-4e0a-8798-99bdec57eef7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:03.775322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67234aed-c0c0-4e0a-8798-99bdec57eef7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:03.779163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee074804-7303-4bcb-a170-1bde453c3c7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:03.779833 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee074804-7303-4bcb-a170-1bde453c3c7f service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:03.780198 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee074804-7303-4bcb-a170-1bde453c3c7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:03.780477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee074804-7303-4bcb-a170-1bde453c3c7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:03.853553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee074804-7303-4bcb-a170-1bde453c3c7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:03.854926 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee074804-7303-4bcb-a170-1bde453c3c7f service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:03.865176 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1191/2393] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:00:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:00:08.796675 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ef0c5-db99-4ec4-b61c-6f66fe446b92 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:08.797205 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ef0c5-db99-4ec4-b61c-6f66fe446b92 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:08.797340 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ef0c5-db99-4ec4-b61c-6f66fe446b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:08.815387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fb9ef0c5-db99-4ec4-b61c-6f66fe446b92 None None] MFA Rules not processed for user `1551f28754a64d1d9010ed90b67c5dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:08.816604 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fb9ef0c5-db99-4ec4-b61c-6f66fe446b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:08.822150 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:08.874266 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1203/2394] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:00:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:09.280580 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee074804-7303-4bcb-a170-1bde453c3c7f service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:09.303955 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:09.355626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee074804-7303-4bcb-a170-1bde453c3c7f service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:09.360790 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c33e53-be8b-4fd4-9cc4-da20f12ef304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:09.361720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c33e53-be8b-4fd4-9cc4-da20f12ef304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:09.362000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c33e53-be8b-4fd4-9cc4-da20f12ef304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:09.362275 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c33e53-be8b-4fd4-9cc4-da20f12ef304 admin admin] PATH_INFO: `/v3/users/a5532532eb4845c2bb96c88ffbf9db7b` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:09.363517 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c33e53-be8b-4fd4-9cc4-da20f12ef304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5532532eb4845c2bb96c88ffbf9db7b)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:09.365570 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c33e53-be8b-4fd4-9cc4-da20f12ef304 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:09.569061 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c4c33e53-be8b-4fd4-9cc4-da20f12ef304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5532532eb4845c2bb96c88ffbf9db7b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:09.652143 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c4c33e53-be8b-4fd4-9cc4-da20f12ef304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5532532eb4845c2bb96c88ffbf9db7b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:09.655822 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c4c33e53-be8b-4fd4-9cc4-da20f12ef304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5532532eb4845c2bb96c88ffbf9db7b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:09.655822 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c4c33e53-be8b-4fd4-9cc4-da20f12ef304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5532532eb4845c2bb96c88ffbf9db7b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:09.664946 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c4c33e53-be8b-4fd4-9cc4-da20f12ef304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5532532eb4845c2bb96c88ffbf9db7b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:09.706848 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1192/2395] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:00:09 2022] DELETE /identity/v3/users/a5532532eb4845c2bb96c88ffbf9db7b => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:09.708688 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6969a8-14b4-4dcc-9565-960c6b79568d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:09.708979 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6969a8-14b4-4dcc-9565-960c6b79568d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:09.709288 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6969a8-14b4-4dcc-9565-960c6b79568d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:09.736047 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fe6969a8-14b4-4dcc-9565-960c6b79568d None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:09.737491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fe6969a8-14b4-4dcc-9565-960c6b79568d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:09.850474 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1204/2396] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:09.859714 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c33e53-be8b-4fd4-9cc4-da20f12ef304 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:09.861591 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c4c33e53-be8b-4fd4-9cc4-da20f12ef304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:09.932638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c33e53-be8b-4fd4-9cc4-da20f12ef304 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:09.936396 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5032705-b97c-4798-804d-f4195fbf0773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:09.937074 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5032705-b97c-4798-804d-f4195fbf0773 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:09.937386 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5032705-b97c-4798-804d-f4195fbf0773 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:09.937669 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5032705-b97c-4798-804d-f4195fbf0773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:09.947532 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5032705-b97c-4798-804d-f4195fbf0773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:09.949004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5032705-b97c-4798-804d-f4195fbf0773 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:09.959082 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1193/2397] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:00:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:00:10.471810 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6969a8-14b4-4dcc-9565-960c6b79568d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:10.478718 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fe6969a8-14b4-4dcc-9565-960c6b79568d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:10.493317 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6969a8-14b4-4dcc-9565-960c6b79568d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:10.498433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e44b9-501f-4a06-a706-ac78976bfab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:10.499536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e44b9-501f-4a06-a706-ac78976bfab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:10.499979 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e44b9-501f-4a06-a706-ac78976bfab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:10.504739 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e44b9-501f-4a06-a706-ac78976bfab1 admin admin] PATH_INFO: `/v3/projects/1de57acd22ac46588dd42d0a29f83738` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:10.504739 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e44b9-501f-4a06-a706-ac78976bfab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1de57acd22ac46588dd42d0a29f83738)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:10.504739 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e44b9-501f-4a06-a706-ac78976bfab1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:10.646497 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2d6e44b9-501f-4a06-a706-ac78976bfab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1de57acd22ac46588dd42d0a29f83738', 'request_id': 'req-2d6e44b9-501f-4a06-a706-ac78976bfab1'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:10.767147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2d6e44b9-501f-4a06-a706-ac78976bfab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1de57acd22ac46588dd42d0a29f83738', 'request_id': 'req-2d6e44b9-501f-4a06-a706-ac78976bfab1'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:10.782452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2d6e44b9-501f-4a06-a706-ac78976bfab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1de57acd22ac46588dd42d0a29f83738', 'request_id': 'req-2d6e44b9-501f-4a06-a706-ac78976bfab1'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:10.808468 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2d6e44b9-501f-4a06-a706-ac78976bfab1 admin admin] The token cache is being invalidate because project 1de57acd22ac46588dd42d0a29f83738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:00:10.808759 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2d6e44b9-501f-4a06-a706-ac78976bfab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:10.809458 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2d6e44b9-501f-4a06-a706-ac78976bfab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:10.811235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1205/2398] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:00:10 2022] DELETE /identity/v3/projects/1de57acd22ac46588dd42d0a29f83738 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:10.815217 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5032705-b97c-4798-804d-f4195fbf0773 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:10.825815 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5032705-b97c-4798-804d-f4195fbf0773 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:10.894622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:10.919008 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ca08b-73cf-4e6a-8871-c9339eb07cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:10.919994 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ca08b-73cf-4e6a-8871-c9339eb07cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:10.920280 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ca08b-73cf-4e6a-8871-c9339eb07cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:10.920557 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ca08b-73cf-4e6a-8871-c9339eb07cbb admin admin] PATH_INFO: `/v3/users/a3bc672f9c984335ab37d3a37f4be773` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:10.922762 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ca08b-73cf-4e6a-8871-c9339eb07cbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3bc672f9c984335ab37d3a37f4be773)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:10.924751 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ca08b-73cf-4e6a-8871-c9339eb07cbb admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:11.235869 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c83ca08b-73cf-4e6a-8871-c9339eb07cbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3bc672f9c984335ab37d3a37f4be773'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:11.353892 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c83ca08b-73cf-4e6a-8871-c9339eb07cbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3bc672f9c984335ab37d3a37f4be773'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:11.354917 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c83ca08b-73cf-4e6a-8871-c9339eb07cbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3bc672f9c984335ab37d3a37f4be773'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:11.355760 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c83ca08b-73cf-4e6a-8871-c9339eb07cbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3bc672f9c984335ab37d3a37f4be773'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:11.364883 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c83ca08b-73cf-4e6a-8871-c9339eb07cbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3bc672f9c984335ab37d3a37f4be773'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:11.384514 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1194/2399] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:00:10 2022] DELETE /identity/v3/users/a3bc672f9c984335ab37d3a37f4be773 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:11.999009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c93b6-c420-4a91-b12f-d2b1fe2f1b4c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:11.999510 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c93b6-c420-4a91-b12f-d2b1fe2f1b4c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:12.000138 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c93b6-c420-4a91-b12f-d2b1fe2f1b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:12.018656 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b91c93b6-c420-4a91-b12f-d2b1fe2f1b4c None None] MFA Rules not processed for user `5d6ddab73db44710bcb5bba4c0cfbcfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:12.019871 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b91c93b6-c420-4a91-b12f-d2b1fe2f1b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:12.041982 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ca08b-73cf-4e6a-8871-c9339eb07cbb admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:12.046715 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c83ca08b-73cf-4e6a-8871-c9339eb07cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:12.055364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:12.082633 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1206/2400] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:00:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:12.129699 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ca08b-73cf-4e6a-8871-c9339eb07cbb admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:12.138628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a70f91-cb5f-47b6-aca0-c7458102547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:12.139633 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a70f91-cb5f-47b6-aca0-c7458102547d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:12.139633 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a70f91-cb5f-47b6-aca0-c7458102547d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:12.140008 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a70f91-cb5f-47b6-aca0-c7458102547d admin admin] PATH_INFO: `/v3/projects/167c736303824bb3bacca44e06d80459` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:12.141556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a70f91-cb5f-47b6-aca0-c7458102547d admin admin] RBAC: Authorizing `identity:delete_project(project_id=167c736303824bb3bacca44e06d80459)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:12.143899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a70f91-cb5f-47b6-aca0-c7458102547d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:12.319226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-41a70f91-cb5f-47b6-aca0-c7458102547d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '167c736303824bb3bacca44e06d80459', 'request_id': 'req-41a70f91-cb5f-47b6-aca0-c7458102547d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:12.326282 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-41a70f91-cb5f-47b6-aca0-c7458102547d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '167c736303824bb3bacca44e06d80459', 'request_id': 'req-41a70f91-cb5f-47b6-aca0-c7458102547d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:12.334459 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-41a70f91-cb5f-47b6-aca0-c7458102547d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '167c736303824bb3bacca44e06d80459', 'request_id': 'req-41a70f91-cb5f-47b6-aca0-c7458102547d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:12.336370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:12.442403 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-41a70f91-cb5f-47b6-aca0-c7458102547d admin admin] The token cache is being invalidate because project 167c736303824bb3bacca44e06d80459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:00:12.442693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-41a70f91-cb5f-47b6-aca0-c7458102547d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:12.443488 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-41a70f91-cb5f-47b6-aca0-c7458102547d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:12.445114 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1195/2401] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:00:12 2022] DELETE /identity/v3/projects/167c736303824bb3bacca44e06d80459 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:12.450317 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da2bbf-ad3b-4dc5-8729-729fefab3e6c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:12.450637 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da2bbf-ad3b-4dc5-8729-729fefab3e6c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:12.450946 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da2bbf-ad3b-4dc5-8729-729fefab3e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:12.474983 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e0da2bbf-ad3b-4dc5-8729-729fefab3e6c None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:12.476602 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e0da2bbf-ad3b-4dc5-8729-729fefab3e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:12.543942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1207/2402] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:12.552384 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbaaba-0269-4ccb-8bc4-e0df0b3643c9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:12.553199 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbaaba-0269-4ccb-8bc4-e0df0b3643c9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:12.553956 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbaaba-0269-4ccb-8bc4-e0df0b3643c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:12.575912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-08bbaaba-0269-4ccb-8bc4-e0df0b3643c9 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:12.577504 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-08bbaaba-0269-4ccb-8bc4-e0df0b3643c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:12.588804 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1196/2403] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:12.594299 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da2bbf-ad3b-4dc5-8729-729fefab3e6c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:12.606622 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da2bbf-ad3b-4dc5-8729-729fefab3e6c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:12.611758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb5891-4e7c-43f5-ad71-f3e38da98d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:12.612858 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb5891-4e7c-43f5-ad71-f3e38da98d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:12.613235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb5891-4e7c-43f5-ad71-f3e38da98d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:12.613627 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb5891-4e7c-43f5-ad71-f3e38da98d87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:12.614464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb5891-4e7c-43f5-ad71-f3e38da98d87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:00:12.614854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb5891-4e7c-43f5-ad71-f3e38da98d87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:12.616852 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb5891-4e7c-43f5-ad71-f3e38da98d87 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:12.633835 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1208/2404] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:00:12.639173 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbaaba-0269-4ccb-8bc4-e0df0b3643c9 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:12.658200 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbaaba-0269-4ccb-8bc4-e0df0b3643c9 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:12.674711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b1563-9c74-4b8f-9590-110283f14162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:12.675929 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b1563-9c74-4b8f-9590-110283f14162 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:12.676873 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b1563-9c74-4b8f-9590-110283f14162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:12.677657 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b1563-9c74-4b8f-9590-110283f14162 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:12.679322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b1563-9c74-4b8f-9590-110283f14162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:12.682951 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b1563-9c74-4b8f-9590-110283f14162 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:12.815484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1197/2405] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:00:12 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:00:12.819294 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb5891-4e7c-43f5-ad71-f3e38da98d87 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:12.830739 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb5891-4e7c-43f5-ad71-f3e38da98d87 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:12.901039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e440ff-b9f2-4ffd-a364-f46bbb02cec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:12.901957 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e440ff-b9f2-4ffd-a364-f46bbb02cec5 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:12.902231 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e440ff-b9f2-4ffd-a364-f46bbb02cec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:12.902500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e440ff-b9f2-4ffd-a364-f46bbb02cec5 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:12.903210 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e440ff-b9f2-4ffd-a364-f46bbb02cec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:12.905187 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e440ff-b9f2-4ffd-a364-f46bbb02cec5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:13.007990 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1209/2406] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:00:12 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:00:13.012442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b1563-9c74-4b8f-9590-110283f14162 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:13.024203 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b1563-9c74-4b8f-9590-110283f14162 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:13.028991 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12c89a-9cb7-4407-88f6-8464894be066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:13.029725 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12c89a-9cb7-4407-88f6-8464894be066 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:13.030011 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12c89a-9cb7-4407-88f6-8464894be066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:13.030287 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12c89a-9cb7-4407-88f6-8464894be066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:13.031079 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12c89a-9cb7-4407-88f6-8464894be066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:13.032685 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12c89a-9cb7-4407-88f6-8464894be066 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:13.043952 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1198/2407] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:00:13.049350 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e440ff-b9f2-4ffd-a364-f46bbb02cec5 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:13.062952 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e440ff-b9f2-4ffd-a364-f46bbb02cec5 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:13.072217 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8d48e-728a-4408-ae0d-4fa2fa2f9de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:13.073015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8d48e-728a-4408-ae0d-4fa2fa2f9de6 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:13.073451 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8d48e-728a-4408-ae0d-4fa2fa2f9de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:13.073634 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8d48e-728a-4408-ae0d-4fa2fa2f9de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:13.075198 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8d48e-728a-4408-ae0d-4fa2fa2f9de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:13.078426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8d48e-728a-4408-ae0d-4fa2fa2f9de6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:13.101774 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1210/2408] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:00:13.102167 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12c89a-9cb7-4407-88f6-8464894be066 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:13.109814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12c89a-9cb7-4407-88f6-8464894be066 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:13.114923 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1278a-3ff1-4b8a-ab85-1725c66ee7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:13.115917 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1278a-3ff1-4b8a-ab85-1725c66ee7e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:13.116272 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1278a-3ff1-4b8a-ab85-1725c66ee7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:13.116620 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1278a-3ff1-4b8a-ab85-1725c66ee7e2 admin admin] PATH_INFO: `/v3/projects/83bbc4ecce4a40759395a8afb41063e0/users/8f36feb77d14455e9c2b603325758b59/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:13.133400 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1278a-3ff1-4b8a-ab85-1725c66ee7e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83bbc4ecce4a40759395a8afb41063e0, user_id=8f36feb77d14455e9c2b603325758b59, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:13.140331 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1278a-3ff1-4b8a-ab85-1725c66ee7e2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:13.235916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1199/2409] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:00:13 2022] PUT /identity/v3/projects/83bbc4ecce4a40759395a8afb41063e0/users/8f36feb77d14455e9c2b603325758b59/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:13.246404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f0772-2eb2-48a8-8a74-bad68d5be7ca None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:13.246695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f0772-2eb2-48a8-8a74-bad68d5be7ca None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:13.247006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f0772-2eb2-48a8-8a74-bad68d5be7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:13.277104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b39f0772-2eb2-48a8-8a74-bad68d5be7ca None None] MFA Rules not processed for user `8f36feb77d14455e9c2b603325758b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:13.278593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b39f0772-2eb2-48a8-8a74-bad68d5be7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:13.354296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:13.394505 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1211/2410] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:00:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:00:13.415024 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1278a-3ff1-4b8a-ab85-1725c66ee7e2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:13.415024 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1ec1278a-3ff1-4b8a-ab85-1725c66ee7e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:13.487607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1278a-3ff1-4b8a-ab85-1725c66ee7e2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:13.494115 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e43ba1-4fbe-4aaa-9f26-809725d15c7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:13.494642 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e43ba1-4fbe-4aaa-9f26-809725d15c7d service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:13.495174 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e43ba1-4fbe-4aaa-9f26-809725d15c7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:13.495621 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e43ba1-4fbe-4aaa-9f26-809725d15c7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:13.508490 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e43ba1-4fbe-4aaa-9f26-809725d15c7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:13.510043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e43ba1-4fbe-4aaa-9f26-809725d15c7d service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:13.522048 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1200/2411] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:00:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:00:15.246739 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f0772-2eb2-48a8-8a74-bad68d5be7ca None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:15.248455 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b39f0772-2eb2-48a8-8a74-bad68d5be7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:15.326853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f0772-2eb2-48a8-8a74-bad68d5be7ca None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:15.332648 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c392ed-3c40-4b79-b1b7-9bbb289ea051 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:15.333339 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c392ed-3c40-4b79-b1b7-9bbb289ea051 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:15.333629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c392ed-3c40-4b79-b1b7-9bbb289ea051 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:15.333910 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c392ed-3c40-4b79-b1b7-9bbb289ea051 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:15.335750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-96c392ed-3c40-4b79-b1b7-9bbb289ea051 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:15.408682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c392ed-3c40-4b79-b1b7-9bbb289ea051 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:15.410334 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c392ed-3c40-4b79-b1b7-9bbb289ea051 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:15.423270 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1212/2412] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:00:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:00:20.732172 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37cfc0-50eb-4e53-9629-d60d941163a2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:20.732760 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37cfc0-50eb-4e53-9629-d60d941163a2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:20.733087 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37cfc0-50eb-4e53-9629-d60d941163a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:20.754453 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ec37cfc0-50eb-4e53-9629-d60d941163a2 None None] MFA Rules not processed for user `4d2ab3eeb5b44979956dd223ac6b7c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:20.756037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ec37cfc0-50eb-4e53-9629-d60d941163a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:20.840678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1201/2413] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 17:00:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:20.954287 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c392ed-3c40-4b79-b1b7-9bbb289ea051 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:20.955899 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-96c392ed-3c40-4b79-b1b7-9bbb289ea051 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:21.061912 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c392ed-3c40-4b79-b1b7-9bbb289ea051 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:21.072555 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290c4ad-6c0e-4d85-a7c2-b4481798a500 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cc455638fb4db4939af3657ab4203e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:21.073289 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290c4ad-6c0e-4d85-a7c2-b4481798a500 service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:21.076604 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290c4ad-6c0e-4d85-a7c2-b4481798a500 service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:21.076900 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290c4ad-6c0e-4d85-a7c2-b4481798a500 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:21.103035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290c4ad-6c0e-4d85-a7c2-b4481798a500 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:21.104662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290c4ad-6c0e-4d85-a7c2-b4481798a500 service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:21.148580 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1213/2414] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 17:00:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:00:24.680607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37cfc0-50eb-4e53-9629-d60d941163a2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:24.744861 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:24.808947 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37cfc0-50eb-4e53-9629-d60d941163a2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:24.816182 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69079b-f48b-49bb-9a4b-dc8c66aa7b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:24.817296 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69079b-f48b-49bb-9a4b-dc8c66aa7b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:24.817706 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69079b-f48b-49bb-9a4b-dc8c66aa7b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:24.818087 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69079b-f48b-49bb-9a4b-dc8c66aa7b18 admin admin] PATH_INFO: `/v3/users/8f36feb77d14455e9c2b603325758b59` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:24.819784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69079b-f48b-49bb-9a4b-dc8c66aa7b18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f36feb77d14455e9c2b603325758b59)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:24.822301 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69079b-f48b-49bb-9a4b-dc8c66aa7b18 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:25.170244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bf69079b-f48b-49bb-9a4b-dc8c66aa7b18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f36feb77d14455e9c2b603325758b59'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:25.566240 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bf69079b-f48b-49bb-9a4b-dc8c66aa7b18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f36feb77d14455e9c2b603325758b59'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:25.566891 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bf69079b-f48b-49bb-9a4b-dc8c66aa7b18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f36feb77d14455e9c2b603325758b59'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:25.567504 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bf69079b-f48b-49bb-9a4b-dc8c66aa7b18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f36feb77d14455e9c2b603325758b59'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:25.575068 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bf69079b-f48b-49bb-9a4b-dc8c66aa7b18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f36feb77d14455e9c2b603325758b59'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:25.596076 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1202/2415] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:00:24 2022] DELETE /identity/v3/users/8f36feb77d14455e9c2b603325758b59 => generated 0 bytes in 916 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:25.601026 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e703e6-0cb9-4ded-a881-43d4f423052d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:25.601679 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e703e6-0cb9-4ded-a881-43d4f423052d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:25.601679 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e703e6-0cb9-4ded-a881-43d4f423052d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:25.617859 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:25.625559 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e8e703e6-0cb9-4ded-a881-43d4f423052d None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:25.626899 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e8e703e6-0cb9-4ded-a881-43d4f423052d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:25.729378 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1214/2416] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:00:25.739535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69079b-f48b-49bb-9a4b-dc8c66aa7b18 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:25.741727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bf69079b-f48b-49bb-9a4b-dc8c66aa7b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:25.835303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69079b-f48b-49bb-9a4b-dc8c66aa7b18 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:25.839759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf05ff-3f90-446d-a65e-00fd6dbf4784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:25.840734 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf05ff-3f90-446d-a65e-00fd6dbf4784 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:25.841703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf05ff-3f90-446d-a65e-00fd6dbf4784 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:25.842440 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf05ff-3f90-446d-a65e-00fd6dbf4784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:25.855346 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf05ff-3f90-446d-a65e-00fd6dbf4784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:25.857094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf05ff-3f90-446d-a65e-00fd6dbf4784 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:25.869371 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1203/2417] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:00:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:00:26.563136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e703e6-0cb9-4ded-a881-43d4f423052d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:26.569875 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e8e703e6-0cb9-4ded-a881-43d4f423052d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:26.588716 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e703e6-0cb9-4ded-a881-43d4f423052d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:26.594304 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cdeca-5327-493d-a827-a535da5d480e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:26.595258 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cdeca-5327-493d-a827-a535da5d480e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:26.596272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cdeca-5327-493d-a827-a535da5d480e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:26.596544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cdeca-5327-493d-a827-a535da5d480e admin admin] PATH_INFO: `/v3/projects/83bbc4ecce4a40759395a8afb41063e0` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:26.597994 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cdeca-5327-493d-a827-a535da5d480e admin admin] RBAC: Authorizing `identity:delete_project(project_id=83bbc4ecce4a40759395a8afb41063e0)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:26.601127 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cdeca-5327-493d-a827-a535da5d480e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:26.767760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a60cdeca-5327-493d-a827-a535da5d480e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83bbc4ecce4a40759395a8afb41063e0', 'request_id': 'req-a60cdeca-5327-493d-a827-a535da5d480e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:26.863169 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a60cdeca-5327-493d-a827-a535da5d480e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83bbc4ecce4a40759395a8afb41063e0', 'request_id': 'req-a60cdeca-5327-493d-a827-a535da5d480e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:26.876582 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a60cdeca-5327-493d-a827-a535da5d480e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83bbc4ecce4a40759395a8afb41063e0', 'request_id': 'req-a60cdeca-5327-493d-a827-a535da5d480e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:26.896788 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a60cdeca-5327-493d-a827-a535da5d480e admin admin] The token cache is being invalidate because project 83bbc4ecce4a40759395a8afb41063e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:00:26.896984 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a60cdeca-5327-493d-a827-a535da5d480e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:26.897808 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a60cdeca-5327-493d-a827-a535da5d480e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:26.899990 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1215/2418] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:00:26 2022] DELETE /identity/v3/projects/83bbc4ecce4a40759395a8afb41063e0 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:26.906776 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedab811-65c7-4663-8167-ec7f6b2ebe20 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:26.909521 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedab811-65c7-4663-8167-ec7f6b2ebe20 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:26.914670 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedab811-65c7-4663-8167-ec7f6b2ebe20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:26.933352 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-cedab811-65c7-4663-8167-ec7f6b2ebe20 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:26.934776 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cedab811-65c7-4663-8167-ec7f6b2ebe20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:27.037483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:27.057065 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1204/2419] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:00:27.073831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a46153-f2c0-4719-98e3-858a8418a51c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:27.075150 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a46153-f2c0-4719-98e3-858a8418a51c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:27.075150 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a46153-f2c0-4719-98e3-858a8418a51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:27.104762 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-30a46153-f2c0-4719-98e3-858a8418a51c None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:27.106042 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-30a46153-f2c0-4719-98e3-858a8418a51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:27.120254 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedab811-65c7-4663-8167-ec7f6b2ebe20 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:27.126765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1216/2420] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:27.131935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedab811-65c7-4663-8167-ec7f6b2ebe20 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:27.136943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43cc0a-30bf-463f-87e3-95990e314756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:27.137767 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43cc0a-30bf-463f-87e3-95990e314756 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:27.138053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43cc0a-30bf-463f-87e3-95990e314756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:27.138337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43cc0a-30bf-463f-87e3-95990e314756 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:27.139085 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43cc0a-30bf-463f-87e3-95990e314756 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:00:27.139932 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43cc0a-30bf-463f-87e3-95990e314756 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:27.141376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43cc0a-30bf-463f-87e3-95990e314756 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:27.168674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1205/2421] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:00:27.173370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a46153-f2c0-4719-98e3-858a8418a51c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:27.185292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a46153-f2c0-4719-98e3-858a8418a51c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:27.198539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab8c07-14b8-44a6-a5aa-ba2ec0ea9e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:27.199385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab8c07-14b8-44a6-a5aa-ba2ec0ea9e55 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:27.199925 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab8c07-14b8-44a6-a5aa-ba2ec0ea9e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:27.200303 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab8c07-14b8-44a6-a5aa-ba2ec0ea9e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:27.201204 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab8c07-14b8-44a6-a5aa-ba2ec0ea9e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:27.203610 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab8c07-14b8-44a6-a5aa-ba2ec0ea9e55 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:27.330219 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1217/2422] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:00:27 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:00:27.337707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43cc0a-30bf-463f-87e3-95990e314756 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:27.352260 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43cc0a-30bf-463f-87e3-95990e314756 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:27.474508 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4038dd-af86-4b77-a07e-d487afb3174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:27.475344 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4038dd-af86-4b77-a07e-d487afb3174d admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:27.475723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4038dd-af86-4b77-a07e-d487afb3174d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:27.476251 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4038dd-af86-4b77-a07e-d487afb3174d admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:27.477046 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4038dd-af86-4b77-a07e-d487afb3174d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:27.479339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4038dd-af86-4b77-a07e-d487afb3174d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:27.570884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1206/2423] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:00:27 2022] POST /identity/v3/users => generated 291 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:00:27.574609 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab8c07-14b8-44a6-a5aa-ba2ec0ea9e55 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:27.588945 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab8c07-14b8-44a6-a5aa-ba2ec0ea9e55 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:27.609973 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9ca00-6d4c-408d-ab6c-4247b2ef6484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:27.611913 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9ca00-6d4c-408d-ab6c-4247b2ef6484 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:27.613630 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9ca00-6d4c-408d-ab6c-4247b2ef6484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:27.628233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9ca00-6d4c-408d-ab6c-4247b2ef6484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:27.628233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9ca00-6d4c-408d-ab6c-4247b2ef6484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:27.628233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9ca00-6d4c-408d-ab6c-4247b2ef6484 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:27.639786 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1218/2424] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:00:27.644587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4038dd-af86-4b77-a07e-d487afb3174d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:27.658341 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4038dd-af86-4b77-a07e-d487afb3174d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:27.665901 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9def6-2e22-4d1d-9509-a12082264ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:27.666609 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9def6-2e22-4d1d-9509-a12082264ffb admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:27.666971 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9def6-2e22-4d1d-9509-a12082264ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:27.667148 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9def6-2e22-4d1d-9509-a12082264ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:27.667885 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9def6-2e22-4d1d-9509-a12082264ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:27.669584 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9def6-2e22-4d1d-9509-a12082264ffb admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:27.682319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1207/2425] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:00:27.686200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9ca00-6d4c-408d-ab6c-4247b2ef6484 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:27.698443 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9ca00-6d4c-408d-ab6c-4247b2ef6484 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:27.704799 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a57803-ff5d-49e9-8409-b43c9fa8522f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:27.705969 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a57803-ff5d-49e9-8409-b43c9fa8522f admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:27.706683 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a57803-ff5d-49e9-8409-b43c9fa8522f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:27.707064 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a57803-ff5d-49e9-8409-b43c9fa8522f admin admin] PATH_INFO: `/v3/projects/c6ad6af479db4e92933ac0d1567f25e1/users/284df7837ac84a98992207ac01587020/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:27.728085 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a57803-ff5d-49e9-8409-b43c9fa8522f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ad6af479db4e92933ac0d1567f25e1, user_id=284df7837ac84a98992207ac01587020, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:27.731008 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a57803-ff5d-49e9-8409-b43c9fa8522f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:27.837344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1219/2426] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:00:27 2022] PUT /identity/v3/projects/c6ad6af479db4e92933ac0d1567f25e1/users/284df7837ac84a98992207ac01587020/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:00:27.848374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b680bd5-f35c-4a72-aee9-be9ea5fde997 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:27.848677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b680bd5-f35c-4a72-aee9-be9ea5fde997 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:27.848969 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b680bd5-f35c-4a72-aee9-be9ea5fde997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:27.871148 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6b680bd5-f35c-4a72-aee9-be9ea5fde997 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:27.881901 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6b680bd5-f35c-4a72-aee9-be9ea5fde997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:27.956362 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1208/2427] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:27.989619 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a57803-ff5d-49e9-8409-b43c9fa8522f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:27.992260 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-47a57803-ff5d-49e9-8409-b43c9fa8522f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:28.038720 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:28.077199 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a57803-ff5d-49e9-8409-b43c9fa8522f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:28.085124 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb47ce-4129-4f01-85d6-ad6da54a6f1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:28.086002 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb47ce-4129-4f01-85d6-ad6da54a6f1f service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:28.086385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb47ce-4129-4f01-85d6-ad6da54a6f1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:28.086812 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb47ce-4129-4f01-85d6-ad6da54a6f1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:28.097876 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb47ce-4129-4f01-85d6-ad6da54a6f1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:28.102084 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb47ce-4129-4f01-85d6-ad6da54a6f1f service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:28.118681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1220/2428] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:00:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:00:30.328225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64e6c8-0b69-4d8d-a365-c2589d10d7f5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:30.329355 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64e6c8-0b69-4d8d-a365-c2589d10d7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:30.329805 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64e6c8-0b69-4d8d-a365-c2589d10d7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:30.367965 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6f64e6c8-0b69-4d8d-a365-c2589d10d7f5 None None] MFA Rules not processed for user `284df7837ac84a98992207ac01587020`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:30.386937 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6f64e6c8-0b69-4d8d-a365-c2589d10d7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:30.573113 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:30.591353 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1209/2429] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:00:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:30.600473 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb47ce-4129-4f01-85d6-ad6da54a6f1f service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:30.602272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f7cb47ce-4129-4f01-85d6-ad6da54a6f1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:30.746712 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb47ce-4129-4f01-85d6-ad6da54a6f1f service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:30.751409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079265cc-118e-40cd-82be-5c3add894644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:30.752178 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079265cc-118e-40cd-82be-5c3add894644 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:30.752457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079265cc-118e-40cd-82be-5c3add894644 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:30.752736 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079265cc-118e-40cd-82be-5c3add894644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:30.763469 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079265cc-118e-40cd-82be-5c3add894644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:30.764862 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079265cc-118e-40cd-82be-5c3add894644 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:30.787272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1221/2430] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:00:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:00:32.611734 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9303a39-421e-4a98-af8d-9540f3dd0eff None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:32.612246 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9303a39-421e-4a98-af8d-9540f3dd0eff None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:32.612353 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9303a39-421e-4a98-af8d-9540f3dd0eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:32.634540 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d9303a39-421e-4a98-af8d-9540f3dd0eff None None] MFA Rules not processed for user `284df7837ac84a98992207ac01587020`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:32.635852 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d9303a39-421e-4a98-af8d-9540f3dd0eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:32.652358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1210/2431] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:00:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:40.771022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=40 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:42.626393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:46.676699 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf01664-9400-4d5c-8d22-0fd2a6b786ab None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:46.677174 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf01664-9400-4d5c-8d22-0fd2a6b786ab None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:46.677336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf01664-9400-4d5c-8d22-0fd2a6b786ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:46.695225 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1bf01664-9400-4d5c-8d22-0fd2a6b786ab None None] MFA Rules not processed for user `4d2ab3eeb5b44979956dd223ac6b7c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:46.696463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1bf01664-9400-4d5c-8d22-0fd2a6b786ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:46.757945 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1222/2432] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 17:00:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:46.770576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9303a39-421e-4a98-af8d-9540f3dd0eff None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:46.772298 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d9303a39-421e-4a98-af8d-9540f3dd0eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:46.846689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9303a39-421e-4a98-af8d-9540f3dd0eff None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:46.859650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcb375-2b37-476d-bc8d-0b9198a3e45d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cc455638fb4db4939af3657ab4203e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:46.859650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcb375-2b37-476d-bc8d-0b9198a3e45d service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:46.859650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcb375-2b37-476d-bc8d-0b9198a3e45d service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:46.859650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcb375-2b37-476d-bc8d-0b9198a3e45d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:46.867673 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afcb375-2b37-476d-bc8d-0b9198a3e45d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:46.869311 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afcb375-2b37-476d-bc8d-0b9198a3e45d service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:46.879108 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1211/2433] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 17:00:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:00:56.749596 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=25 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:56.874873 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=32 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:04.893171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217df1f-f9b9-45a9-9403-74dcb353df53 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:04.893812 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217df1f-f9b9-45a9-9403-74dcb353df53 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:04.893812 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217df1f-f9b9-45a9-9403-74dcb353df53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:04.914221 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8217df1f-f9b9-45a9-9403-74dcb353df53 None None] MFA Rules not processed for user `4d2ab3eeb5b44979956dd223ac6b7c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:04.915451 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8217df1f-f9b9-45a9-9403-74dcb353df53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:04.923193 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1223/2434] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 26 17:01:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:04.935617 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcb375-2b37-476d-bc8d-0b9198a3e45d service swift] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:04.946182 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcb375-2b37-476d-bc8d-0b9198a3e45d service swift] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:04.951676 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af334e-30d8-491e-902d-3d6cdc9f2b78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cc455638fb4db4939af3657ab4203e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:04.953218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af334e-30d8-491e-902d-3d6cdc9f2b78 service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:04.953365 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af334e-30d8-491e-902d-3d6cdc9f2b78 service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:04.953638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af334e-30d8-491e-902d-3d6cdc9f2b78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:04.963047 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af334e-30d8-491e-902d-3d6cdc9f2b78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:04.964653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af334e-30d8-491e-902d-3d6cdc9f2b78 service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:04.974197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1212/2435] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 17:01:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:01:10.846746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217df1f-f9b9-45a9-9403-74dcb353df53 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:10.856367 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217df1f-f9b9-45a9-9403-74dcb353df53 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:10.860566 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95f6b9-9c0e-410b-8f46-60ac98e996a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:10.861204 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95f6b9-9c0e-410b-8f46-60ac98e996a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:10.861526 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95f6b9-9c0e-410b-8f46-60ac98e996a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:10.861798 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95f6b9-9c0e-410b-8f46-60ac98e996a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:10.863523 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7c95f6b9-9c0e-410b-8f46-60ac98e996a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:10.876258 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95f6b9-9c0e-410b-8f46-60ac98e996a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:10.877713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95f6b9-9c0e-410b-8f46-60ac98e996a2 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:10.887660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1224/2436] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:01:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:14.499451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af334e-30d8-491e-902d-3d6cdc9f2b78 service swift] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:14.502615 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-94af334e-30d8-491e-902d-3d6cdc9f2b78 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:14.589147 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af334e-30d8-491e-902d-3d6cdc9f2b78 service swift] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:14.595429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7db560-cf3e-47a7-b27d-279d0079c002 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beeefb9b8d394407a5e7a32f5a00ffad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:14.595812 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7db560-cf3e-47a7-b27d-279d0079c002 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:14.596023 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7db560-cf3e-47a7-b27d-279d0079c002 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:14.596763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7db560-cf3e-47a7-b27d-279d0079c002 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:14.598205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bb7db560-cf3e-47a7-b27d-279d0079c002 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:14.609840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95f6b9-9c0e-410b-8f46-60ac98e996a2 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:14.611344 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7db560-cf3e-47a7-b27d-279d0079c002 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:14.611993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7c95f6b9-9c0e-410b-8f46-60ac98e996a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:14.613242 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7db560-cf3e-47a7-b27d-279d0079c002 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:14.625115 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1213/2437] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:01:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:14.629017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95f6b9-9c0e-410b-8f46-60ac98e996a2 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:14.633825 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e681f7-5fd4-441b-a92a-e2e44de53ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:14.634724 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e681f7-5fd4-441b-a92a-e2e44de53ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:14.635010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e681f7-5fd4-441b-a92a-e2e44de53ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:14.635287 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e681f7-5fd4-441b-a92a-e2e44de53ba2 admin admin] PATH_INFO: `/v3/users/d5684eb0dd3141f5a25b61aafedbe865` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:14.636549 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e681f7-5fd4-441b-a92a-e2e44de53ba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5684eb0dd3141f5a25b61aafedbe865)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:14.639782 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e681f7-5fd4-441b-a92a-e2e44de53ba2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:14.832136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c0e681f7-5fd4-441b-a92a-e2e44de53ba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5684eb0dd3141f5a25b61aafedbe865'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:14.832839 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c0e681f7-5fd4-441b-a92a-e2e44de53ba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5684eb0dd3141f5a25b61aafedbe865'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:14.840320 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c0e681f7-5fd4-441b-a92a-e2e44de53ba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5684eb0dd3141f5a25b61aafedbe865'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:14.930850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c0e681f7-5fd4-441b-a92a-e2e44de53ba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5684eb0dd3141f5a25b61aafedbe865'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:14.931476 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c0e681f7-5fd4-441b-a92a-e2e44de53ba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5684eb0dd3141f5a25b61aafedbe865'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:14.953742 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1225/2438] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:01:14 2022] DELETE /identity/v3/users/d5684eb0dd3141f5a25b61aafedbe865 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:15.190460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7db560-cf3e-47a7-b27d-279d0079c002 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:15.201649 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7db560-cf3e-47a7-b27d-279d0079c002 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:15.263936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5fd1b-18b0-4dca-9f23-b89e42a7f794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:15.264798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5fd1b-18b0-4dca-9f23-b89e42a7f794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:15.265081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5fd1b-18b0-4dca-9f23-b89e42a7f794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:15.265395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5fd1b-18b0-4dca-9f23-b89e42a7f794 admin admin] PATH_INFO: `/v3/projects/89a7299f01984027a505aa43d96e07b3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:15.266571 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5fd1b-18b0-4dca-9f23-b89e42a7f794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89a7299f01984027a505aa43d96e07b3)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:15.268808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5fd1b-18b0-4dca-9f23-b89e42a7f794 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:15.394634 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2de5fd1b-18b0-4dca-9f23-b89e42a7f794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89a7299f01984027a505aa43d96e07b3', 'request_id': 'req-2de5fd1b-18b0-4dca-9f23-b89e42a7f794'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:15.400134 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2de5fd1b-18b0-4dca-9f23-b89e42a7f794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89a7299f01984027a505aa43d96e07b3', 'request_id': 'req-2de5fd1b-18b0-4dca-9f23-b89e42a7f794'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:15.406712 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2de5fd1b-18b0-4dca-9f23-b89e42a7f794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89a7299f01984027a505aa43d96e07b3', 'request_id': 'req-2de5fd1b-18b0-4dca-9f23-b89e42a7f794'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:15.497397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2de5fd1b-18b0-4dca-9f23-b89e42a7f794 admin admin] The token cache is being invalidate because project 89a7299f01984027a505aa43d96e07b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:01:15.497725 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2de5fd1b-18b0-4dca-9f23-b89e42a7f794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:15.498363 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2de5fd1b-18b0-4dca-9f23-b89e42a7f794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:15.500606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1214/2439] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:01:15 2022] DELETE /identity/v3/projects/89a7299f01984027a505aa43d96e07b3 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:15.505502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f205e-8b27-42be-8e7a-a9acc5733077 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:15.505802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f205e-8b27-42be-8e7a-a9acc5733077 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:15.506082 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f205e-8b27-42be-8e7a-a9acc5733077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:15.525436 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5c6f205e-8b27-42be-8e7a-a9acc5733077 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:15.526639 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5c6f205e-8b27-42be-8e7a-a9acc5733077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:15.587650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1226/2440] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:15.596961 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c9f9d-9dca-4ee9-a2e7-02c5b98b2c6f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:15.599711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c9f9d-9dca-4ee9-a2e7-02c5b98b2c6f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:15.599711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c9f9d-9dca-4ee9-a2e7-02c5b98b2c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:15.615468 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:15.623020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dc7c9f9d-9dca-4ee9-a2e7-02c5b98b2c6f None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:15.625494 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dc7c9f9d-9dca-4ee9-a2e7-02c5b98b2c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:15.635263 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1215/2441] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:15.639025 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f205e-8b27-42be-8e7a-a9acc5733077 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:15.649966 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f205e-8b27-42be-8e7a-a9acc5733077 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:15.656682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42393eaf-c9ce-4326-9001-507c24e42eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:15.664929 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42393eaf-c9ce-4326-9001-507c24e42eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:15.664929 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42393eaf-c9ce-4326-9001-507c24e42eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:15.664929 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42393eaf-c9ce-4326-9001-507c24e42eb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:15.664929 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42393eaf-c9ce-4326-9001-507c24e42eb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:01:15.664929 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42393eaf-c9ce-4326-9001-507c24e42eb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:15.664929 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42393eaf-c9ce-4326-9001-507c24e42eb7 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:15.675163 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1227/2442] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:01:15.681359 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c9f9d-9dca-4ee9-a2e7-02c5b98b2c6f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:15.693753 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c9f9d-9dca-4ee9-a2e7-02c5b98b2c6f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:15.698622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3df12-c570-4490-8685-4ce7cad7577a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:15.699318 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3df12-c570-4490-8685-4ce7cad7577a admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:15.699604 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3df12-c570-4490-8685-4ce7cad7577a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:15.699880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3df12-c570-4490-8685-4ce7cad7577a admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:15.700571 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3df12-c570-4490-8685-4ce7cad7577a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:15.702765 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3df12-c570-4490-8685-4ce7cad7577a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:15.784567 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1216/2443] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:01:15 2022] POST /identity/v3/projects => generated 403 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:15.788708 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42393eaf-c9ce-4326-9001-507c24e42eb7 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:15.799419 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42393eaf-c9ce-4326-9001-507c24e42eb7 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:15.836963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:15.858479 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1dcb78-0cc9-4ff3-bbb7-f4b8e659879c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:15.859237 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dcb78-0cc9-4ff3-bbb7-f4b8e659879c admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:15.859470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dcb78-0cc9-4ff3-bbb7-f4b8e659879c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:15.859651 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dcb78-0cc9-4ff3-bbb7-f4b8e659879c admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:15.860538 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1dcb78-0cc9-4ff3-bbb7-f4b8e659879c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:15.863362 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1dcb78-0cc9-4ff3-bbb7-f4b8e659879c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:15.973961 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1228/2444] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:01:15 2022] POST /identity/v3/users => generated 302 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:01:15.977617 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3df12-c570-4490-8685-4ce7cad7577a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:15.988938 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3df12-c570-4490-8685-4ce7cad7577a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:15.993617 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafc023-9560-4a01-bf57-3caf73d7e918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:15.994284 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafc023-9560-4a01-bf57-3caf73d7e918 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:15.994569 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafc023-9560-4a01-bf57-3caf73d7e918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:15.994848 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafc023-9560-4a01-bf57-3caf73d7e918 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:15.995579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafc023-9560-4a01-bf57-3caf73d7e918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:15.997224 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafc023-9560-4a01-bf57-3caf73d7e918 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:16.007878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1217/2445] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:01:16.011896 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1dcb78-0cc9-4ff3-bbb7-f4b8e659879c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:16.022627 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1dcb78-0cc9-4ff3-bbb7-f4b8e659879c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:16.027986 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723931b8-2ae1-44fe-a937-50534235ee6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:16.030582 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723931b8-2ae1-44fe-a937-50534235ee6c admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:16.030582 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723931b8-2ae1-44fe-a937-50534235ee6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:16.030582 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723931b8-2ae1-44fe-a937-50534235ee6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:16.030879 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723931b8-2ae1-44fe-a937-50534235ee6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:16.032266 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723931b8-2ae1-44fe-a937-50534235ee6c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:16.043165 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1229/2446] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:01:16.047309 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafc023-9560-4a01-bf57-3caf73d7e918 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:16.057697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafc023-9560-4a01-bf57-3caf73d7e918 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:16.062673 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6da10-efb9-468a-b7c5-59e475e497c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:16.063668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6da10-efb9-468a-b7c5-59e475e497c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:16.063949 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6da10-efb9-468a-b7c5-59e475e497c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:16.064221 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6da10-efb9-468a-b7c5-59e475e497c0 admin admin] PATH_INFO: `/v3/projects/c975c1ee1d7146fd9efbf15cdbb023ae/users/0ec5b10144cd429da76e10db8eb8a746/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:16.083015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6da10-efb9-468a-b7c5-59e475e497c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c975c1ee1d7146fd9efbf15cdbb023ae, user_id=0ec5b10144cd429da76e10db8eb8a746, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:16.085975 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6da10-efb9-468a-b7c5-59e475e497c0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:16.161067 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1218/2447] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:01:16 2022] PUT /identity/v3/projects/c975c1ee1d7146fd9efbf15cdbb023ae/users/0ec5b10144cd429da76e10db8eb8a746/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:16.172429 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2aeb34-b85b-44df-a0f9-eb62387f2c99 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:16.172718 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2aeb34-b85b-44df-a0f9-eb62387f2c99 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:16.172999 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2aeb34-b85b-44df-a0f9-eb62387f2c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:16.199329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8b2aeb34-b85b-44df-a0f9-eb62387f2c99 None None] MFA Rules not processed for user `0ec5b10144cd429da76e10db8eb8a746`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:16.200658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8b2aeb34-b85b-44df-a0f9-eb62387f2c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:16.268175 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1230/2448] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:16.272314 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6da10-efb9-468a-b7c5-59e475e497c0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:16.335300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6da10-efb9-468a-b7c5-59e475e497c0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:16.340014 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69829a79-ba3c-4b3e-8129-395abe3ee7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:16.340720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69829a79-ba3c-4b3e-8129-395abe3ee7b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:16.341008 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69829a79-ba3c-4b3e-8129-395abe3ee7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:16.341305 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69829a79-ba3c-4b3e-8129-395abe3ee7b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:16.342142 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69829a79-ba3c-4b3e-8129-395abe3ee7b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:16.344614 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69829a79-ba3c-4b3e-8129-395abe3ee7b3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:16.447357 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1219/2449] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:01:16 2022] POST /identity/v3/projects => generated 403 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:16.452301 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2aeb34-b85b-44df-a0f9-eb62387f2c99 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:16.463897 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2aeb34-b85b-44df-a0f9-eb62387f2c99 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:16.521787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa0d38-0f2c-4b05-bd32-2dbf0a4fa728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:16.522464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa0d38-0f2c-4b05-bd32-2dbf0a4fa728 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:16.522746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa0d38-0f2c-4b05-bd32-2dbf0a4fa728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:16.523058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa0d38-0f2c-4b05-bd32-2dbf0a4fa728 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:16.523755 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa0d38-0f2c-4b05-bd32-2dbf0a4fa728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:16.525859 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa0d38-0f2c-4b05-bd32-2dbf0a4fa728 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:16.667352 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1231/2450] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:01:16 2022] POST /identity/v3/users => generated 308 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:16.667924 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69829a79-ba3c-4b3e-8129-395abe3ee7b3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:16.679530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69829a79-ba3c-4b3e-8129-395abe3ee7b3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:16.684788 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d2483-18d1-4da9-bc84-1f2b2123da0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:16.685584 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d2483-18d1-4da9-bc84-1f2b2123da0f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:16.686370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d2483-18d1-4da9-bc84-1f2b2123da0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:16.686651 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d2483-18d1-4da9-bc84-1f2b2123da0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:16.687396 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d2483-18d1-4da9-bc84-1f2b2123da0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:16.689036 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d2483-18d1-4da9-bc84-1f2b2123da0f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:16.704824 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1220/2451] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:01:16.705951 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa0d38-0f2c-4b05-bd32-2dbf0a4fa728 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:16.716959 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa0d38-0f2c-4b05-bd32-2dbf0a4fa728 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:16.722914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f75c0-cf29-43fb-abf1-1f31c6b9c93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:16.723639 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f75c0-cf29-43fb-abf1-1f31c6b9c93c admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:16.723925 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f75c0-cf29-43fb-abf1-1f31c6b9c93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:16.724199 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f75c0-cf29-43fb-abf1-1f31c6b9c93c admin admin] PATH_INFO: `/v3/projects/471a76dbc0a7439da93c01e2416bc6fe/users/1e535408131f4dfaba52f019de2514aa/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:16.743256 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f75c0-cf29-43fb-abf1-1f31c6b9c93c admin admin] RBAC: Authorizing `identity:create_grant(project_id=471a76dbc0a7439da93c01e2416bc6fe, user_id=1e535408131f4dfaba52f019de2514aa, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:16.746284 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f75c0-cf29-43fb-abf1-1f31c6b9c93c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:16.891488 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1232/2452] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:01:16 2022] PUT /identity/v3/projects/471a76dbc0a7439da93c01e2416bc6fe/users/1e535408131f4dfaba52f019de2514aa/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:16.895442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d2483-18d1-4da9-bc84-1f2b2123da0f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:16.905512 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d2483-18d1-4da9-bc84-1f2b2123da0f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:16.963071 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df1a51-d397-422b-8c1b-26dc02d44f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:16.963640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df1a51-d397-422b-8c1b-26dc02d44f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:16.963922 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df1a51-d397-422b-8c1b-26dc02d44f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:16.964196 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df1a51-d397-422b-8c1b-26dc02d44f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:16.964908 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df1a51-d397-422b-8c1b-26dc02d44f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:16.966535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df1a51-d397-422b-8c1b-26dc02d44f39 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:16.976817 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1221/2453] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:01:16.980979 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f75c0-cf29-43fb-abf1-1f31c6b9c93c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:16.992055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f75c0-cf29-43fb-abf1-1f31c6b9c93c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:17.012738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9e6f6-72dd-46ae-97f7-c9de8c936434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:17.013759 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9e6f6-72dd-46ae-97f7-c9de8c936434 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:17.014173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9e6f6-72dd-46ae-97f7-c9de8c936434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:17.014589 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9e6f6-72dd-46ae-97f7-c9de8c936434 admin admin] PATH_INFO: `/v3/projects/471a76dbc0a7439da93c01e2416bc6fe/users/1e535408131f4dfaba52f019de2514aa/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:17.016757 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9e6f6-72dd-46ae-97f7-c9de8c936434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=471a76dbc0a7439da93c01e2416bc6fe, user_id=1e535408131f4dfaba52f019de2514aa, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:17.019730 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9e6f6-72dd-46ae-97f7-c9de8c936434 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:17.028622 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:17.040447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1233/2454] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:01:16 2022] PUT /identity/v3/projects/471a76dbc0a7439da93c01e2416bc6fe/users/1e535408131f4dfaba52f019de2514aa/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:17.051713 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3c156-8824-4f01-9381-a51a53152451 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:17.052003 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3c156-8824-4f01-9381-a51a53152451 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:17.052287 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3c156-8824-4f01-9381-a51a53152451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:17.078749 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:17.084752 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9bf3c156-8824-4f01-9381-a51a53152451 None None] MFA Rules not processed for user `1e535408131f4dfaba52f019de2514aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:17.084752 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9bf3c156-8824-4f01-9381-a51a53152451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:17.151664 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1222/2455] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:17 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:17.163527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9e6f6-72dd-46ae-97f7-c9de8c936434 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:17.165589 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-87f9e6f6-72dd-46ae-97f7-c9de8c936434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:17.240460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9e6f6-72dd-46ae-97f7-c9de8c936434 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:17.240460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190f98e-9851-4da4-ac19-a6b200a29798 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:17.240460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190f98e-9851-4da4-ac19-a6b200a29798 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:17.240460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190f98e-9851-4da4-ac19-a6b200a29798 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:17.240991 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190f98e-9851-4da4-ac19-a6b200a29798 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:17.240991 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190f98e-9851-4da4-ac19-a6b200a29798 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:17.241308 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190f98e-9851-4da4-ac19-a6b200a29798 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:17.250828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1234/2456] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:01:17 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:01:17.413775 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3c156-8824-4f01-9381-a51a53152451 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:17.477138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3c156-8824-4f01-9381-a51a53152451 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:17.481790 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe3b8b-001a-4398-a4ba-bd64542bacec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:17.482683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe3b8b-001a-4398-a4ba-bd64542bacec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:17.483613 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe3b8b-001a-4398-a4ba-bd64542bacec admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:17.483892 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe3b8b-001a-4398-a4ba-bd64542bacec admin admin] PATH_INFO: `/v3/users/0ec5b10144cd429da76e10db8eb8a746` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:17.485139 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe3b8b-001a-4398-a4ba-bd64542bacec admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ec5b10144cd429da76e10db8eb8a746)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:17.487269 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe3b8b-001a-4398-a4ba-bd64542bacec admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:17.688314 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a2fe3b8b-001a-4398-a4ba-bd64542bacec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ec5b10144cd429da76e10db8eb8a746'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:17.754014 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a2fe3b8b-001a-4398-a4ba-bd64542bacec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ec5b10144cd429da76e10db8eb8a746'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:17.754662 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a2fe3b8b-001a-4398-a4ba-bd64542bacec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ec5b10144cd429da76e10db8eb8a746'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:17.755251 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a2fe3b8b-001a-4398-a4ba-bd64542bacec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ec5b10144cd429da76e10db8eb8a746'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:17.770902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a2fe3b8b-001a-4398-a4ba-bd64542bacec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ec5b10144cd429da76e10db8eb8a746'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:17.789350 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1223/2457] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:01:17 2022] DELETE /identity/v3/users/0ec5b10144cd429da76e10db8eb8a746 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:17.793822 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d27479-6447-4447-8b9f-9e9613ab0185 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:17.794327 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d27479-6447-4447-8b9f-9e9613ab0185 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:17.794445 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d27479-6447-4447-8b9f-9e9613ab0185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:17.812099 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b6d27479-6447-4447-8b9f-9e9613ab0185 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:17.813348 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b6d27479-6447-4447-8b9f-9e9613ab0185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:17.872502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1235/2458] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:17.882769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe3b8b-001a-4398-a4ba-bd64542bacec admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:17.884213 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a2fe3b8b-001a-4398-a4ba-bd64542bacec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:17.905222 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:17.941900 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe3b8b-001a-4398-a4ba-bd64542bacec admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:17.945502 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672dfa15-a367-4410-8187-375f811de06f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:17.946145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672dfa15-a367-4410-8187-375f811de06f service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:17.946489 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672dfa15-a367-4410-8187-375f811de06f service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:17.946761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672dfa15-a367-4410-8187-375f811de06f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:17.955703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672dfa15-a367-4410-8187-375f811de06f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:17.957126 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672dfa15-a367-4410-8187-375f811de06f service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:17.966777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1224/2459] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:01:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:18.435627 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d27479-6447-4447-8b9f-9e9613ab0185 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:18.437796 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b6d27479-6447-4447-8b9f-9e9613ab0185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:18.450487 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d27479-6447-4447-8b9f-9e9613ab0185 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:18.455264 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6288d9d-3bac-4899-8f9b-cad5773e0f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:18.456208 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6288d9d-3bac-4899-8f9b-cad5773e0f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:18.456545 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6288d9d-3bac-4899-8f9b-cad5773e0f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:18.456817 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6288d9d-3bac-4899-8f9b-cad5773e0f6c admin admin] PATH_INFO: `/v3/projects/c975c1ee1d7146fd9efbf15cdbb023ae` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:18.458140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6288d9d-3bac-4899-8f9b-cad5773e0f6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c975c1ee1d7146fd9efbf15cdbb023ae)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:18.460411 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6288d9d-3bac-4899-8f9b-cad5773e0f6c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:18.590161 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d6288d9d-3bac-4899-8f9b-cad5773e0f6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c975c1ee1d7146fd9efbf15cdbb023ae', 'request_id': 'req-d6288d9d-3bac-4899-8f9b-cad5773e0f6c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:18.673928 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d6288d9d-3bac-4899-8f9b-cad5773e0f6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c975c1ee1d7146fd9efbf15cdbb023ae', 'request_id': 'req-d6288d9d-3bac-4899-8f9b-cad5773e0f6c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:18.680915 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d6288d9d-3bac-4899-8f9b-cad5773e0f6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c975c1ee1d7146fd9efbf15cdbb023ae', 'request_id': 'req-d6288d9d-3bac-4899-8f9b-cad5773e0f6c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:18.692855 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d6288d9d-3bac-4899-8f9b-cad5773e0f6c admin admin] The token cache is being invalidate because project c975c1ee1d7146fd9efbf15cdbb023ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:01:18.693141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d6288d9d-3bac-4899-8f9b-cad5773e0f6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:18.693823 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d6288d9d-3bac-4899-8f9b-cad5773e0f6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:18.695363 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1236/2460] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:01:18 2022] DELETE /identity/v3/projects/c975c1ee1d7146fd9efbf15cdbb023ae => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:18.699677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672dfa15-a367-4410-8187-375f811de06f service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:18.710438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672dfa15-a367-4410-8187-375f811de06f service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:18.775070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e762d6c-372e-4544-bd1b-3e1c0dc91587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:18.776008 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e762d6c-372e-4544-bd1b-3e1c0dc91587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:18.776331 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e762d6c-372e-4544-bd1b-3e1c0dc91587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:18.776612 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e762d6c-372e-4544-bd1b-3e1c0dc91587 admin admin] PATH_INFO: `/v3/users/1e535408131f4dfaba52f019de2514aa` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:18.777849 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e762d6c-372e-4544-bd1b-3e1c0dc91587 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e535408131f4dfaba52f019de2514aa)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:18.779797 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e762d6c-372e-4544-bd1b-3e1c0dc91587 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:19.079174 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e762d6c-372e-4544-bd1b-3e1c0dc91587 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e535408131f4dfaba52f019de2514aa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:19.239842 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e762d6c-372e-4544-bd1b-3e1c0dc91587 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e535408131f4dfaba52f019de2514aa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:19.240521 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e762d6c-372e-4544-bd1b-3e1c0dc91587 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e535408131f4dfaba52f019de2514aa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:19.241178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e762d6c-372e-4544-bd1b-3e1c0dc91587 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e535408131f4dfaba52f019de2514aa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:19.249458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e762d6c-372e-4544-bd1b-3e1c0dc91587 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e535408131f4dfaba52f019de2514aa'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:19.267170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1225/2461] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:01:18 2022] DELETE /identity/v3/users/1e535408131f4dfaba52f019de2514aa => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:19.856641 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6288d9d-3bac-4899-8f9b-cad5773e0f6c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:19.859712 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d6288d9d-3bac-4899-8f9b-cad5773e0f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:19.876438 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6288d9d-3bac-4899-8f9b-cad5773e0f6c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:19.905037 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:19.941031 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d0e83-baf3-4c41-a072-d5ba2edd1d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:19.942056 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d0e83-baf3-4c41-a072-d5ba2edd1d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:19.942366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d0e83-baf3-4c41-a072-d5ba2edd1d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:19.942640 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d0e83-baf3-4c41-a072-d5ba2edd1d6e admin admin] PATH_INFO: `/v3/projects/471a76dbc0a7439da93c01e2416bc6fe` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:19.943893 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d0e83-baf3-4c41-a072-d5ba2edd1d6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=471a76dbc0a7439da93c01e2416bc6fe)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:19.945853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d0e83-baf3-4c41-a072-d5ba2edd1d6e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:20.046309 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-625d0e83-baf3-4c41-a072-d5ba2edd1d6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '471a76dbc0a7439da93c01e2416bc6fe', 'request_id': 'req-625d0e83-baf3-4c41-a072-d5ba2edd1d6e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:20.119819 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-625d0e83-baf3-4c41-a072-d5ba2edd1d6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '471a76dbc0a7439da93c01e2416bc6fe', 'request_id': 'req-625d0e83-baf3-4c41-a072-d5ba2edd1d6e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:20.127035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-625d0e83-baf3-4c41-a072-d5ba2edd1d6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '471a76dbc0a7439da93c01e2416bc6fe', 'request_id': 'req-625d0e83-baf3-4c41-a072-d5ba2edd1d6e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:20.138175 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-625d0e83-baf3-4c41-a072-d5ba2edd1d6e admin admin] The token cache is being invalidate because project 471a76dbc0a7439da93c01e2416bc6fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:01:20.138464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-625d0e83-baf3-4c41-a072-d5ba2edd1d6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:20.139121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-625d0e83-baf3-4c41-a072-d5ba2edd1d6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:20.140671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1237/2462] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:01:19 2022] DELETE /identity/v3/projects/471a76dbc0a7439da93c01e2416bc6fe => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:20.146854 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17043f-730c-4298-822d-826717292588 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:20.147251 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17043f-730c-4298-822d-826717292588 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:20.147599 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17043f-730c-4298-822d-826717292588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:20.167716 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fb17043f-730c-4298-822d-826717292588 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:20.168929 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fb17043f-730c-4298-822d-826717292588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:20.205698 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:20.234124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1226/2463] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:20.242331 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5c5c2-781a-45fa-91f1-386c15f5c67c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:20.242671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5c5c2-781a-45fa-91f1-386c15f5c67c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:20.242955 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5c5c2-781a-45fa-91f1-386c15f5c67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:20.262506 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-42a5c5c2-781a-45fa-91f1-386c15f5c67c None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:20.263863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-42a5c5c2-781a-45fa-91f1-386c15f5c67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:20.272260 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1238/2464] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:20.276555 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17043f-730c-4298-822d-826717292588 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:20.288093 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17043f-730c-4298-822d-826717292588 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:20.293733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c205a9-6bfc-44f1-9d69-bce9daf78ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:20.294200 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c205a9-6bfc-44f1-9d69-bce9daf78ecb admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:20.294490 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c205a9-6bfc-44f1-9d69-bce9daf78ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:20.294768 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c205a9-6bfc-44f1-9d69-bce9daf78ecb admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:20.296357 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c205a9-6bfc-44f1-9d69-bce9daf78ecb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:01:20.296669 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c205a9-6bfc-44f1-9d69-bce9daf78ecb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:20.298330 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c205a9-6bfc-44f1-9d69-bce9daf78ecb admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:20.310591 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1227/2465] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:01:20.315407 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5c5c2-781a-45fa-91f1-386c15f5c67c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:20.325325 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5c5c2-781a-45fa-91f1-386c15f5c67c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:20.330603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bb7e4-c097-4c0f-8377-8027f74b46a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:20.330930 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bb7e4-c097-4c0f-8377-8027f74b46a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:20.331255 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bb7e4-c097-4c0f-8377-8027f74b46a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:20.331513 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bb7e4-c097-4c0f-8377-8027f74b46a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:20.332210 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048bb7e4-c097-4c0f-8377-8027f74b46a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:20.334183 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048bb7e4-c097-4c0f-8377-8027f74b46a9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:20.459921 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1239/2466] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:01:20 2022] POST /identity/v3/projects => generated 369 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:20.463960 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c205a9-6bfc-44f1-9d69-bce9daf78ecb admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:20.475122 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c205a9-6bfc-44f1-9d69-bce9daf78ecb admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:20.533083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85c118-0232-4a99-8b86-2d20f99350b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:20.533805 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85c118-0232-4a99-8b86-2d20f99350b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:20.534093 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85c118-0232-4a99-8b86-2d20f99350b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:20.534374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85c118-0232-4a99-8b86-2d20f99350b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:20.535062 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85c118-0232-4a99-8b86-2d20f99350b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:20.537005 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85c118-0232-4a99-8b86-2d20f99350b0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:20.657689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1228/2467] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:01:20 2022] POST /identity/v3/users => generated 285 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:20.662151 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bb7e4-c097-4c0f-8377-8027f74b46a9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:20.672586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bb7e4-c097-4c0f-8377-8027f74b46a9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:20.677312 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b655bdb-b6ac-4b28-8be2-adf3bd407f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:20.677973 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b655bdb-b6ac-4b28-8be2-adf3bd407f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:20.678258 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b655bdb-b6ac-4b28-8be2-adf3bd407f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:20.678534 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b655bdb-b6ac-4b28-8be2-adf3bd407f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:20.679294 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b655bdb-b6ac-4b28-8be2-adf3bd407f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:20.680895 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b655bdb-b6ac-4b28-8be2-adf3bd407f42 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:20.693225 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1240/2468] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:01:20.702166 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85c118-0232-4a99-8b86-2d20f99350b0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:20.712418 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85c118-0232-4a99-8b86-2d20f99350b0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:20.717697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854873f-e71c-4198-bb60-c79ca2ab7c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:20.718370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854873f-e71c-4198-bb60-c79ca2ab7c98 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:20.718656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854873f-e71c-4198-bb60-c79ca2ab7c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:20.718950 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854873f-e71c-4198-bb60-c79ca2ab7c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:20.719657 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854873f-e71c-4198-bb60-c79ca2ab7c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:20.721288 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854873f-e71c-4198-bb60-c79ca2ab7c98 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:20.731819 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1229/2469] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:01:20.736101 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b655bdb-b6ac-4b28-8be2-adf3bd407f42 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:20.746201 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b655bdb-b6ac-4b28-8be2-adf3bd407f42 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:20.751287 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8905238-e4ab-4828-a557-34d69155ec1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:20.752175 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8905238-e4ab-4828-a557-34d69155ec1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:20.752455 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8905238-e4ab-4828-a557-34d69155ec1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:20.752839 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8905238-e4ab-4828-a557-34d69155ec1c admin admin] PATH_INFO: `/v3/projects/715a80d3829e4dfc83e8456f3260156f/users/91cb5c3949d64416890ab935debf26df/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:20.768293 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8905238-e4ab-4828-a557-34d69155ec1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=715a80d3829e4dfc83e8456f3260156f, user_id=91cb5c3949d64416890ab935debf26df, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:20.771051 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8905238-e4ab-4828-a557-34d69155ec1c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:20.862944 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1241/2470] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:01:20 2022] PUT /identity/v3/projects/715a80d3829e4dfc83e8456f3260156f/users/91cb5c3949d64416890ab935debf26df/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:20.875158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995eb8d-2630-4da0-9ffb-be71f845ffe6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:20.875450 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995eb8d-2630-4da0-9ffb-be71f845ffe6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:20.875730 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995eb8d-2630-4da0-9ffb-be71f845ffe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:20.905347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a995eb8d-2630-4da0-9ffb-be71f845ffe6 None None] MFA Rules not processed for user `91cb5c3949d64416890ab935debf26df`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:20.906577 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a995eb8d-2630-4da0-9ffb-be71f845ffe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:20.972926 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1230/2471] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:20.977574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8905238-e4ab-4828-a557-34d69155ec1c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:21.035531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:21.046938 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8905238-e4ab-4828-a557-34d69155ec1c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:21.051761 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4f972-7f3b-4bff-99d7-b43715c37dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:21.065101 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4f972-7f3b-4bff-99d7-b43715c37dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:21.065101 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4f972-7f3b-4bff-99d7-b43715c37dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:21.065101 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4f972-7f3b-4bff-99d7-b43715c37dc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:21.065101 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4f972-7f3b-4bff-99d7-b43715c37dc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:21.065101 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4f972-7f3b-4bff-99d7-b43715c37dc2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:21.159517 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1242/2472] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:01:20 2022] POST /identity/v3/projects => generated 367 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:21.161045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995eb8d-2630-4da0-9ffb-be71f845ffe6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:21.171769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995eb8d-2630-4da0-9ffb-be71f845ffe6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:21.206991 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:21.233432 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b68e66-0b21-4e76-b146-3ff0eb24ef3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:21.234032 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b68e66-0b21-4e76-b146-3ff0eb24ef3f admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:21.234316 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b68e66-0b21-4e76-b146-3ff0eb24ef3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:21.234596 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b68e66-0b21-4e76-b146-3ff0eb24ef3f admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:21.235394 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b68e66-0b21-4e76-b146-3ff0eb24ef3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:21.237314 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b68e66-0b21-4e76-b146-3ff0eb24ef3f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:21.349736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1231/2473] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:01:21 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:21.352343 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4f972-7f3b-4bff-99d7-b43715c37dc2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:21.363295 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4f972-7f3b-4bff-99d7-b43715c37dc2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:21.367874 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c154c-4287-4b2c-9a47-3033da42896b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:21.368533 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c154c-4287-4b2c-9a47-3033da42896b admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:21.368821 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c154c-4287-4b2c-9a47-3033da42896b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:21.369105 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c154c-4287-4b2c-9a47-3033da42896b admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:21.369893 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c154c-4287-4b2c-9a47-3033da42896b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:21.372029 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c154c-4287-4b2c-9a47-3033da42896b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:21.384066 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1243/2474] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:01:21.388170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b68e66-0b21-4e76-b146-3ff0eb24ef3f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:21.398271 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b68e66-0b21-4e76-b146-3ff0eb24ef3f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:21.402874 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d8fa3-f781-4bb7-bbcc-7b0dfa0c2013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:21.403753 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d8fa3-f781-4bb7-bbcc-7b0dfa0c2013 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:21.404036 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d8fa3-f781-4bb7-bbcc-7b0dfa0c2013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:21.404383 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d8fa3-f781-4bb7-bbcc-7b0dfa0c2013 admin admin] PATH_INFO: `/v3/projects/3a313457d87e445c950b895a4240d3f8/users/771b2b31827d4f97967853798f971e34/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:21.419109 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d8fa3-f781-4bb7-bbcc-7b0dfa0c2013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a313457d87e445c950b895a4240d3f8, user_id=771b2b31827d4f97967853798f971e34, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:21.422290 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d8fa3-f781-4bb7-bbcc-7b0dfa0c2013 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:21.543211 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1232/2475] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:01:21 2022] PUT /identity/v3/projects/3a313457d87e445c950b895a4240d3f8/users/771b2b31827d4f97967853798f971e34/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:21.547762 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c154c-4287-4b2c-9a47-3033da42896b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:21.557946 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c154c-4287-4b2c-9a47-3033da42896b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:21.617117 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316cd6d-7765-492d-83c9-8c870085bc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:21.617809 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316cd6d-7765-492d-83c9-8c870085bc8f admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:21.618089 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316cd6d-7765-492d-83c9-8c870085bc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:21.618362 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316cd6d-7765-492d-83c9-8c870085bc8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:21.619075 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316cd6d-7765-492d-83c9-8c870085bc8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:21.620656 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316cd6d-7765-492d-83c9-8c870085bc8f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:21.630858 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1244/2476] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:01:21.635063 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d8fa3-f781-4bb7-bbcc-7b0dfa0c2013 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:21.646078 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d8fa3-f781-4bb7-bbcc-7b0dfa0c2013 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:21.651127 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cb7e2-cbaf-48d5-85da-f8e2b7876aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:21.652036 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cb7e2-cbaf-48d5-85da-f8e2b7876aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:21.652325 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cb7e2-cbaf-48d5-85da-f8e2b7876aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:21.652602 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cb7e2-cbaf-48d5-85da-f8e2b7876aaa admin admin] PATH_INFO: `/v3/projects/3a313457d87e445c950b895a4240d3f8/users/771b2b31827d4f97967853798f971e34/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:21.655191 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cb7e2-cbaf-48d5-85da-f8e2b7876aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a313457d87e445c950b895a4240d3f8, user_id=771b2b31827d4f97967853798f971e34, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:21.657896 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cb7e2-cbaf-48d5-85da-f8e2b7876aaa admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:21.668340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1233/2477] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:01:21 2022] PUT /identity/v3/projects/3a313457d87e445c950b895a4240d3f8/users/771b2b31827d4f97967853798f971e34/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:21.679242 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a018401-cc8f-414b-a20e-2aa7054660a6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:21.679532 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a018401-cc8f-414b-a20e-2aa7054660a6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:21.679817 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a018401-cc8f-414b-a20e-2aa7054660a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:21.710349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1a018401-cc8f-414b-a20e-2aa7054660a6 None None] MFA Rules not processed for user `771b2b31827d4f97967853798f971e34`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:21.711555 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1a018401-cc8f-414b-a20e-2aa7054660a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:21.780138 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1245/2478] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:21 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:21.791420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cb7e2-cbaf-48d5-85da-f8e2b7876aaa admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:21.793164 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-957cb7e2-cbaf-48d5-85da-f8e2b7876aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:21.856089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cb7e2-cbaf-48d5-85da-f8e2b7876aaa admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:21.860405 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159f527-a42a-4705-a7a5-f3113e8d89c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:21.861053 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159f527-a42a-4705-a7a5-f3113e8d89c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:21.861372 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159f527-a42a-4705-a7a5-f3113e8d89c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:21.861680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159f527-a42a-4705-a7a5-f3113e8d89c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:21.871121 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159f527-a42a-4705-a7a5-f3113e8d89c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:21.872550 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159f527-a42a-4705-a7a5-f3113e8d89c8 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:21.882063 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1234/2479] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:01:21 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:22.047853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a018401-cc8f-414b-a20e-2aa7054660a6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:22.049419 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1a018401-cc8f-414b-a20e-2aa7054660a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:22.061190 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a018401-cc8f-414b-a20e-2aa7054660a6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:22.064727 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84f8cc-ae53-4d8a-b935-2f809b9c05ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:22.065418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84f8cc-ae53-4d8a-b935-2f809b9c05ca service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:22.065703 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84f8cc-ae53-4d8a-b935-2f809b9c05ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:22.065980 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84f8cc-ae53-4d8a-b935-2f809b9c05ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:22.117010 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:22.123304 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da84f8cc-ae53-4d8a-b935-2f809b9c05ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:22.124816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da84f8cc-ae53-4d8a-b935-2f809b9c05ca service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:22.133818 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1246/2480] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:01:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:23.169034 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159f527-a42a-4705-a7a5-f3113e8d89c8 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:23.170573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6159f527-a42a-4705-a7a5-f3113e8d89c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:23.239838 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159f527-a42a-4705-a7a5-f3113e8d89c8 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:23.244802 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bf5dd-07ff-44d2-92da-7f5a0604be81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beeefb9b8d394407a5e7a32f5a00ffad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:23.245487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bf5dd-07ff-44d2-92da-7f5a0604be81 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:23.245839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bf5dd-07ff-44d2-92da-7f5a0604be81 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:23.246087 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bf5dd-07ff-44d2-92da-7f5a0604be81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:23.248093 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-102bf5dd-07ff-44d2-92da-7f5a0604be81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:23.261377 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102bf5dd-07ff-44d2-92da-7f5a0604be81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:23.263036 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102bf5dd-07ff-44d2-92da-7f5a0604be81 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:23.274264 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1235/2481] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:01:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:27.883272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84f8cc-ae53-4d8a-b935-2f809b9c05ca service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:27.951817 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84f8cc-ae53-4d8a-b935-2f809b9c05ca service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:27.957136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254630f-3a59-424e-99a5-b376e72fbca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:27.958044 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254630f-3a59-424e-99a5-b376e72fbca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:27.958325 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254630f-3a59-424e-99a5-b376e72fbca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:27.958598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254630f-3a59-424e-99a5-b376e72fbca7 admin admin] PATH_INFO: `/v3/users/91cb5c3949d64416890ab935debf26df` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:27.959799 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254630f-3a59-424e-99a5-b376e72fbca7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91cb5c3949d64416890ab935debf26df)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:27.961761 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254630f-3a59-424e-99a5-b376e72fbca7 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:28.154225 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9254630f-3a59-424e-99a5-b376e72fbca7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91cb5c3949d64416890ab935debf26df'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:28.154762 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9254630f-3a59-424e-99a5-b376e72fbca7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91cb5c3949d64416890ab935debf26df'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:28.161954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9254630f-3a59-424e-99a5-b376e72fbca7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91cb5c3949d64416890ab935debf26df'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:28.239546 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9254630f-3a59-424e-99a5-b376e72fbca7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91cb5c3949d64416890ab935debf26df'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:28.240264 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9254630f-3a59-424e-99a5-b376e72fbca7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91cb5c3949d64416890ab935debf26df'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:28.258831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1247/2482] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:01:27 2022] DELETE /identity/v3/users/91cb5c3949d64416890ab935debf26df => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:28.263469 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d0d94-bb14-499e-867c-653a71e17ef4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:28.264001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d0d94-bb14-499e-867c-653a71e17ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:28.264115 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d0d94-bb14-499e-867c-653a71e17ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:28.282242 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6e2d0d94-bb14-499e-867c-653a71e17ef4 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:28.283447 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6e2d0d94-bb14-499e-867c-653a71e17ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:28.297205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:28.349376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1236/2483] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:28.360203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254630f-3a59-424e-99a5-b376e72fbca7 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:28.365983 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9254630f-3a59-424e-99a5-b376e72fbca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:28.425480 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254630f-3a59-424e-99a5-b376e72fbca7 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:28.429058 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040134d9-08ca-432b-a4d9-8bf1c0464f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:28.429743 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040134d9-08ca-432b-a4d9-8bf1c0464f29 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:28.430030 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040134d9-08ca-432b-a4d9-8bf1c0464f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:28.430307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040134d9-08ca-432b-a4d9-8bf1c0464f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:28.442477 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040134d9-08ca-432b-a4d9-8bf1c0464f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:28.443154 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040134d9-08ca-432b-a4d9-8bf1c0464f29 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:28.454041 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1248/2484] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:28.978368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d0d94-bb14-499e-867c-653a71e17ef4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:28.979886 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6e2d0d94-bb14-499e-867c-653a71e17ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:28.992583 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d0d94-bb14-499e-867c-653a71e17ef4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:28.999163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dafcdf-23a9-4a47-8ea5-3c2464960da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:29.000264 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dafcdf-23a9-4a47-8ea5-3c2464960da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:29.000787 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dafcdf-23a9-4a47-8ea5-3c2464960da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:29.001294 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dafcdf-23a9-4a47-8ea5-3c2464960da3 admin admin] PATH_INFO: `/v3/projects/715a80d3829e4dfc83e8456f3260156f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:29.003354 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dafcdf-23a9-4a47-8ea5-3c2464960da3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=715a80d3829e4dfc83e8456f3260156f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:29.006214 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dafcdf-23a9-4a47-8ea5-3c2464960da3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:29.119653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-99dafcdf-23a9-4a47-8ea5-3c2464960da3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '715a80d3829e4dfc83e8456f3260156f', 'request_id': 'req-99dafcdf-23a9-4a47-8ea5-3c2464960da3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:29.125908 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-99dafcdf-23a9-4a47-8ea5-3c2464960da3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '715a80d3829e4dfc83e8456f3260156f', 'request_id': 'req-99dafcdf-23a9-4a47-8ea5-3c2464960da3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:29.132283 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-99dafcdf-23a9-4a47-8ea5-3c2464960da3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '715a80d3829e4dfc83e8456f3260156f', 'request_id': 'req-99dafcdf-23a9-4a47-8ea5-3c2464960da3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:29.262003 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-99dafcdf-23a9-4a47-8ea5-3c2464960da3 admin admin] The token cache is being invalidate because project 715a80d3829e4dfc83e8456f3260156f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:01:29.262294 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-99dafcdf-23a9-4a47-8ea5-3c2464960da3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:29.262926 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-99dafcdf-23a9-4a47-8ea5-3c2464960da3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:29.265317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1237/2485] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:01:28 2022] DELETE /identity/v3/projects/715a80d3829e4dfc83e8456f3260156f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:29.269612 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040134d9-08ca-432b-a4d9-8bf1c0464f29 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:29.280997 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040134d9-08ca-432b-a4d9-8bf1c0464f29 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:29.286845 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:29.339625 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642f5cb-e0d2-4e49-b1cb-e506b86bd09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:29.341139 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642f5cb-e0d2-4e49-b1cb-e506b86bd09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:29.341727 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642f5cb-e0d2-4e49-b1cb-e506b86bd09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:29.342223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642f5cb-e0d2-4e49-b1cb-e506b86bd09b admin admin] PATH_INFO: `/v3/users/771b2b31827d4f97967853798f971e34` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:29.344119 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642f5cb-e0d2-4e49-b1cb-e506b86bd09b admin admin] RBAC: Authorizing `identity:delete_user(user_id=771b2b31827d4f97967853798f971e34)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:29.347093 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642f5cb-e0d2-4e49-b1cb-e506b86bd09b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:29.594233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d642f5cb-e0d2-4e49-b1cb-e506b86bd09b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771b2b31827d4f97967853798f971e34'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:29.594890 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d642f5cb-e0d2-4e49-b1cb-e506b86bd09b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771b2b31827d4f97967853798f971e34'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:29.602851 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d642f5cb-e0d2-4e49-b1cb-e506b86bd09b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771b2b31827d4f97967853798f971e34'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:29.731128 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d642f5cb-e0d2-4e49-b1cb-e506b86bd09b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771b2b31827d4f97967853798f971e34'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:29.732017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d642f5cb-e0d2-4e49-b1cb-e506b86bd09b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771b2b31827d4f97967853798f971e34'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:29.753342 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1249/2486] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:01:29 2022] DELETE /identity/v3/users/771b2b31827d4f97967853798f971e34 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:30.280936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dafcdf-23a9-4a47-8ea5-3c2464960da3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:30.284023 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-99dafcdf-23a9-4a47-8ea5-3c2464960da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:30.298510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dafcdf-23a9-4a47-8ea5-3c2464960da3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:30.358969 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba905743-acf4-4951-9baf-06d0da212f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:30.359839 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba905743-acf4-4951-9baf-06d0da212f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:30.360115 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba905743-acf4-4951-9baf-06d0da212f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:30.360381 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba905743-acf4-4951-9baf-06d0da212f0c admin admin] PATH_INFO: `/v3/projects/3a313457d87e445c950b895a4240d3f8` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:30.361643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba905743-acf4-4951-9baf-06d0da212f0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a313457d87e445c950b895a4240d3f8)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:30.363569 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba905743-acf4-4951-9baf-06d0da212f0c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:30.495453 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:30.498357 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ba905743-acf4-4951-9baf-06d0da212f0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a313457d87e445c950b895a4240d3f8', 'request_id': 'req-ba905743-acf4-4951-9baf-06d0da212f0c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:30.503841 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ba905743-acf4-4951-9baf-06d0da212f0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a313457d87e445c950b895a4240d3f8', 'request_id': 'req-ba905743-acf4-4951-9baf-06d0da212f0c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:30.510334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ba905743-acf4-4951-9baf-06d0da212f0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a313457d87e445c950b895a4240d3f8', 'request_id': 'req-ba905743-acf4-4951-9baf-06d0da212f0c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:30.576689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ba905743-acf4-4951-9baf-06d0da212f0c admin admin] The token cache is being invalidate because project 3a313457d87e445c950b895a4240d3f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:01:30.576977 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ba905743-acf4-4951-9baf-06d0da212f0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:30.577658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ba905743-acf4-4951-9baf-06d0da212f0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:30.579369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1238/2487] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:01:30 2022] DELETE /identity/v3/projects/3a313457d87e445c950b895a4240d3f8 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:30.584785 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec843e-6a54-4826-b4c2-5f107c2046f9 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:30.585386 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec843e-6a54-4826-b4c2-5f107c2046f9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:30.585488 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec843e-6a54-4826-b4c2-5f107c2046f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:30.604515 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-54ec843e-6a54-4826-b4c2-5f107c2046f9 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:30.607087 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-54ec843e-6a54-4826-b4c2-5f107c2046f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:30.669176 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1250/2488] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:30.677911 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a231c5a-0000-4027-b84f-9f26c7230539 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:30.678201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a231c5a-0000-4027-b84f-9f26c7230539 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:30.678483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a231c5a-0000-4027-b84f-9f26c7230539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:30.698022 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7a231c5a-0000-4027-b84f-9f26c7230539 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:30.699259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7a231c5a-0000-4027-b84f-9f26c7230539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:30.707877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1239/2489] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:30.712153 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec843e-6a54-4826-b4c2-5f107c2046f9 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:30.722194 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec843e-6a54-4826-b4c2-5f107c2046f9 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:30.727076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9262415-81de-431a-9ec8-0803d62f940b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:30.727731 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9262415-81de-431a-9ec8-0803d62f940b admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:30.728024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9262415-81de-431a-9ec8-0803d62f940b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:30.728299 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9262415-81de-431a-9ec8-0803d62f940b admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:30.729025 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9262415-81de-431a-9ec8-0803d62f940b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:01:30.729371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9262415-81de-431a-9ec8-0803d62f940b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:30.730971 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9262415-81de-431a-9ec8-0803d62f940b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:30.742510 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1251/2490] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:01:30.746672 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a231c5a-0000-4027-b84f-9f26c7230539 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:30.756614 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a231c5a-0000-4027-b84f-9f26c7230539 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:30.761425 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05dfcb-b8f2-4b91-8a5a-f98c5b521dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:30.762082 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05dfcb-b8f2-4b91-8a5a-f98c5b521dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:30.762364 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05dfcb-b8f2-4b91-8a5a-f98c5b521dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:30.762637 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05dfcb-b8f2-4b91-8a5a-f98c5b521dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:30.763335 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05dfcb-b8f2-4b91-8a5a-f98c5b521dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:30.765925 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05dfcb-b8f2-4b91-8a5a-f98c5b521dc4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:30.863626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1240/2491] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:01:30 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:01:30.864934 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9262415-81de-431a-9ec8-0803d62f940b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:30.884096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9262415-81de-431a-9ec8-0803d62f940b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:30.888120 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:30.932461 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ff3a0-302f-464d-b56f-c86005b5c898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:30.933133 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ff3a0-302f-464d-b56f-c86005b5c898 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:30.933452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ff3a0-302f-464d-b56f-c86005b5c898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:30.933731 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ff3a0-302f-464d-b56f-c86005b5c898 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:30.934417 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ff3a0-302f-464d-b56f-c86005b5c898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:30.936881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ff3a0-302f-464d-b56f-c86005b5c898 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:31.045755 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1252/2492] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:01:30 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:31.050115 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05dfcb-b8f2-4b91-8a5a-f98c5b521dc4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:31.061288 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05dfcb-b8f2-4b91-8a5a-f98c5b521dc4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:31.065902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac375e-7851-4683-9cc7-100b02f61563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:31.066548 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac375e-7851-4683-9cc7-100b02f61563 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:31.066828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac375e-7851-4683-9cc7-100b02f61563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:31.067102 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac375e-7851-4683-9cc7-100b02f61563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:31.067825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac375e-7851-4683-9cc7-100b02f61563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:31.069462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac375e-7851-4683-9cc7-100b02f61563 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:31.080778 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1241/2493] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:01:31.084707 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ff3a0-302f-464d-b56f-c86005b5c898 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:31.096324 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ff3a0-302f-464d-b56f-c86005b5c898 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:31.101438 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571b8d0-83bf-413a-ae45-05c4ef441277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:31.102151 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571b8d0-83bf-413a-ae45-05c4ef441277 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:31.102434 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571b8d0-83bf-413a-ae45-05c4ef441277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:31.102751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571b8d0-83bf-413a-ae45-05c4ef441277 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:31.103475 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571b8d0-83bf-413a-ae45-05c4ef441277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:31.105209 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571b8d0-83bf-413a-ae45-05c4ef441277 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:31.118345 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1253/2494] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:01:31.122537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac375e-7851-4683-9cc7-100b02f61563 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:31.133458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac375e-7851-4683-9cc7-100b02f61563 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:31.138172 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c33279-bfe4-46e9-862a-23a65e71c6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:31.139104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c33279-bfe4-46e9-862a-23a65e71c6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:31.139386 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c33279-bfe4-46e9-862a-23a65e71c6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:31.139663 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c33279-bfe4-46e9-862a-23a65e71c6f5 admin admin] PATH_INFO: `/v3/projects/3dab975626f04300a991fde4599afd78/users/4720ca16750a4e00bca646388c21e736/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:31.154308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c33279-bfe4-46e9-862a-23a65e71c6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dab975626f04300a991fde4599afd78, user_id=4720ca16750a4e00bca646388c21e736, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:31.156974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c33279-bfe4-46e9-862a-23a65e71c6f5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:31.226367 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1242/2495] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:01:31 2022] PUT /identity/v3/projects/3dab975626f04300a991fde4599afd78/users/4720ca16750a4e00bca646388c21e736/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:31.237371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed06d70-c40d-483c-a08a-20c4f1cd43dc None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:31.237875 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed06d70-c40d-483c-a08a-20c4f1cd43dc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:31.238175 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed06d70-c40d-483c-a08a-20c4f1cd43dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:31.267426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4ed06d70-c40d-483c-a08a-20c4f1cd43dc None None] MFA Rules not processed for user `4720ca16750a4e00bca646388c21e736`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:31.268653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4ed06d70-c40d-483c-a08a-20c4f1cd43dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:31.336899 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1254/2496] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:31.341354 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c33279-bfe4-46e9-862a-23a65e71c6f5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:31.404009 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c33279-bfe4-46e9-862a-23a65e71c6f5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:31.409467 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20e4da-5b61-471c-817b-3f1cff4bc048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:31.410161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20e4da-5b61-471c-817b-3f1cff4bc048 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:31.410435 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20e4da-5b61-471c-817b-3f1cff4bc048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:31.410708 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20e4da-5b61-471c-817b-3f1cff4bc048 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:31.411403 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20e4da-5b61-471c-817b-3f1cff4bc048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:31.413442 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20e4da-5b61-471c-817b-3f1cff4bc048 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:31.480604 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1243/2497] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:01:31 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:31.485506 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed06d70-c40d-483c-a08a-20c4f1cd43dc None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:31.497240 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed06d70-c40d-483c-a08a-20c4f1cd43dc None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:31.555979 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb350df4-b83c-4f85-9f13-30497efd1ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:31.556712 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb350df4-b83c-4f85-9f13-30497efd1ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:31.556952 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb350df4-b83c-4f85-9f13-30497efd1ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:31.557226 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb350df4-b83c-4f85-9f13-30497efd1ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:31.558011 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb350df4-b83c-4f85-9f13-30497efd1ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:31.559949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb350df4-b83c-4f85-9f13-30497efd1ea1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:31.664272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1255/2498] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:01:31 2022] POST /identity/v3/users => generated 300 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:31.669225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20e4da-5b61-471c-817b-3f1cff4bc048 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:31.680660 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20e4da-5b61-471c-817b-3f1cff4bc048 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:31.685658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c502767-3216-4bb7-88c2-7955d4d327e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:31.686334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c502767-3216-4bb7-88c2-7955d4d327e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:31.686617 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c502767-3216-4bb7-88c2-7955d4d327e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:31.686894 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c502767-3216-4bb7-88c2-7955d4d327e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:31.687620 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c502767-3216-4bb7-88c2-7955d4d327e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:31.689228 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c502767-3216-4bb7-88c2-7955d4d327e9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:31.700239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1244/2499] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:01:31.704978 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb350df4-b83c-4f85-9f13-30497efd1ea1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:31.715134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb350df4-b83c-4f85-9f13-30497efd1ea1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:31.720416 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ca447-cd80-4f82-81a2-8bdd06a4de12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:31.721338 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ca447-cd80-4f82-81a2-8bdd06a4de12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:31.721628 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ca447-cd80-4f82-81a2-8bdd06a4de12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:31.721906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ca447-cd80-4f82-81a2-8bdd06a4de12 admin admin] PATH_INFO: `/v3/projects/962b80ea4da84602888dd9d2a348ec6f/users/899a1f5e6dc54477999e8d95e8761e9a/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:31.734751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:31.739193 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ca447-cd80-4f82-81a2-8bdd06a4de12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=962b80ea4da84602888dd9d2a348ec6f, user_id=899a1f5e6dc54477999e8d95e8761e9a, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:31.742237 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ca447-cd80-4f82-81a2-8bdd06a4de12 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:31.834280 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1256/2500] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:01:31 2022] PUT /identity/v3/projects/962b80ea4da84602888dd9d2a348ec6f/users/899a1f5e6dc54477999e8d95e8761e9a/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:31.839082 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c502767-3216-4bb7-88c2-7955d4d327e9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:31.851823 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c502767-3216-4bb7-88c2-7955d4d327e9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:31.895266 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:31.913120 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ee3f6-23e6-4b4e-97eb-b0c644b1197c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:31.914418 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ee3f6-23e6-4b4e-97eb-b0c644b1197c admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:31.914849 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ee3f6-23e6-4b4e-97eb-b0c644b1197c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:31.915312 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ee3f6-23e6-4b4e-97eb-b0c644b1197c admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:31.916539 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ee3f6-23e6-4b4e-97eb-b0c644b1197c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:31.919791 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ee3f6-23e6-4b4e-97eb-b0c644b1197c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:31.931625 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1245/2501] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:01:31.936066 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ca447-cd80-4f82-81a2-8bdd06a4de12 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:31.946731 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ca447-cd80-4f82-81a2-8bdd06a4de12 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:31.952249 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9172fb-3d56-45aa-87b0-c074a551a065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:31.953216 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9172fb-3d56-45aa-87b0-c074a551a065 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:31.953653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9172fb-3d56-45aa-87b0-c074a551a065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:31.953992 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9172fb-3d56-45aa-87b0-c074a551a065 admin admin] PATH_INFO: `/v3/projects/962b80ea4da84602888dd9d2a348ec6f/users/899a1f5e6dc54477999e8d95e8761e9a/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:31.956073 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9172fb-3d56-45aa-87b0-c074a551a065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=962b80ea4da84602888dd9d2a348ec6f, user_id=899a1f5e6dc54477999e8d95e8761e9a, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:31.959155 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9172fb-3d56-45aa-87b0-c074a551a065 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:31.972386 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1257/2502] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:01:31 2022] PUT /identity/v3/projects/962b80ea4da84602888dd9d2a348ec6f/users/899a1f5e6dc54477999e8d95e8761e9a/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:31.983160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82717ebf-c71d-4486-8d22-6f00675ed010 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:31.983507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82717ebf-c71d-4486-8d22-6f00675ed010 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:31.983779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82717ebf-c71d-4486-8d22-6f00675ed010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:32.014412 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-82717ebf-c71d-4486-8d22-6f00675ed010 None None] MFA Rules not processed for user `899a1f5e6dc54477999e8d95e8761e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:32.016080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-82717ebf-c71d-4486-8d22-6f00675ed010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:32.098886 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1246/2503] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:32.423261 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9172fb-3d56-45aa-87b0-c074a551a065 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:32.424949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ea9172fb-3d56-45aa-87b0-c074a551a065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:32.490103 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9172fb-3d56-45aa-87b0-c074a551a065 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:32.493716 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0bab0-2b2d-4758-adf7-44de91433513 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:32.494369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0bab0-2b2d-4758-adf7-44de91433513 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:32.494648 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0bab0-2b2d-4758-adf7-44de91433513 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:32.494937 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0bab0-2b2d-4758-adf7-44de91433513 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:32.505500 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0bab0-2b2d-4758-adf7-44de91433513 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:32.506966 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0bab0-2b2d-4758-adf7-44de91433513 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:32.516949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1258/2504] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:01:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:32.596624 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82717ebf-c71d-4486-8d22-6f00675ed010 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:32.664105 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82717ebf-c71d-4486-8d22-6f00675ed010 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:32.668834 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb94cdb-0758-4cad-9090-25dfbacd8934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:32.670224 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb94cdb-0758-4cad-9090-25dfbacd8934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:32.670512 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb94cdb-0758-4cad-9090-25dfbacd8934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:32.670787 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb94cdb-0758-4cad-9090-25dfbacd8934 admin admin] PATH_INFO: `/v3/users/4720ca16750a4e00bca646388c21e736` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:32.672036 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb94cdb-0758-4cad-9090-25dfbacd8934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4720ca16750a4e00bca646388c21e736)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:32.674020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb94cdb-0758-4cad-9090-25dfbacd8934 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:32.889423 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ffb94cdb-0758-4cad-9090-25dfbacd8934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4720ca16750a4e00bca646388c21e736'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:33.021956 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ffb94cdb-0758-4cad-9090-25dfbacd8934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4720ca16750a4e00bca646388c21e736'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:33.022636 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ffb94cdb-0758-4cad-9090-25dfbacd8934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4720ca16750a4e00bca646388c21e736'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:33.023295 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ffb94cdb-0758-4cad-9090-25dfbacd8934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4720ca16750a4e00bca646388c21e736'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:33.031264 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ffb94cdb-0758-4cad-9090-25dfbacd8934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4720ca16750a4e00bca646388c21e736'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:33.035763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:33.049194 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1247/2505] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:01:32 2022] DELETE /identity/v3/users/4720ca16750a4e00bca646388c21e736 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:33.053804 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57cc9f-3060-46fd-a341-9e44797e9886 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:33.054305 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57cc9f-3060-46fd-a341-9e44797e9886 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:33.054428 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57cc9f-3060-46fd-a341-9e44797e9886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:33.076330 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2c57cc9f-3060-46fd-a341-9e44797e9886 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:33.077560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2c57cc9f-3060-46fd-a341-9e44797e9886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:33.142298 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1259/2506] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:01:33.152343 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb94cdb-0758-4cad-9090-25dfbacd8934 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:33.154536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ffb94cdb-0758-4cad-9090-25dfbacd8934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:33.218530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb94cdb-0758-4cad-9090-25dfbacd8934 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:33.222222 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b9d80-f857-40f4-b9a8-90363e739974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:33.222862 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b9d80-f857-40f4-b9a8-90363e739974 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:33.223138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b9d80-f857-40f4-b9a8-90363e739974 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:33.223408 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b9d80-f857-40f4-b9a8-90363e739974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:33.233924 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b9d80-f857-40f4-b9a8-90363e739974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:33.235720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b9d80-f857-40f4-b9a8-90363e739974 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:33.246783 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1248/2507] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:33.738832 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57cc9f-3060-46fd-a341-9e44797e9886 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:33.740617 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2c57cc9f-3060-46fd-a341-9e44797e9886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:33.752552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57cc9f-3060-46fd-a341-9e44797e9886 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:33.757463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf929e-8791-4b54-955f-7ad5bde709d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:33.758336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf929e-8791-4b54-955f-7ad5bde709d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:33.758621 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf929e-8791-4b54-955f-7ad5bde709d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:33.758900 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf929e-8791-4b54-955f-7ad5bde709d3 admin admin] PATH_INFO: `/v3/projects/3dab975626f04300a991fde4599afd78` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:33.760089 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf929e-8791-4b54-955f-7ad5bde709d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dab975626f04300a991fde4599afd78)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:33.762044 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf929e-8791-4b54-955f-7ad5bde709d3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:33.927230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-65cf929e-8791-4b54-955f-7ad5bde709d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dab975626f04300a991fde4599afd78', 'request_id': 'req-65cf929e-8791-4b54-955f-7ad5bde709d3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:34.016353 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-65cf929e-8791-4b54-955f-7ad5bde709d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dab975626f04300a991fde4599afd78', 'request_id': 'req-65cf929e-8791-4b54-955f-7ad5bde709d3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:34.023571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-65cf929e-8791-4b54-955f-7ad5bde709d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dab975626f04300a991fde4599afd78', 'request_id': 'req-65cf929e-8791-4b54-955f-7ad5bde709d3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:34.034854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-65cf929e-8791-4b54-955f-7ad5bde709d3 admin admin] The token cache is being invalidate because project 3dab975626f04300a991fde4599afd78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:01:34.038118 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-65cf929e-8791-4b54-955f-7ad5bde709d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:34.038118 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-65cf929e-8791-4b54-955f-7ad5bde709d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:34.038118 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1260/2508] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:01:33 2022] DELETE /identity/v3/projects/3dab975626f04300a991fde4599afd78 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:34.041482 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b9d80-f857-40f4-b9a8-90363e739974 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:34.051941 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b9d80-f857-40f4-b9a8-90363e739974 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:34.113766 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa832b1e-9933-4d89-91c9-b971bc6f21b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:34.114641 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa832b1e-9933-4d89-91c9-b971bc6f21b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:34.114919 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa832b1e-9933-4d89-91c9-b971bc6f21b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:34.115194 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa832b1e-9933-4d89-91c9-b971bc6f21b1 admin admin] PATH_INFO: `/v3/users/899a1f5e6dc54477999e8d95e8761e9a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:34.116368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa832b1e-9933-4d89-91c9-b971bc6f21b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=899a1f5e6dc54477999e8d95e8761e9a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:34.118339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa832b1e-9933-4d89-91c9-b971bc6f21b1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:34.304785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fa832b1e-9933-4d89-91c9-b971bc6f21b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '899a1f5e6dc54477999e8d95e8761e9a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:34.370778 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fa832b1e-9933-4d89-91c9-b971bc6f21b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '899a1f5e6dc54477999e8d95e8761e9a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:34.371314 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fa832b1e-9933-4d89-91c9-b971bc6f21b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '899a1f5e6dc54477999e8d95e8761e9a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:34.371911 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fa832b1e-9933-4d89-91c9-b971bc6f21b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '899a1f5e6dc54477999e8d95e8761e9a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:34.379404 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fa832b1e-9933-4d89-91c9-b971bc6f21b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '899a1f5e6dc54477999e8d95e8761e9a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:34.396715 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1249/2509] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:01:34 2022] DELETE /identity/v3/users/899a1f5e6dc54477999e8d95e8761e9a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:01:34.938665 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf929e-8791-4b54-955f-7ad5bde709d3 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:34.940131 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-65cf929e-8791-4b54-955f-7ad5bde709d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:34.948370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:34.954863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf929e-8791-4b54-955f-7ad5bde709d3 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:35.014616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae3f48-e53a-4e23-9e13-bf35b027aa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:35.015501 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae3f48-e53a-4e23-9e13-bf35b027aa62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:35.015779 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae3f48-e53a-4e23-9e13-bf35b027aa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:35.016050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae3f48-e53a-4e23-9e13-bf35b027aa62 admin admin] PATH_INFO: `/v3/projects/962b80ea4da84602888dd9d2a348ec6f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:35.017229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae3f48-e53a-4e23-9e13-bf35b027aa62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=962b80ea4da84602888dd9d2a348ec6f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:35.019164 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae3f48-e53a-4e23-9e13-bf35b027aa62 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:35.178017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-caae3f48-e53a-4e23-9e13-bf35b027aa62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '962b80ea4da84602888dd9d2a348ec6f', 'request_id': 'req-caae3f48-e53a-4e23-9e13-bf35b027aa62'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:35.273427 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-caae3f48-e53a-4e23-9e13-bf35b027aa62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '962b80ea4da84602888dd9d2a348ec6f', 'request_id': 'req-caae3f48-e53a-4e23-9e13-bf35b027aa62'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:35.280362 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-caae3f48-e53a-4e23-9e13-bf35b027aa62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '962b80ea4da84602888dd9d2a348ec6f', 'request_id': 'req-caae3f48-e53a-4e23-9e13-bf35b027aa62'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:35.290828 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-caae3f48-e53a-4e23-9e13-bf35b027aa62 admin admin] The token cache is being invalidate because project 962b80ea4da84602888dd9d2a348ec6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:01:35.291111 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-caae3f48-e53a-4e23-9e13-bf35b027aa62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:35.291747 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-caae3f48-e53a-4e23-9e13-bf35b027aa62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:35.293312 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1261/2510] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:01:34 2022] DELETE /identity/v3/projects/962b80ea4da84602888dd9d2a348ec6f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:35.298206 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300eb14-5fa3-4ff2-8526-de304b3e6355 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:35.298774 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300eb14-5fa3-4ff2-8526-de304b3e6355 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:35.298774 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300eb14-5fa3-4ff2-8526-de304b3e6355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:35.311675 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:35.317472 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a300eb14-5fa3-4ff2-8526-de304b3e6355 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:35.318692 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a300eb14-5fa3-4ff2-8526-de304b3e6355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:35.377832 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1250/2511] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:35.386958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47623a28-bd31-46ac-b8f5-301d79cfdc69 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:35.387245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47623a28-bd31-46ac-b8f5-301d79cfdc69 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:35.387522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47623a28-bd31-46ac-b8f5-301d79cfdc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:35.407042 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-47623a28-bd31-46ac-b8f5-301d79cfdc69 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:35.408256 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-47623a28-bd31-46ac-b8f5-301d79cfdc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:35.416307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1262/2512] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:35.420725 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300eb14-5fa3-4ff2-8526-de304b3e6355 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:35.430830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300eb14-5fa3-4ff2-8526-de304b3e6355 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:35.435371 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fa771-3fc7-4e0e-8e67-7be8cf2f1c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:35.436622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fa771-3fc7-4e0e-8e67-7be8cf2f1c35 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:35.436911 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fa771-3fc7-4e0e-8e67-7be8cf2f1c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:35.437190 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fa771-3fc7-4e0e-8e67-7be8cf2f1c35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:35.437972 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fa771-3fc7-4e0e-8e67-7be8cf2f1c35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:01:35.438278 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fa771-3fc7-4e0e-8e67-7be8cf2f1c35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:35.439896 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fa771-3fc7-4e0e-8e67-7be8cf2f1c35 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:35.452912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1251/2513] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:01:35.457545 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47623a28-bd31-46ac-b8f5-301d79cfdc69 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:35.467184 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47623a28-bd31-46ac-b8f5-301d79cfdc69 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:35.472203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c2ddd-1df8-4894-bdda-dcb77efd3830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:35.472873 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c2ddd-1df8-4894-bdda-dcb77efd3830 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:35.473159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c2ddd-1df8-4894-bdda-dcb77efd3830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:35.473472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c2ddd-1df8-4894-bdda-dcb77efd3830 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:35.474185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c2ddd-1df8-4894-bdda-dcb77efd3830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:35.476361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c2ddd-1df8-4894-bdda-dcb77efd3830 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:35.555632 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1263/2514] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:01:35 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:35.559224 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fa771-3fc7-4e0e-8e67-7be8cf2f1c35 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:35.570277 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fa771-3fc7-4e0e-8e67-7be8cf2f1c35 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:35.627988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687db19-e4ce-4d1d-a2d7-2f1b4c6c8745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:35.628669 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687db19-e4ce-4d1d-a2d7-2f1b4c6c8745 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:35.628957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687db19-e4ce-4d1d-a2d7-2f1b4c6c8745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:35.629384 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687db19-e4ce-4d1d-a2d7-2f1b4c6c8745 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:35.630089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687db19-e4ce-4d1d-a2d7-2f1b4c6c8745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:35.632007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687db19-e4ce-4d1d-a2d7-2f1b4c6c8745 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:35.752226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1252/2515] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:01:35 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:35.753926 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c2ddd-1df8-4894-bdda-dcb77efd3830 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:35.765247 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c2ddd-1df8-4894-bdda-dcb77efd3830 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:35.770029 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266531d-8723-4ab1-8437-c0850d50b4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:35.770695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266531d-8723-4ab1-8437-c0850d50b4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:35.770976 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266531d-8723-4ab1-8437-c0850d50b4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:35.771243 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266531d-8723-4ab1-8437-c0850d50b4d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:35.771978 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266531d-8723-4ab1-8437-c0850d50b4d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:35.773616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266531d-8723-4ab1-8437-c0850d50b4d4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:35.786499 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1264/2516] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:01:35.790709 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687db19-e4ce-4d1d-a2d7-2f1b4c6c8745 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:35.801646 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687db19-e4ce-4d1d-a2d7-2f1b4c6c8745 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:35.806412 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec9679-731c-42a2-a106-59c5288f11c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:35.807074 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec9679-731c-42a2-a106-59c5288f11c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:35.807393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec9679-731c-42a2-a106-59c5288f11c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:35.807648 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec9679-731c-42a2-a106-59c5288f11c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:35.808363 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec9679-731c-42a2-a106-59c5288f11c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:35.810007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec9679-731c-42a2-a106-59c5288f11c2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:35.820999 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1253/2517] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:01:35.825196 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266531d-8723-4ab1-8437-c0850d50b4d4 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:35.835462 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266531d-8723-4ab1-8437-c0850d50b4d4 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:35.840043 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f423b5f-eafb-4e03-ac78-7af54e67844b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:35.840915 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f423b5f-eafb-4e03-ac78-7af54e67844b admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:35.841197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f423b5f-eafb-4e03-ac78-7af54e67844b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:35.841654 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f423b5f-eafb-4e03-ac78-7af54e67844b admin admin] PATH_INFO: `/v3/projects/2d85b1d7d7b74876a05dc3c068b59ac6/users/955096a222bb4dffb98ae521584afa3a/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:35.857499 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f423b5f-eafb-4e03-ac78-7af54e67844b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d85b1d7d7b74876a05dc3c068b59ac6, user_id=955096a222bb4dffb98ae521584afa3a, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:35.860763 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f423b5f-eafb-4e03-ac78-7af54e67844b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:35.965781 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1265/2518] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:01:35 2022] PUT /identity/v3/projects/2d85b1d7d7b74876a05dc3c068b59ac6/users/955096a222bb4dffb98ae521584afa3a/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:35.976872 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cddb0a-e371-427b-a7d8-56cbbf4da849 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:35.977091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cddb0a-e371-427b-a7d8-56cbbf4da849 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:35.977409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cddb0a-e371-427b-a7d8-56cbbf4da849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:36.004509 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-95cddb0a-e371-427b-a7d8-56cbbf4da849 None None] MFA Rules not processed for user `955096a222bb4dffb98ae521584afa3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:36.005755 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-95cddb0a-e371-427b-a7d8-56cbbf4da849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:36.071579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1254/2519] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:36.075900 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f423b5f-eafb-4e03-ac78-7af54e67844b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:36.107121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:36.138539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f423b5f-eafb-4e03-ac78-7af54e67844b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:36.143721 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da8aeb-6884-4fb5-b070-dae469d55c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:36.144404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da8aeb-6884-4fb5-b070-dae469d55c40 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:36.144682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da8aeb-6884-4fb5-b070-dae469d55c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:36.144954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da8aeb-6884-4fb5-b070-dae469d55c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:36.145682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da8aeb-6884-4fb5-b070-dae469d55c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:36.147560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da8aeb-6884-4fb5-b070-dae469d55c40 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:36.263729 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1266/2520] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:01:36 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:36.268382 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cddb0a-e371-427b-a7d8-56cbbf4da849 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:36.275444 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:36.280431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cddb0a-e371-427b-a7d8-56cbbf4da849 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:36.335245 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5744159-cad0-436b-a245-fac9dafec900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:36.335918 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5744159-cad0-436b-a245-fac9dafec900 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:36.336192 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5744159-cad0-436b-a245-fac9dafec900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:36.336470 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5744159-cad0-436b-a245-fac9dafec900 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:36.337151 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5744159-cad0-436b-a245-fac9dafec900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:36.339247 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5744159-cad0-436b-a245-fac9dafec900 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:36.497774 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1255/2521] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:01:36 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:36.502102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da8aeb-6884-4fb5-b070-dae469d55c40 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:36.512441 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da8aeb-6884-4fb5-b070-dae469d55c40 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:36.517627 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456ee7a-ee78-42c0-a8bc-c78d9bdd4e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:36.518362 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456ee7a-ee78-42c0-a8bc-c78d9bdd4e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:36.518647 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456ee7a-ee78-42c0-a8bc-c78d9bdd4e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:36.518924 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456ee7a-ee78-42c0-a8bc-c78d9bdd4e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:36.519646 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456ee7a-ee78-42c0-a8bc-c78d9bdd4e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:36.521244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456ee7a-ee78-42c0-a8bc-c78d9bdd4e2f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:36.532757 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1267/2522] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:01:36.536688 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5744159-cad0-436b-a245-fac9dafec900 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:36.546771 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5744159-cad0-436b-a245-fac9dafec900 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:36.551836 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259194d-1116-4670-b746-bce2129822d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:36.551975 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259194d-1116-4670-b746-bce2129822d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:36.552225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259194d-1116-4670-b746-bce2129822d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:36.552504 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259194d-1116-4670-b746-bce2129822d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:36.553224 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259194d-1116-4670-b746-bce2129822d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:36.554895 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259194d-1116-4670-b746-bce2129822d1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:36.564956 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1256/2523] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:01:36.569081 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456ee7a-ee78-42c0-a8bc-c78d9bdd4e2f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:36.580424 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456ee7a-ee78-42c0-a8bc-c78d9bdd4e2f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:36.584836 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d55780-ab74-44d7-af50-05440281c036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:36.585754 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d55780-ab74-44d7-af50-05440281c036 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:36.586034 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d55780-ab74-44d7-af50-05440281c036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:36.586305 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d55780-ab74-44d7-af50-05440281c036 admin admin] PATH_INFO: `/v3/projects/da03309584d74d9c9487a4351df47d2c/users/9300e15aeb274a2fa98ef7bedbb76bdc/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:36.602376 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d55780-ab74-44d7-af50-05440281c036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da03309584d74d9c9487a4351df47d2c, user_id=9300e15aeb274a2fa98ef7bedbb76bdc, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:36.605056 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d55780-ab74-44d7-af50-05440281c036 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:36.706296 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1268/2524] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:01:36 2022] PUT /identity/v3/projects/da03309584d74d9c9487a4351df47d2c/users/9300e15aeb274a2fa98ef7bedbb76bdc/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:36.717319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d18fbe-2d0b-4410-86ac-15344fab87d4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:36.717620 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d18fbe-2d0b-4410-86ac-15344fab87d4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:36.717939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d18fbe-2d0b-4410-86ac-15344fab87d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:36.745188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-88d18fbe-2d0b-4410-86ac-15344fab87d4 None None] MFA Rules not processed for user `9300e15aeb274a2fa98ef7bedbb76bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:36.746421 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-88d18fbe-2d0b-4410-86ac-15344fab87d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:36.812425 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1257/2525] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:36.816893 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d55780-ab74-44d7-af50-05440281c036 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:36.884447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d55780-ab74-44d7-af50-05440281c036 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:36.890507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cc29c-512a-4ca1-8fba-62a61b4e8d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:36.891323 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cc29c-512a-4ca1-8fba-62a61b4e8d0d admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:36.891608 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cc29c-512a-4ca1-8fba-62a61b4e8d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:36.891916 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cc29c-512a-4ca1-8fba-62a61b4e8d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:36.892609 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cc29c-512a-4ca1-8fba-62a61b4e8d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:36.894555 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cc29c-512a-4ca1-8fba-62a61b4e8d0d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:37.015616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1269/2526] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:01:36 2022] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:37.017313 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d18fbe-2d0b-4410-86ac-15344fab87d4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:37.029095 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d18fbe-2d0b-4410-86ac-15344fab87d4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:37.114808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644abc44-ced9-4931-8b0b-1c6b5151155d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:37.115392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644abc44-ced9-4931-8b0b-1c6b5151155d admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:37.115681 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644abc44-ced9-4931-8b0b-1c6b5151155d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:37.115958 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644abc44-ced9-4931-8b0b-1c6b5151155d admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:37.116656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644abc44-ced9-4931-8b0b-1c6b5151155d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:37.118671 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644abc44-ced9-4931-8b0b-1c6b5151155d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:37.200681 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:37.208761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1258/2527] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:01:37 2022] POST /identity/v3/users => generated 296 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:37.210064 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cc29c-512a-4ca1-8fba-62a61b4e8d0d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:37.222003 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cc29c-512a-4ca1-8fba-62a61b4e8d0d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:37.226799 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394242a7-7492-456b-9337-2db019a0a196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:37.227456 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394242a7-7492-456b-9337-2db019a0a196 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:37.227736 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394242a7-7492-456b-9337-2db019a0a196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:37.228677 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394242a7-7492-456b-9337-2db019a0a196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:37.229458 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394242a7-7492-456b-9337-2db019a0a196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:37.232249 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394242a7-7492-456b-9337-2db019a0a196 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:37.242135 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1270/2528] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:01:37.246432 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644abc44-ced9-4931-8b0b-1c6b5151155d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:37.258299 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644abc44-ced9-4931-8b0b-1c6b5151155d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:37.262978 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f13730-dd9a-4418-9596-755d9f7ea1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:37.263857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f13730-dd9a-4418-9596-755d9f7ea1bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:37.264144 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f13730-dd9a-4418-9596-755d9f7ea1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:37.264420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f13730-dd9a-4418-9596-755d9f7ea1bc admin admin] PATH_INFO: `/v3/projects/cd68dfebb9144f7ea13a06b20bc7f8ec/users/9062826223314aa8a30d17f9a66d56b8/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:37.280592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f13730-dd9a-4418-9596-755d9f7ea1bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd68dfebb9144f7ea13a06b20bc7f8ec, user_id=9062826223314aa8a30d17f9a66d56b8, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:37.286285 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f13730-dd9a-4418-9596-755d9f7ea1bc admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:37.365793 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1259/2529] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:01:37 2022] PUT /identity/v3/projects/cd68dfebb9144f7ea13a06b20bc7f8ec/users/9062826223314aa8a30d17f9a66d56b8/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:37.369698 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394242a7-7492-456b-9337-2db019a0a196 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:37.379974 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394242a7-7492-456b-9337-2db019a0a196 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:37.428025 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:37.436774 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcf71c-7a5d-4d00-aa49-4ecffae23f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:37.437523 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcf71c-7a5d-4d00-aa49-4ecffae23f3f admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:37.437809 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcf71c-7a5d-4d00-aa49-4ecffae23f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:37.438086 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcf71c-7a5d-4d00-aa49-4ecffae23f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:37.438802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcf71c-7a5d-4d00-aa49-4ecffae23f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:37.440399 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcf71c-7a5d-4d00-aa49-4ecffae23f3f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:37.450882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1271/2530] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:01:37.455354 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f13730-dd9a-4418-9596-755d9f7ea1bc admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:37.465723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f13730-dd9a-4418-9596-755d9f7ea1bc admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:37.472115 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29482573-fa3f-45c6-8b49-d725b47b6424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:37.472999 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29482573-fa3f-45c6-8b49-d725b47b6424 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:37.473314 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29482573-fa3f-45c6-8b49-d725b47b6424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:37.473615 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29482573-fa3f-45c6-8b49-d725b47b6424 admin admin] PATH_INFO: `/v3/projects/cd68dfebb9144f7ea13a06b20bc7f8ec/users/9062826223314aa8a30d17f9a66d56b8/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:37.475872 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29482573-fa3f-45c6-8b49-d725b47b6424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd68dfebb9144f7ea13a06b20bc7f8ec, user_id=9062826223314aa8a30d17f9a66d56b8, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:37.478593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29482573-fa3f-45c6-8b49-d725b47b6424 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:37.489662 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1260/2531] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:01:37 2022] PUT /identity/v3/projects/cd68dfebb9144f7ea13a06b20bc7f8ec/users/9062826223314aa8a30d17f9a66d56b8/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:37.500614 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c7529-f121-4084-b65c-e5ebf7a88e75 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:37.500903 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c7529-f121-4084-b65c-e5ebf7a88e75 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:37.501184 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c7529-f121-4084-b65c-e5ebf7a88e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:37.527559 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1f1c7529-f121-4084-b65c-e5ebf7a88e75 None None] MFA Rules not processed for user `9062826223314aa8a30d17f9a66d56b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:37.528917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1f1c7529-f121-4084-b65c-e5ebf7a88e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:37.602854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1272/2532] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:37.615153 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29482573-fa3f-45c6-8b49-d725b47b6424 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:37.616908 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-29482573-fa3f-45c6-8b49-d725b47b6424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:37.675674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29482573-fa3f-45c6-8b49-d725b47b6424 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:37.679493 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642cc13-f4d2-4c37-b72c-4c9ee40343f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:37.680157 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642cc13-f4d2-4c37-b72c-4c9ee40343f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:37.680436 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642cc13-f4d2-4c37-b72c-4c9ee40343f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:37.680708 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642cc13-f4d2-4c37-b72c-4c9ee40343f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:37.690426 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642cc13-f4d2-4c37-b72c-4c9ee40343f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:37.691905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642cc13-f4d2-4c37-b72c-4c9ee40343f8 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:37.702580 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1261/2533] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:01:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:37.804165 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c7529-f121-4084-b65c-e5ebf7a88e75 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:37.805366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1f1c7529-f121-4084-b65c-e5ebf7a88e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:37.817239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c7529-f121-4084-b65c-e5ebf7a88e75 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:37.820831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844a558-8161-465c-9c6e-72eaf41695f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:37.821498 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844a558-8161-465c-9c6e-72eaf41695f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:37.821779 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844a558-8161-465c-9c6e-72eaf41695f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:37.822053 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844a558-8161-465c-9c6e-72eaf41695f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:37.882557 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844a558-8161-465c-9c6e-72eaf41695f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:37.883929 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844a558-8161-465c-9c6e-72eaf41695f0 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:37.893213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1273/2534] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:01:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:46.584624 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642cc13-f4d2-4c37-b72c-4c9ee40343f8 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:46.661543 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642cc13-f4d2-4c37-b72c-4c9ee40343f8 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:46.666668 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5ed66-fef0-4e9b-bcdf-6cb29067db21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:46.667540 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5ed66-fef0-4e9b-bcdf-6cb29067db21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:46.667821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5ed66-fef0-4e9b-bcdf-6cb29067db21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:46.668099 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5ed66-fef0-4e9b-bcdf-6cb29067db21 admin admin] PATH_INFO: `/v3/users/955096a222bb4dffb98ae521584afa3a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:46.669349 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5ed66-fef0-4e9b-bcdf-6cb29067db21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=955096a222bb4dffb98ae521584afa3a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:46.672250 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5ed66-fef0-4e9b-bcdf-6cb29067db21 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:46.882860 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6da5ed66-fef0-4e9b-bcdf-6cb29067db21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '955096a222bb4dffb98ae521584afa3a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:46.988079 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6da5ed66-fef0-4e9b-bcdf-6cb29067db21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '955096a222bb4dffb98ae521584afa3a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:46.988702 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6da5ed66-fef0-4e9b-bcdf-6cb29067db21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '955096a222bb4dffb98ae521584afa3a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:46.989360 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6da5ed66-fef0-4e9b-bcdf-6cb29067db21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '955096a222bb4dffb98ae521584afa3a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:46.997683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6da5ed66-fef0-4e9b-bcdf-6cb29067db21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '955096a222bb4dffb98ae521584afa3a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:47.003242 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:47.019685 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1262/2535] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:01:46 2022] DELETE /identity/v3/users/955096a222bb4dffb98ae521584afa3a => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:47.027050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5280d8-fa43-4c45-b1f0-ad1941742589 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:47.027562 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5280d8-fa43-4c45-b1f0-ad1941742589 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:47.027663 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5280d8-fa43-4c45-b1f0-ad1941742589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:47.047003 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6e5280d8-fa43-4c45-b1f0-ad1941742589 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:47.048367 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6e5280d8-fa43-4c45-b1f0-ad1941742589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:47.141099 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1274/2536] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:47.150833 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5ed66-fef0-4e9b-bcdf-6cb29067db21 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:47.152281 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6da5ed66-fef0-4e9b-bcdf-6cb29067db21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:47.211706 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5ed66-fef0-4e9b-bcdf-6cb29067db21 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:47.215388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86904cf8-1802-4833-807e-6fb7be4a98d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:47.216047 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86904cf8-1802-4833-807e-6fb7be4a98d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:47.216331 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86904cf8-1802-4833-807e-6fb7be4a98d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:47.216654 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86904cf8-1802-4833-807e-6fb7be4a98d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:47.227833 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86904cf8-1802-4833-807e-6fb7be4a98d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:47.229296 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86904cf8-1802-4833-807e-6fb7be4a98d6 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:47.239511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1263/2537] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:01:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:47.682364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5280d8-fa43-4c45-b1f0-ad1941742589 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:47.685174 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6e5280d8-fa43-4c45-b1f0-ad1941742589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:47.701892 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5280d8-fa43-4c45-b1f0-ad1941742589 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:47.707345 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02c247-3104-4659-afb6-322735a5df5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:47.708352 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02c247-3104-4659-afb6-322735a5df5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:47.708640 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02c247-3104-4659-afb6-322735a5df5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:47.708969 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02c247-3104-4659-afb6-322735a5df5f admin admin] PATH_INFO: `/v3/projects/2d85b1d7d7b74876a05dc3c068b59ac6` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:47.710283 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02c247-3104-4659-afb6-322735a5df5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d85b1d7d7b74876a05dc3c068b59ac6)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:47.712259 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02c247-3104-4659-afb6-322735a5df5f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:47.726544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:47.914945 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cd02c247-3104-4659-afb6-322735a5df5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d85b1d7d7b74876a05dc3c068b59ac6', 'request_id': 'req-cd02c247-3104-4659-afb6-322735a5df5f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:48.050219 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cd02c247-3104-4659-afb6-322735a5df5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d85b1d7d7b74876a05dc3c068b59ac6', 'request_id': 'req-cd02c247-3104-4659-afb6-322735a5df5f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:48.057252 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cd02c247-3104-4659-afb6-322735a5df5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d85b1d7d7b74876a05dc3c068b59ac6', 'request_id': 'req-cd02c247-3104-4659-afb6-322735a5df5f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:48.067898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cd02c247-3104-4659-afb6-322735a5df5f admin admin] The token cache is being invalidate because project 2d85b1d7d7b74876a05dc3c068b59ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:01:48.068188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cd02c247-3104-4659-afb6-322735a5df5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:48.068848 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cd02c247-3104-4659-afb6-322735a5df5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:48.070437 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1275/2538] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:01:47 2022] DELETE /identity/v3/projects/2d85b1d7d7b74876a05dc3c068b59ac6 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:48.078745 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86904cf8-1802-4833-807e-6fb7be4a98d6 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:48.088733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86904cf8-1802-4833-807e-6fb7be4a98d6 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:48.148247 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286814d5-8e45-469f-ba87-b9afeab83a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:48.149139 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286814d5-8e45-469f-ba87-b9afeab83a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:48.149478 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286814d5-8e45-469f-ba87-b9afeab83a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:48.149758 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286814d5-8e45-469f-ba87-b9afeab83a33 admin admin] PATH_INFO: `/v3/users/9300e15aeb274a2fa98ef7bedbb76bdc` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:48.150987 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286814d5-8e45-469f-ba87-b9afeab83a33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9300e15aeb274a2fa98ef7bedbb76bdc)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:48.152949 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286814d5-8e45-469f-ba87-b9afeab83a33 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:48.329410 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd30da-69f1-49c3-8f28-89e0e16987b8 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:48.331866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd30da-69f1-49c3-8f28-89e0e16987b8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:48.331866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd30da-69f1-49c3-8f28-89e0e16987b8 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:48.331866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1276/2539] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 17:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:01:48.339007 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361f3e4-d738-4e24-887a-37ed62c5f918 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:48.339315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361f3e4-d738-4e24-887a-37ed62c5f918 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:48.339595 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361f3e4-d738-4e24-887a-37ed62c5f918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:48.365358 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c361f3e4-d738-4e24-887a-37ed62c5f918 None None] MFA Rules not processed for user `d577b5295f9e4a4388bb6293d1c33d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:48.366650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c361f3e4-d738-4e24-887a-37ed62c5f918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:48.383300 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-286814d5-8e45-469f-ba87-b9afeab83a33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9300e15aeb274a2fa98ef7bedbb76bdc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:48.431085 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1277/2540] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 17:01:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:48.443816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361f3e4-d738-4e24-887a-37ed62c5f918 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:48.445964 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c361f3e4-d738-4e24-887a-37ed62c5f918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:48.462887 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361f3e4-d738-4e24-887a-37ed62c5f918 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:48.466512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36da7d-f486-4c32-a221-5423cd83d7c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:48.467722 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36da7d-f486-4c32-a221-5423cd83d7c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:48.468011 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36da7d-f486-4c32-a221-5423cd83d7c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:48.468300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36da7d-f486-4c32-a221-5423cd83d7c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:48.475974 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36da7d-f486-4c32-a221-5423cd83d7c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:48.477430 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36da7d-f486-4c32-a221-5423cd83d7c5 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:48.485236 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1278/2541] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:01:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:48.507707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-286814d5-8e45-469f-ba87-b9afeab83a33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9300e15aeb274a2fa98ef7bedbb76bdc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:48.508449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-286814d5-8e45-469f-ba87-b9afeab83a33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9300e15aeb274a2fa98ef7bedbb76bdc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:48.509187 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-286814d5-8e45-469f-ba87-b9afeab83a33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9300e15aeb274a2fa98ef7bedbb76bdc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:48.520788 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-286814d5-8e45-469f-ba87-b9afeab83a33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9300e15aeb274a2fa98ef7bedbb76bdc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:48.544742 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1264/2542] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:01:48 2022] DELETE /identity/v3/users/9300e15aeb274a2fa98ef7bedbb76bdc => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:48.577881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a181f-5825-4edd-a054-a369b23e931d None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:48.578252 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a181f-5825-4edd-a054-a369b23e931d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:48.578531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a181f-5825-4edd-a054-a369b23e931d None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:48.579944 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1279/2543] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 17:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 17:01:48.586227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2143b4-8798-4078-ab00-20d99a74302c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:48.586533 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2143b4-8798-4078-ab00-20d99a74302c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:48.586968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2143b4-8798-4078-ab00-20d99a74302c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:48.605906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:48.612365 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3e2143b4-8798-4078-ab00-20d99a74302c None None] MFA Rules not processed for user `35c9fa9c29494ff9b1f749974dca2719`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:48.620795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3e2143b4-8798-4078-ab00-20d99a74302c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:48.715930 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1265/2544] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 17:01:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:48.727294 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a181f-5825-4edd-a054-a369b23e931d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:48.729069 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-595a181f-5825-4edd-a054-a369b23e931d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:48.801660 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a181f-5825-4edd-a054-a369b23e931d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:48.805479 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624bbf9-eb3c-4046-bb01-f8c596d90e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:48.806230 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624bbf9-eb3c-4046-bb01-f8c596d90e19 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:48.806578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624bbf9-eb3c-4046-bb01-f8c596d90e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:48.806917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624bbf9-eb3c-4046-bb01-f8c596d90e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:48.822697 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624bbf9-eb3c-4046-bb01-f8c596d90e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:48.824256 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624bbf9-eb3c-4046-bb01-f8c596d90e19 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:48.836653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1280/2545] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:01:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:49.062727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2143b4-8798-4078-ab00-20d99a74302c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:49.064378 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3e2143b4-8798-4078-ab00-20d99a74302c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:49.174133 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2143b4-8798-4078-ab00-20d99a74302c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:49.180258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848f716-af42-4825-834a-01661ab76ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:49.180258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848f716-af42-4825-834a-01661ab76ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:49.180258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848f716-af42-4825-834a-01661ab76ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:49.180258 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848f716-af42-4825-834a-01661ab76ccf admin admin] PATH_INFO: `/v3/projects/da03309584d74d9c9487a4351df47d2c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:49.181427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848f716-af42-4825-834a-01661ab76ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=da03309584d74d9c9487a4351df47d2c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:49.183361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848f716-af42-4825-834a-01661ab76ccf admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:49.305146 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0848f716-af42-4825-834a-01661ab76ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da03309584d74d9c9487a4351df47d2c', 'request_id': 'req-0848f716-af42-4825-834a-01661ab76ccf'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:49.313342 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0848f716-af42-4825-834a-01661ab76ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da03309584d74d9c9487a4351df47d2c', 'request_id': 'req-0848f716-af42-4825-834a-01661ab76ccf'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:49.319521 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0848f716-af42-4825-834a-01661ab76ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da03309584d74d9c9487a4351df47d2c', 'request_id': 'req-0848f716-af42-4825-834a-01661ab76ccf'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:49.411088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0848f716-af42-4825-834a-01661ab76ccf admin admin] The token cache is being invalidate because project da03309584d74d9c9487a4351df47d2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:01:49.411364 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0848f716-af42-4825-834a-01661ab76ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:49.412137 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0848f716-af42-4825-834a-01661ab76ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:49.413737 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1266/2546] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:01:49 2022] DELETE /identity/v3/projects/da03309584d74d9c9487a4351df47d2c => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:01:49.417881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624bbf9-eb3c-4046-bb01-f8c596d90e19 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:49.429349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624bbf9-eb3c-4046-bb01-f8c596d90e19 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:49.462413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:49.495529 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b907d1-dbe6-4ea2-b3e9-20ba51b3ba38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:49.496517 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b907d1-dbe6-4ea2-b3e9-20ba51b3ba38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:49.496884 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b907d1-dbe6-4ea2-b3e9-20ba51b3ba38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:49.497234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b907d1-dbe6-4ea2-b3e9-20ba51b3ba38 admin admin] PATH_INFO: `/v3/users/9062826223314aa8a30d17f9a66d56b8` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:49.498676 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b907d1-dbe6-4ea2-b3e9-20ba51b3ba38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9062826223314aa8a30d17f9a66d56b8)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:49.500679 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b907d1-dbe6-4ea2-b3e9-20ba51b3ba38 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:49.807672 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-74b907d1-dbe6-4ea2-b3e9-20ba51b3ba38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9062826223314aa8a30d17f9a66d56b8'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:49.808424 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-74b907d1-dbe6-4ea2-b3e9-20ba51b3ba38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9062826223314aa8a30d17f9a66d56b8'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:49.816133 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-74b907d1-dbe6-4ea2-b3e9-20ba51b3ba38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9062826223314aa8a30d17f9a66d56b8'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:49.924862 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-74b907d1-dbe6-4ea2-b3e9-20ba51b3ba38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9062826223314aa8a30d17f9a66d56b8'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:49.925513 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-74b907d1-dbe6-4ea2-b3e9-20ba51b3ba38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9062826223314aa8a30d17f9a66d56b8'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:49.944461 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1281/2547] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:01:49 2022] DELETE /identity/v3/users/9062826223314aa8a30d17f9a66d56b8 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:50.406848 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848f716-af42-4825-834a-01661ab76ccf admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:50.414856 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0848f716-af42-4825-834a-01661ab76ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:50.422904 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848f716-af42-4825-834a-01661ab76ccf admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:50.452205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:50.483965 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e500d6-cdbb-4f48-8ffa-bafca48c8e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:50.484756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e500d6-cdbb-4f48-8ffa-bafca48c8e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:50.485034 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e500d6-cdbb-4f48-8ffa-bafca48c8e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:50.485519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e500d6-cdbb-4f48-8ffa-bafca48c8e62 admin admin] PATH_INFO: `/v3/projects/cd68dfebb9144f7ea13a06b20bc7f8ec` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:50.486739 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e500d6-cdbb-4f48-8ffa-bafca48c8e62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd68dfebb9144f7ea13a06b20bc7f8ec)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:50.488642 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e500d6-cdbb-4f48-8ffa-bafca48c8e62 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:50.628718 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a6e500d6-cdbb-4f48-8ffa-bafca48c8e62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd68dfebb9144f7ea13a06b20bc7f8ec', 'request_id': 'req-a6e500d6-cdbb-4f48-8ffa-bafca48c8e62'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:50.634238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a6e500d6-cdbb-4f48-8ffa-bafca48c8e62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd68dfebb9144f7ea13a06b20bc7f8ec', 'request_id': 'req-a6e500d6-cdbb-4f48-8ffa-bafca48c8e62'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:50.643800 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a6e500d6-cdbb-4f48-8ffa-bafca48c8e62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd68dfebb9144f7ea13a06b20bc7f8ec', 'request_id': 'req-a6e500d6-cdbb-4f48-8ffa-bafca48c8e62'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:50.753012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a6e500d6-cdbb-4f48-8ffa-bafca48c8e62 admin admin] The token cache is being invalidate because project cd68dfebb9144f7ea13a06b20bc7f8ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:01:50.757437 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a6e500d6-cdbb-4f48-8ffa-bafca48c8e62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:50.757437 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a6e500d6-cdbb-4f48-8ffa-bafca48c8e62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:50.757437 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1267/2548] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:01:50 2022] DELETE /identity/v3/projects/cd68dfebb9144f7ea13a06b20bc7f8ec => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:50.761600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e24ca3-05fe-4a7a-b8c9-22e68089a4ef None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:50.762065 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e24ca3-05fe-4a7a-b8c9-22e68089a4ef None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:50.762185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e24ca3-05fe-4a7a-b8c9-22e68089a4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:50.783887 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-48e24ca3-05fe-4a7a-b8c9-22e68089a4ef None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:50.785140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-48e24ca3-05fe-4a7a-b8c9-22e68089a4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:50.846563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1282/2549] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:50.855377 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccee1ef-370f-4685-a184-782c217e7ac2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:50.855673 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccee1ef-370f-4685-a184-782c217e7ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:50.855959 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccee1ef-370f-4685-a184-782c217e7ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:50.875430 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dccee1ef-370f-4685-a184-782c217e7ac2 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:50.876677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dccee1ef-370f-4685-a184-782c217e7ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:50.885156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1268/2550] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:50.890261 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e24ca3-05fe-4a7a-b8c9-22e68089a4ef None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:50.901313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e24ca3-05fe-4a7a-b8c9-22e68089a4ef None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:50.907292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fae51-8380-4fd0-8c7a-3d0cc364e054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:50.907956 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fae51-8380-4fd0-8c7a-3d0cc364e054 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:50.908234 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fae51-8380-4fd0-8c7a-3d0cc364e054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:50.908503 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fae51-8380-4fd0-8c7a-3d0cc364e054 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:50.909221 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0fae51-8380-4fd0-8c7a-3d0cc364e054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:01:50.909571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0fae51-8380-4fd0-8c7a-3d0cc364e054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:50.911179 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0fae51-8380-4fd0-8c7a-3d0cc364e054 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:50.925350 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1283/2551] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:01:50.928009 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccee1ef-370f-4685-a184-782c217e7ac2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:50.939873 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccee1ef-370f-4685-a184-782c217e7ac2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:50.944607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d2d66-c3bf-468a-97f1-557bc7e3a3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:50.945292 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d2d66-c3bf-468a-97f1-557bc7e3a3a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:50.945593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d2d66-c3bf-468a-97f1-557bc7e3a3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:50.945862 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d2d66-c3bf-468a-97f1-557bc7e3a3a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:50.946555 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d2d66-c3bf-468a-97f1-557bc7e3a3a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:50.948445 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d2d66-c3bf-468a-97f1-557bc7e3a3a4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:51.104263 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1269/2552] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:01:50 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:51.109553 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fae51-8380-4fd0-8c7a-3d0cc364e054 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:51.118680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fae51-8380-4fd0-8c7a-3d0cc364e054 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:51.176865 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce086624-96ce-40b0-b1ce-ed17a1d8f48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:51.177495 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce086624-96ce-40b0-b1ce-ed17a1d8f48d admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:51.177782 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce086624-96ce-40b0-b1ce-ed17a1d8f48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:51.178061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce086624-96ce-40b0-b1ce-ed17a1d8f48d admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:51.178764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce086624-96ce-40b0-b1ce-ed17a1d8f48d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:51.180678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce086624-96ce-40b0-b1ce-ed17a1d8f48d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:51.252543 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1284/2553] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:01:51 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:01:51.258511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d2d66-c3bf-468a-97f1-557bc7e3a3a4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:51.269126 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d2d66-c3bf-468a-97f1-557bc7e3a3a4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:51.274406 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96279a9-8cb6-4c36-b0d7-818ae38926dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:51.274550 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96279a9-8cb6-4c36-b0d7-818ae38926dc admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:51.274847 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96279a9-8cb6-4c36-b0d7-818ae38926dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:51.275125 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96279a9-8cb6-4c36-b0d7-818ae38926dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:51.275846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96279a9-8cb6-4c36-b0d7-818ae38926dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:51.277512 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96279a9-8cb6-4c36-b0d7-818ae38926dc admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:51.287878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1270/2554] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:01:51.292647 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce086624-96ce-40b0-b1ce-ed17a1d8f48d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:51.304115 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce086624-96ce-40b0-b1ce-ed17a1d8f48d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:51.309954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bfaa0-7085-43db-a83e-3c48dcc1c568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:51.310782 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bfaa0-7085-43db-a83e-3c48dcc1c568 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:51.311708 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bfaa0-7085-43db-a83e-3c48dcc1c568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:51.311987 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bfaa0-7085-43db-a83e-3c48dcc1c568 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:51.312716 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bfaa0-7085-43db-a83e-3c48dcc1c568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:51.314388 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bfaa0-7085-43db-a83e-3c48dcc1c568 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:51.326420 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1285/2555] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:01:51.330716 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96279a9-8cb6-4c36-b0d7-818ae38926dc admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:51.341049 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96279a9-8cb6-4c36-b0d7-818ae38926dc admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:51.346781 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16ea76-fba6-49d1-860c-fcf484ccb2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:51.347712 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16ea76-fba6-49d1-860c-fcf484ccb2b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:51.348018 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16ea76-fba6-49d1-860c-fcf484ccb2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:51.348293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16ea76-fba6-49d1-860c-fcf484ccb2b2 admin admin] PATH_INFO: `/v3/projects/7ff72225667447a0b5cb895f81a7d720/users/5d3f0b51bbe94dd98a39e515dad5f705/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:51.364029 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16ea76-fba6-49d1-860c-fcf484ccb2b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff72225667447a0b5cb895f81a7d720, user_id=5d3f0b51bbe94dd98a39e515dad5f705, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:51.366748 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16ea76-fba6-49d1-860c-fcf484ccb2b2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:51.382492 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:51.450814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1271/2556] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:01:51 2022] PUT /identity/v3/projects/7ff72225667447a0b5cb895f81a7d720/users/5d3f0b51bbe94dd98a39e515dad5f705/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:51.463140 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307d4ec-a607-410f-b88c-e1d8e5dc9752 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:51.463412 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307d4ec-a607-410f-b88c-e1d8e5dc9752 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:51.463701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307d4ec-a607-410f-b88c-e1d8e5dc9752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:51.495224 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6307d4ec-a607-410f-b88c-e1d8e5dc9752 None None] MFA Rules not processed for user `5d3f0b51bbe94dd98a39e515dad5f705`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:51.496451 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6307d4ec-a607-410f-b88c-e1d8e5dc9752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:51.562559 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1286/2557] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:51.574406 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16ea76-fba6-49d1-860c-fcf484ccb2b2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:51.580404 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8a16ea76-fba6-49d1-860c-fcf484ccb2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:51.635770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16ea76-fba6-49d1-860c-fcf484ccb2b2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:51.640013 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95188186-ffe2-4832-b077-e9701eb07268 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:51.640655 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95188186-ffe2-4832-b077-e9701eb07268 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:51.640930 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95188186-ffe2-4832-b077-e9701eb07268 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:51.641201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95188186-ffe2-4832-b077-e9701eb07268 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:51.649775 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95188186-ffe2-4832-b077-e9701eb07268 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:51.651197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95188186-ffe2-4832-b077-e9701eb07268 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:51.660623 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1272/2558] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:01:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:51.680769 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307d4ec-a607-410f-b88c-e1d8e5dc9752 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:51.744884 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307d4ec-a607-410f-b88c-e1d8e5dc9752 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:51.750183 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca70489-5f12-4a79-aa6d-7e76449e01f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:51.751326 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca70489-5f12-4a79-aa6d-7e76449e01f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:51.751686 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca70489-5f12-4a79-aa6d-7e76449e01f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:51.752091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca70489-5f12-4a79-aa6d-7e76449e01f4 admin admin] PATH_INFO: `/v3/users/5d3f0b51bbe94dd98a39e515dad5f705` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:51.753526 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca70489-5f12-4a79-aa6d-7e76449e01f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d3f0b51bbe94dd98a39e515dad5f705)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:51.755448 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca70489-5f12-4a79-aa6d-7e76449e01f4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:51.913436 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:52.015458 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cca70489-5f12-4a79-aa6d-7e76449e01f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d3f0b51bbe94dd98a39e515dad5f705'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:52.016120 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cca70489-5f12-4a79-aa6d-7e76449e01f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d3f0b51bbe94dd98a39e515dad5f705'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:52.029007 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cca70489-5f12-4a79-aa6d-7e76449e01f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d3f0b51bbe94dd98a39e515dad5f705'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:52.079793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cca70489-5f12-4a79-aa6d-7e76449e01f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d3f0b51bbe94dd98a39e515dad5f705'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:52.080663 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-cca70489-5f12-4a79-aa6d-7e76449e01f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d3f0b51bbe94dd98a39e515dad5f705'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:52.101249 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1287/2559] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:01:51 2022] DELETE /identity/v3/users/5d3f0b51bbe94dd98a39e515dad5f705 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:52.105790 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876e26-1106-4d38-8958-30ca213b9436 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:52.106172 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876e26-1106-4d38-8958-30ca213b9436 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:52.106495 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876e26-1106-4d38-8958-30ca213b9436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:52.132866 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-34876e26-1106-4d38-8958-30ca213b9436 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:52.134270 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-34876e26-1106-4d38-8958-30ca213b9436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:52.165520 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:52.206988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1273/2560] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:52.216663 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca70489-5f12-4a79-aa6d-7e76449e01f4 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:52.218702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cca70489-5f12-4a79-aa6d-7e76449e01f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:52.277642 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca70489-5f12-4a79-aa6d-7e76449e01f4 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:52.281790 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd42a0-f682-4a52-903e-fd6c40d8eb20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:52.282439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd42a0-f682-4a52-903e-fd6c40d8eb20 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:52.282723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd42a0-f682-4a52-903e-fd6c40d8eb20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:52.282997 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd42a0-f682-4a52-903e-fd6c40d8eb20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:52.291991 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd42a0-f682-4a52-903e-fd6c40d8eb20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:52.293459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd42a0-f682-4a52-903e-fd6c40d8eb20 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:52.303136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1288/2561] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:01:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:52.836756 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34876e26-1106-4d38-8958-30ca213b9436 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:52.840374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-34876e26-1106-4d38-8958-30ca213b9436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:52.850326 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34876e26-1106-4d38-8958-30ca213b9436 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:52.855057 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9314b2-835e-4d6a-884e-87b30cfe6c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:52.855934 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9314b2-835e-4d6a-884e-87b30cfe6c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:52.856209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9314b2-835e-4d6a-884e-87b30cfe6c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:52.856674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9314b2-835e-4d6a-884e-87b30cfe6c7b admin admin] PATH_INFO: `/v3/projects/7ff72225667447a0b5cb895f81a7d720` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:52.858541 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9314b2-835e-4d6a-884e-87b30cfe6c7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff72225667447a0b5cb895f81a7d720)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:52.860496 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9314b2-835e-4d6a-884e-87b30cfe6c7b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:52.989693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3f9314b2-835e-4d6a-884e-87b30cfe6c7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff72225667447a0b5cb895f81a7d720', 'request_id': 'req-3f9314b2-835e-4d6a-884e-87b30cfe6c7b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:52.996116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3f9314b2-835e-4d6a-884e-87b30cfe6c7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff72225667447a0b5cb895f81a7d720', 'request_id': 'req-3f9314b2-835e-4d6a-884e-87b30cfe6c7b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:53.004896 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3f9314b2-835e-4d6a-884e-87b30cfe6c7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff72225667447a0b5cb895f81a7d720', 'request_id': 'req-3f9314b2-835e-4d6a-884e-87b30cfe6c7b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:53.145437 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3f9314b2-835e-4d6a-884e-87b30cfe6c7b admin admin] The token cache is being invalidate because project 7ff72225667447a0b5cb895f81a7d720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:01:53.145781 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3f9314b2-835e-4d6a-884e-87b30cfe6c7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:53.151439 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3f9314b2-835e-4d6a-884e-87b30cfe6c7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:53.151439 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1274/2562] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:01:52 2022] DELETE /identity/v3/projects/7ff72225667447a0b5cb895f81a7d720 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:53.153701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a582e88-c622-4e70-ad5a-a996fdccd115 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:53.154196 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a582e88-c622-4e70-ad5a-a996fdccd115 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:53.154400 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a582e88-c622-4e70-ad5a-a996fdccd115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:53.174277 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4a582e88-c622-4e70-ad5a-a996fdccd115 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:53.175649 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4a582e88-c622-4e70-ad5a-a996fdccd115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:53.264874 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1289/2563] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:53.273347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3aea6c-5b28-430b-8668-5385c4818d9b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:53.273657 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3aea6c-5b28-430b-8668-5385c4818d9b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:53.273935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3aea6c-5b28-430b-8668-5385c4818d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:53.294184 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ef3aea6c-5b28-430b-8668-5385c4818d9b None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:53.295913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ef3aea6c-5b28-430b-8668-5385c4818d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:53.304264 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1275/2564] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:53.308621 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a582e88-c622-4e70-ad5a-a996fdccd115 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:53.320044 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a582e88-c622-4e70-ad5a-a996fdccd115 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:53.326218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da95f2-6795-4121-8547-b54a1c5e152a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:53.326911 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da95f2-6795-4121-8547-b54a1c5e152a admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:53.327384 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da95f2-6795-4121-8547-b54a1c5e152a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:53.327670 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da95f2-6795-4121-8547-b54a1c5e152a admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:53.328399 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da95f2-6795-4121-8547-b54a1c5e152a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:01:53.328813 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da95f2-6795-4121-8547-b54a1c5e152a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:53.330461 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da95f2-6795-4121-8547-b54a1c5e152a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:53.347359 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1290/2565] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:01:53.353780 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3aea6c-5b28-430b-8668-5385c4818d9b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:53.364256 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3aea6c-5b28-430b-8668-5385c4818d9b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:53.368866 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a08d6f-0809-4057-88db-458dc901b62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:53.370705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a08d6f-0809-4057-88db-458dc901b62d admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:53.371120 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a08d6f-0809-4057-88db-458dc901b62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:53.371402 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a08d6f-0809-4057-88db-458dc901b62d admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:53.372106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a08d6f-0809-4057-88db-458dc901b62d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:53.374633 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a08d6f-0809-4057-88db-458dc901b62d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:53.489840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da95f2-6795-4121-8547-b54a1c5e152a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:53.491507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-69da95f2-6795-4121-8547-b54a1c5e152a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:53.494263 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1276/2566] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:01:53 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:53.500043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a08d6f-0809-4057-88db-458dc901b62d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:53.555134 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:53.564674 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da95f2-6795-4121-8547-b54a1c5e152a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:53.568366 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a08d6f-0809-4057-88db-458dc901b62d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:53.573238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94f749-2605-4071-93e3-7fbefc565717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:53.573937 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94f749-2605-4071-93e3-7fbefc565717 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:53.574959 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94f749-2605-4071-93e3-7fbefc565717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:53.575167 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94f749-2605-4071-93e3-7fbefc565717 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:53.575970 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94f749-2605-4071-93e3-7fbefc565717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:53.576509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:53.578033 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94f749-2605-4071-93e3-7fbefc565717 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:53.618038 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032af882-59c7-42a5-8e3a-c684a267eafa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:53.618632 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032af882-59c7-42a5-8e3a-c684a267eafa service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:53.618916 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032af882-59c7-42a5-8e3a-c684a267eafa service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:53.619185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032af882-59c7-42a5-8e3a-c684a267eafa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:53.620981 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-032af882-59c7-42a5-8e3a-c684a267eafa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:53.633374 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032af882-59c7-42a5-8e3a-c684a267eafa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:53.635850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032af882-59c7-42a5-8e3a-c684a267eafa service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:53.648020 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1291/2567] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:01:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:01:53.675933 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1277/2568] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:01:53 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:01:53.680336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032af882-59c7-42a5-8e3a-c684a267eafa service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:53.690587 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032af882-59c7-42a5-8e3a-c684a267eafa service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:53.701579 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9f673-302c-4e00-b898-2158169a688f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:53.702459 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f673-302c-4e00-b898-2158169a688f admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:53.702751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f673-302c-4e00-b898-2158169a688f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:53.703026 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f673-302c-4e00-b898-2158169a688f admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:53.703753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9f673-302c-4e00-b898-2158169a688f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:53.705548 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9f673-302c-4e00-b898-2158169a688f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:53.718484 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1292/2569] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:01:53.723251 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94f749-2605-4071-93e3-7fbefc565717 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:53.735376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94f749-2605-4071-93e3-7fbefc565717 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:53.740577 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f203a-76d9-462e-b70a-cde71a4d633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:53.741355 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f203a-76d9-462e-b70a-cde71a4d633d admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:53.741650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f203a-76d9-462e-b70a-cde71a4d633d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:53.741938 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f203a-76d9-462e-b70a-cde71a4d633d admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:53.743325 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f203a-76d9-462e-b70a-cde71a4d633d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:53.745239 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f203a-76d9-462e-b70a-cde71a4d633d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:53.756944 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1278/2570] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:01:53.760776 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9f673-302c-4e00-b898-2158169a688f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:53.772055 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9f673-302c-4e00-b898-2158169a688f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:53.776978 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6e896-6fc6-467a-9bce-6041b45c29a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:53.777932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6e896-6fc6-467a-9bce-6041b45c29a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:53.778213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6e896-6fc6-467a-9bce-6041b45c29a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:53.778702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6e896-6fc6-467a-9bce-6041b45c29a7 admin admin] PATH_INFO: `/v3/projects/f46bba66f8c14e6590d7e2af3d45c65c/users/95985ddaffeb4715b5b93b1157f6e427/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:53.798134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6e896-6fc6-467a-9bce-6041b45c29a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f46bba66f8c14e6590d7e2af3d45c65c, user_id=95985ddaffeb4715b5b93b1157f6e427, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:53.800922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6e896-6fc6-467a-9bce-6041b45c29a7 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:53.892455 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1293/2571] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:01:53 2022] PUT /identity/v3/projects/f46bba66f8c14e6590d7e2af3d45c65c/users/95985ddaffeb4715b5b93b1157f6e427/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:53.902769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8f576-5176-412f-b99f-556a99c90a54 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:53.903630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8f576-5176-412f-b99f-556a99c90a54 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:53.903918 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8f576-5176-412f-b99f-556a99c90a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:53.932586 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-93a8f576-5176-412f-b99f-556a99c90a54 None None] MFA Rules not processed for user `95985ddaffeb4715b5b93b1157f6e427`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:53.934086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-93a8f576-5176-412f-b99f-556a99c90a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:54.001928 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1279/2572] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:54.014431 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6e896-6fc6-467a-9bce-6041b45c29a7 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:54.016156 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3ac6e896-6fc6-467a-9bce-6041b45c29a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:54.082250 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6e896-6fc6-467a-9bce-6041b45c29a7 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:54.086052 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fb7ac-b6f8-4c98-9781-82b1d5138b66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:54.088513 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fb7ac-b6f8-4c98-9781-82b1d5138b66 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:54.088513 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fb7ac-b6f8-4c98-9781-82b1d5138b66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:54.088513 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fb7ac-b6f8-4c98-9781-82b1d5138b66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:54.096969 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222fb7ac-b6f8-4c98-9781-82b1d5138b66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:54.098552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222fb7ac-b6f8-4c98-9781-82b1d5138b66 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:54.109444 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1294/2573] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:01:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:57.245849 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8f576-5176-412f-b99f-556a99c90a54 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:57.330199 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8f576-5176-412f-b99f-556a99c90a54 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:57.335058 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f6034-3399-45dc-8c31-9f1736d738c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:57.342193 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f6034-3399-45dc-8c31-9f1736d738c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:57.342193 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f6034-3399-45dc-8c31-9f1736d738c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:57.342193 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f6034-3399-45dc-8c31-9f1736d738c9 admin admin] PATH_INFO: `/v3/users/95985ddaffeb4715b5b93b1157f6e427` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:57.342193 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f6034-3399-45dc-8c31-9f1736d738c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95985ddaffeb4715b5b93b1157f6e427)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:57.342193 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f6034-3399-45dc-8c31-9f1736d738c9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:57.636155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-432f6034-3399-45dc-8c31-9f1736d738c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95985ddaffeb4715b5b93b1157f6e427'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:57.714263 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-432f6034-3399-45dc-8c31-9f1736d738c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95985ddaffeb4715b5b93b1157f6e427'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:57.714857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-432f6034-3399-45dc-8c31-9f1736d738c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95985ddaffeb4715b5b93b1157f6e427'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:57.715535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-432f6034-3399-45dc-8c31-9f1736d738c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95985ddaffeb4715b5b93b1157f6e427'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:57.725416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-432f6034-3399-45dc-8c31-9f1736d738c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95985ddaffeb4715b5b93b1157f6e427'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:57.726797 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:57.762553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1280/2574] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:01:57 2022] DELETE /identity/v3/users/95985ddaffeb4715b5b93b1157f6e427 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:57.767287 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475c606-d9f4-4353-9fe8-f85749d2da8f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:57.768032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475c606-d9f4-4353-9fe8-f85749d2da8f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:57.768566 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475c606-d9f4-4353-9fe8-f85749d2da8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:57.800930 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3475c606-d9f4-4353-9fe8-f85749d2da8f None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:57.802447 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3475c606-d9f4-4353-9fe8-f85749d2da8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:57.885959 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1295/2575] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:57.896261 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f6034-3399-45dc-8c31-9f1736d738c9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:57.897818 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-432f6034-3399-45dc-8c31-9f1736d738c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:57.971175 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f6034-3399-45dc-8c31-9f1736d738c9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:57.975780 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811a92a-d50c-446a-a0be-f36713478082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:57.976507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811a92a-d50c-446a-a0be-f36713478082 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:57.976824 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811a92a-d50c-446a-a0be-f36713478082 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:57.977316 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811a92a-d50c-446a-a0be-f36713478082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:57.988832 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811a92a-d50c-446a-a0be-f36713478082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:57.990467 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811a92a-d50c-446a-a0be-f36713478082 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:58.002273 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1281/2576] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:01:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:01:58.445390 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475c606-d9f4-4353-9fe8-f85749d2da8f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:58.446971 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3475c606-d9f4-4353-9fe8-f85749d2da8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:58.461676 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475c606-d9f4-4353-9fe8-f85749d2da8f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:58.466512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973202f6-24ad-45b6-8098-e6c25b3c23bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:58.468778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973202f6-24ad-45b6-8098-e6c25b3c23bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:58.468778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973202f6-24ad-45b6-8098-e6c25b3c23bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:58.468778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973202f6-24ad-45b6-8098-e6c25b3c23bf admin admin] PATH_INFO: `/v3/users/1551f28754a64d1d9010ed90b67c5dc4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:58.469670 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973202f6-24ad-45b6-8098-e6c25b3c23bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1551f28754a64d1d9010ed90b67c5dc4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:58.471704 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973202f6-24ad-45b6-8098-e6c25b3c23bf admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:58.496396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:58.549317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811a92a-d50c-446a-a0be-f36713478082 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:58.551405 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e811a92a-d50c-446a-a0be-f36713478082 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:58.568375 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811a92a-d50c-446a-a0be-f36713478082 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:58.574329 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e8f77-0da6-4344-9789-20bc9ff2fadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:58.575443 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e8f77-0da6-4344-9789-20bc9ff2fadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:58.575761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e8f77-0da6-4344-9789-20bc9ff2fadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:58.576002 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e8f77-0da6-4344-9789-20bc9ff2fadf admin admin] PATH_INFO: `/v3/projects/f46bba66f8c14e6590d7e2af3d45c65c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:58.577320 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e8f77-0da6-4344-9789-20bc9ff2fadf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f46bba66f8c14e6590d7e2af3d45c65c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:58.579322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e8f77-0da6-4344-9789-20bc9ff2fadf admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:58.774578 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-973202f6-24ad-45b6-8098-e6c25b3c23bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1551f28754a64d1d9010ed90b67c5dc4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:58.775242 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-973202f6-24ad-45b6-8098-e6c25b3c23bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1551f28754a64d1d9010ed90b67c5dc4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:58.775543 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5b5e8f77-0da6-4344-9789-20bc9ff2fadf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f46bba66f8c14e6590d7e2af3d45c65c', 'request_id': 'req-5b5e8f77-0da6-4344-9789-20bc9ff2fadf'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:58.781913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5b5e8f77-0da6-4344-9789-20bc9ff2fadf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f46bba66f8c14e6590d7e2af3d45c65c', 'request_id': 'req-5b5e8f77-0da6-4344-9789-20bc9ff2fadf'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:58.783525 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-973202f6-24ad-45b6-8098-e6c25b3c23bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1551f28754a64d1d9010ed90b67c5dc4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:58.788245 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5b5e8f77-0da6-4344-9789-20bc9ff2fadf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f46bba66f8c14e6590d7e2af3d45c65c', 'request_id': 'req-5b5e8f77-0da6-4344-9789-20bc9ff2fadf'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:58.930392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-973202f6-24ad-45b6-8098-e6c25b3c23bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1551f28754a64d1d9010ed90b67c5dc4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:58.931098 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-973202f6-24ad-45b6-8098-e6c25b3c23bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1551f28754a64d1d9010ed90b67c5dc4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:58.951186 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1296/2577] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:01:58 2022] DELETE /identity/v3/users/1551f28754a64d1d9010ed90b67c5dc4 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:59.020962 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5b5e8f77-0da6-4344-9789-20bc9ff2fadf admin admin] The token cache is being invalidate because project f46bba66f8c14e6590d7e2af3d45c65c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:01:59.020962 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5b5e8f77-0da6-4344-9789-20bc9ff2fadf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:59.020962 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5b5e8f77-0da6-4344-9789-20bc9ff2fadf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:59.020962 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1282/2578] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:01:58 2022] DELETE /identity/v3/projects/f46bba66f8c14e6590d7e2af3d45c65c => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:59.259508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973202f6-24ad-45b6-8098-e6c25b3c23bf admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:59.262315 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-973202f6-24ad-45b6-8098-e6c25b3c23bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:59.355793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973202f6-24ad-45b6-8098-e6c25b3c23bf admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:59.361188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706c970-68a4-4b8b-b49b-55c210bd4c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:59.362372 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706c970-68a4-4b8b-b49b-55c210bd4c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:59.362731 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706c970-68a4-4b8b-b49b-55c210bd4c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:59.363116 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706c970-68a4-4b8b-b49b-55c210bd4c8b admin admin] PATH_INFO: `/v3/projects/060af6cf4f7a48758f6859bd3766ae1b` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:59.364715 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706c970-68a4-4b8b-b49b-55c210bd4c8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=060af6cf4f7a48758f6859bd3766ae1b)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:59.366696 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706c970-68a4-4b8b-b49b-55c210bd4c8b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:59.474457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1706c970-68a4-4b8b-b49b-55c210bd4c8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '060af6cf4f7a48758f6859bd3766ae1b', 'request_id': 'req-1706c970-68a4-4b8b-b49b-55c210bd4c8b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:59.622182 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1706c970-68a4-4b8b-b49b-55c210bd4c8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '060af6cf4f7a48758f6859bd3766ae1b', 'request_id': 'req-1706c970-68a4-4b8b-b49b-55c210bd4c8b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:59.630442 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1706c970-68a4-4b8b-b49b-55c210bd4c8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '060af6cf4f7a48758f6859bd3766ae1b', 'request_id': 'req-1706c970-68a4-4b8b-b49b-55c210bd4c8b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:59.640749 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1706c970-68a4-4b8b-b49b-55c210bd4c8b admin admin] The token cache is being invalidate because project 060af6cf4f7a48758f6859bd3766ae1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:01:59.641036 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1706c970-68a4-4b8b-b49b-55c210bd4c8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:59.641698 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1706c970-68a4-4b8b-b49b-55c210bd4c8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:01:59.643240 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1297/2579] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:01:59 2022] DELETE /identity/v3/projects/060af6cf4f7a48758f6859bd3766ae1b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:01:59.648615 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03445c6e-75c7-4256-8bc2-43668ecb23cc None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:59.649223 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03445c6e-75c7-4256-8bc2-43668ecb23cc None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:59.649223 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03445c6e-75c7-4256-8bc2-43668ecb23cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:59.668507 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-03445c6e-75c7-4256-8bc2-43668ecb23cc None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:59.676771 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-03445c6e-75c7-4256-8bc2-43668ecb23cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:59.732992 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1283/2580] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:59.740830 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9b092-7223-41db-8650-36fbc7e9a81e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:59.741122 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9b092-7223-41db-8650-36fbc7e9a81e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:59.741445 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9b092-7223-41db-8650-36fbc7e9a81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:59.760030 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1fb9b092-7223-41db-8650-36fbc7e9a81e None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:01:59.761233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1fb9b092-7223-41db-8650-36fbc7e9a81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:01:59.769547 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1298/2581] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:01:59.773678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03445c6e-75c7-4256-8bc2-43668ecb23cc None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:59.784723 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03445c6e-75c7-4256-8bc2-43668ecb23cc None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:59.789738 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d1c17-598a-437c-b659-05594289f955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:59.790606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d1c17-598a-437c-b659-05594289f955 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:59.790925 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d1c17-598a-437c-b659-05594289f955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:59.791198 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d1c17-598a-437c-b659-05594289f955 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:59.791920 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d1c17-598a-437c-b659-05594289f955 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:01:59.792221 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d1c17-598a-437c-b659-05594289f955 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:59.793927 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d1c17-598a-437c-b659-05594289f955 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:59.796201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:59.807303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1284/2582] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:01:59.811706 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9b092-7223-41db-8650-36fbc7e9a81e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:59.821093 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9b092-7223-41db-8650-36fbc7e9a81e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:01:59.825853 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25061a-fd29-428e-9ca6-6f9f9a28b502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:01:59.826536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25061a-fd29-428e-9ca6-6f9f9a28b502 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:01:59.826819 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25061a-fd29-428e-9ca6-6f9f9a28b502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:01:59.827097 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25061a-fd29-428e-9ca6-6f9f9a28b502 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:01:59.827808 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25061a-fd29-428e-9ca6-6f9f9a28b502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:01:59.829758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25061a-fd29-428e-9ca6-6f9f9a28b502 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:01:59.943653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:59.950043 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1299/2583] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:01:59 2022] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:01:59.954743 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d1c17-598a-437c-b659-05594289f955 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:01:59.964882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d1c17-598a-437c-b659-05594289f955 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:00.027487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c76950-4d91-47f8-8999-d662e1bbc100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:00.028163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c76950-4d91-47f8-8999-d662e1bbc100 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:00.028447 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c76950-4d91-47f8-8999-d662e1bbc100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:00.028725 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c76950-4d91-47f8-8999-d662e1bbc100 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:00.030062 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c76950-4d91-47f8-8999-d662e1bbc100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:00.032040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c76950-4d91-47f8-8999-d662e1bbc100 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:00.174891 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1285/2584] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:01:59 2022] POST /identity/v3/users => generated 284 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:00.175007 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25061a-fd29-428e-9ca6-6f9f9a28b502 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:00.184870 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25061a-fd29-428e-9ca6-6f9f9a28b502 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:00.189681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fccfb1-b748-44f0-afa5-2448022fe09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:00.190343 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fccfb1-b748-44f0-afa5-2448022fe09a admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:00.190652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fccfb1-b748-44f0-afa5-2448022fe09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:00.190929 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fccfb1-b748-44f0-afa5-2448022fe09a admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:00.191719 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fccfb1-b748-44f0-afa5-2448022fe09a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:00.193353 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fccfb1-b748-44f0-afa5-2448022fe09a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:00.206111 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1300/2585] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:00.210245 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c76950-4d91-47f8-8999-d662e1bbc100 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:00.221225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c76950-4d91-47f8-8999-d662e1bbc100 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:00.226438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d586270-43ee-4e10-a3ab-4b86036d745c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:00.226977 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d586270-43ee-4e10-a3ab-4b86036d745c admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:00.227259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d586270-43ee-4e10-a3ab-4b86036d745c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:00.227535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d586270-43ee-4e10-a3ab-4b86036d745c admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:00.228247 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d586270-43ee-4e10-a3ab-4b86036d745c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:00.230206 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d586270-43ee-4e10-a3ab-4b86036d745c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:00.243638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1286/2586] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:00.244771 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fccfb1-b748-44f0-afa5-2448022fe09a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:00.254711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fccfb1-b748-44f0-afa5-2448022fe09a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:00.259233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09978a7d-e873-4bb7-b08b-b192528410d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:00.260114 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09978a7d-e873-4bb7-b08b-b192528410d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:00.260390 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09978a7d-e873-4bb7-b08b-b192528410d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:00.260664 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09978a7d-e873-4bb7-b08b-b192528410d3 admin admin] PATH_INFO: `/v3/projects/7aacdb010b5348c8990e6079c7c3061c/users/34395eefe5614311a3a4594f6bc9d9bc/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:00.276195 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09978a7d-e873-4bb7-b08b-b192528410d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aacdb010b5348c8990e6079c7c3061c, user_id=34395eefe5614311a3a4594f6bc9d9bc, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:00.278917 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09978a7d-e873-4bb7-b08b-b192528410d3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:00.416729 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1301/2587] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:00 2022] PUT /identity/v3/projects/7aacdb010b5348c8990e6079c7c3061c/users/34395eefe5614311a3a4594f6bc9d9bc/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:00.427307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b62ce-15b4-4242-90da-124e441de538 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:00.427690 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b62ce-15b4-4242-90da-124e441de538 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:00.428003 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b62ce-15b4-4242-90da-124e441de538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:00.455808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-021b62ce-15b4-4242-90da-124e441de538 None None] MFA Rules not processed for user `34395eefe5614311a3a4594f6bc9d9bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:00.457088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-021b62ce-15b4-4242-90da-124e441de538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:00.526224 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1287/2588] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:00.537110 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09978a7d-e873-4bb7-b08b-b192528410d3 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:00.538978 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-09978a7d-e873-4bb7-b08b-b192528410d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:00.598922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09978a7d-e873-4bb7-b08b-b192528410d3 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:00.602911 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f117365-32b8-4a3f-bb36-68f6071a1327 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:00.603555 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f117365-32b8-4a3f-bb36-68f6071a1327 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:00.603833 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f117365-32b8-4a3f-bb36-68f6071a1327 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:00.604133 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f117365-32b8-4a3f-bb36-68f6071a1327 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:00.612912 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f117365-32b8-4a3f-bb36-68f6071a1327 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:00.614373 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f117365-32b8-4a3f-bb36-68f6071a1327 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:00.623726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1302/2589] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:00 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:09.305324 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e212e44-421f-4a55-9e02-2e4c5ac7fb88 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:09.305876 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e212e44-421f-4a55-9e02-2e4c5ac7fb88 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:09.305876 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e212e44-421f-4a55-9e02-2e4c5ac7fb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:09.323895 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9e212e44-421f-4a55-9e02-2e4c5ac7fb88 None None] MFA Rules not processed for user `284df7837ac84a98992207ac01587020`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:09.325173 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9e212e44-421f-4a55-9e02-2e4c5ac7fb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:09.381944 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1288/2590] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:10.633418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:11.047841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f117365-32b8-4a3f-bb36-68f6071a1327 service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:11.048772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7f117365-32b8-4a3f-bb36-68f6071a1327 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:11.111779 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f117365-32b8-4a3f-bb36-68f6071a1327 service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:11.115464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948e1f6-635e-4110-8772-dfa012ef0d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:11.116109 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948e1f6-635e-4110-8772-dfa012ef0d7d service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:11.116392 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948e1f6-635e-4110-8772-dfa012ef0d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:11.116667 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948e1f6-635e-4110-8772-dfa012ef0d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:11.118471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9948e1f6-635e-4110-8772-dfa012ef0d7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:11.189014 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948e1f6-635e-4110-8772-dfa012ef0d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:11.190490 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948e1f6-635e-4110-8772-dfa012ef0d7d service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:11.200654 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1303/2591] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:14.480541 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e212e44-421f-4a55-9e02-2e4c5ac7fb88 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:14.492867 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e212e44-421f-4a55-9e02-2e4c5ac7fb88 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:14.497972 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58996cc5-91d5-409f-837a-3a061e9318cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:14.498890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58996cc5-91d5-409f-837a-3a061e9318cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:14.499165 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58996cc5-91d5-409f-837a-3a061e9318cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:14.499434 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58996cc5-91d5-409f-837a-3a061e9318cc admin admin] PATH_INFO: `/v3/users/34395eefe5614311a3a4594f6bc9d9bc` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:14.500630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58996cc5-91d5-409f-837a-3a061e9318cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=34395eefe5614311a3a4594f6bc9d9bc)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:14.502588 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58996cc5-91d5-409f-837a-3a061e9318cc admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:14.504283 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:14.710605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-58996cc5-91d5-409f-837a-3a061e9318cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34395eefe5614311a3a4594f6bc9d9bc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:14.816329 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-58996cc5-91d5-409f-837a-3a061e9318cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34395eefe5614311a3a4594f6bc9d9bc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:14.816849 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-58996cc5-91d5-409f-837a-3a061e9318cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34395eefe5614311a3a4594f6bc9d9bc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:14.817592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-58996cc5-91d5-409f-837a-3a061e9318cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34395eefe5614311a3a4594f6bc9d9bc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:14.830000 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-58996cc5-91d5-409f-837a-3a061e9318cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34395eefe5614311a3a4594f6bc9d9bc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:14.857194 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1289/2592] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:02:14 2022] DELETE /identity/v3/users/34395eefe5614311a3a4594f6bc9d9bc => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:14.860233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e1549-d073-453a-b937-6c2940f54c71 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:14.860233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e1549-d073-453a-b937-6c2940f54c71 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:14.860233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e1549-d073-453a-b937-6c2940f54c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:14.878912 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5f1e1549-d073-453a-b937-6c2940f54c71 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:14.880438 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5f1e1549-d073-453a-b937-6c2940f54c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:15.005918 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1304/2593] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:15.016878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58996cc5-91d5-409f-837a-3a061e9318cc admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:15.018402 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-58996cc5-91d5-409f-837a-3a061e9318cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:15.103845 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58996cc5-91d5-409f-837a-3a061e9318cc admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:15.108037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73362eb9-7c60-4ec1-919f-eac71600f473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:15.108496 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73362eb9-7c60-4ec1-919f-eac71600f473 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:15.108782 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73362eb9-7c60-4ec1-919f-eac71600f473 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:15.109055 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73362eb9-7c60-4ec1-919f-eac71600f473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:15.119930 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73362eb9-7c60-4ec1-919f-eac71600f473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:15.123077 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73362eb9-7c60-4ec1-919f-eac71600f473 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:15.136134 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1290/2594] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:15.637389 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e1549-d073-453a-b937-6c2940f54c71 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:15.639254 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5f1e1549-d073-453a-b937-6c2940f54c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:15.661570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e1549-d073-453a-b937-6c2940f54c71 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:15.666435 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45eded-ca50-4cef-abfc-cc8aa354fcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:15.667320 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45eded-ca50-4cef-abfc-cc8aa354fcdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:15.667637 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45eded-ca50-4cef-abfc-cc8aa354fcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:15.667914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45eded-ca50-4cef-abfc-cc8aa354fcdd admin admin] PATH_INFO: `/v3/users/89f20368c3a747a49a3aaa556115d169` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:15.670086 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45eded-ca50-4cef-abfc-cc8aa354fcdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=89f20368c3a747a49a3aaa556115d169)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:15.672096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45eded-ca50-4cef-abfc-cc8aa354fcdd admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:15.899399 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:15.909350 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fa45eded-ca50-4cef-abfc-cc8aa354fcdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89f20368c3a747a49a3aaa556115d169'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:15.909707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73362eb9-7c60-4ec1-919f-eac71600f473 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:15.910149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fa45eded-ca50-4cef-abfc-cc8aa354fcdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89f20368c3a747a49a3aaa556115d169'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:15.910427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-73362eb9-7c60-4ec1-919f-eac71600f473 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:15.913300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fa45eded-ca50-4cef-abfc-cc8aa354fcdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89f20368c3a747a49a3aaa556115d169'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:15.920975 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73362eb9-7c60-4ec1-919f-eac71600f473 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:15.925952 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a01779-9a19-4de9-b253-51736575ca0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:15.926820 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a01779-9a19-4de9-b253-51736575ca0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:15.927096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a01779-9a19-4de9-b253-51736575ca0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:15.927368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a01779-9a19-4de9-b253-51736575ca0d admin admin] PATH_INFO: `/v3/projects/7aacdb010b5348c8990e6079c7c3061c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:15.928800 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a01779-9a19-4de9-b253-51736575ca0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aacdb010b5348c8990e6079c7c3061c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:15.930951 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a01779-9a19-4de9-b253-51736575ca0d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:16.033131 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fa45eded-ca50-4cef-abfc-cc8aa354fcdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89f20368c3a747a49a3aaa556115d169'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:16.033780 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fa45eded-ca50-4cef-abfc-cc8aa354fcdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89f20368c3a747a49a3aaa556115d169'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:16.056349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1305/2595] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:02:15 2022] DELETE /identity/v3/users/89f20368c3a747a49a3aaa556115d169 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:16.081373 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-18a01779-9a19-4de9-b253-51736575ca0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aacdb010b5348c8990e6079c7c3061c', 'request_id': 'req-18a01779-9a19-4de9-b253-51736575ca0d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:16.086340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-18a01779-9a19-4de9-b253-51736575ca0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aacdb010b5348c8990e6079c7c3061c', 'request_id': 'req-18a01779-9a19-4de9-b253-51736575ca0d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:16.093048 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-18a01779-9a19-4de9-b253-51736575ca0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aacdb010b5348c8990e6079c7c3061c', 'request_id': 'req-18a01779-9a19-4de9-b253-51736575ca0d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:16.188203 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-18a01779-9a19-4de9-b253-51736575ca0d admin admin] The token cache is being invalidate because project 7aacdb010b5348c8990e6079c7c3061c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:16.189429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-18a01779-9a19-4de9-b253-51736575ca0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:16.189429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-18a01779-9a19-4de9-b253-51736575ca0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:16.190722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1291/2596] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:02:15 2022] DELETE /identity/v3/projects/7aacdb010b5348c8990e6079c7c3061c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:16.195778 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5a1f7-09f2-4e98-9bea-8e0501194374 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:16.196061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5a1f7-09f2-4e98-9bea-8e0501194374 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:16.196336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5a1f7-09f2-4e98-9bea-8e0501194374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:16.216044 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7ca5a1f7-09f2-4e98-9bea-8e0501194374 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:16.217306 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7ca5a1f7-09f2-4e98-9bea-8e0501194374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:16.278473 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1306/2597] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:16.286591 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb501679-de03-43e1-8d9a-fae0ae8f9c9e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:16.286882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb501679-de03-43e1-8d9a-fae0ae8f9c9e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:16.287167 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb501679-de03-43e1-8d9a-fae0ae8f9c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:16.295633 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:16.307277 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fb501679-de03-43e1-8d9a-fae0ae8f9c9e None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:16.308742 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fb501679-de03-43e1-8d9a-fae0ae8f9c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:16.317696 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5a1f7-09f2-4e98-9bea-8e0501194374 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:16.318418 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1292/2598] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:16.320638 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7ca5a1f7-09f2-4e98-9bea-8e0501194374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:16.330854 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb501679-de03-43e1-8d9a-fae0ae8f9c9e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:16.345753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5a1f7-09f2-4e98-9bea-8e0501194374 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:16.347692 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb501679-de03-43e1-8d9a-fae0ae8f9c9e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:16.351565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886a8c8-a182-4c06-ba60-20140c358353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:16.352468 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886a8c8-a182-4c06-ba60-20140c358353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:16.352751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886a8c8-a182-4c06-ba60-20140c358353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:16.353038 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886a8c8-a182-4c06-ba60-20140c358353 admin admin] PATH_INFO: `/v3/projects/5a16c7d70bb14cd3b898751084649cd2` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:16.353342 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d828c77-c52c-4dac-8267-8492343947ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:16.354013 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d828c77-c52c-4dac-8267-8492343947ab admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:16.354291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886a8c8-a182-4c06-ba60-20140c358353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a16c7d70bb14cd3b898751084649cd2)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:16.354412 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d828c77-c52c-4dac-8267-8492343947ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:16.354575 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d828c77-c52c-4dac-8267-8492343947ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:16.355327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d828c77-c52c-4dac-8267-8492343947ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:02:16.355632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d828c77-c52c-4dac-8267-8492343947ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:16.356316 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886a8c8-a182-4c06-ba60-20140c358353 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:16.358124 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d828c77-c52c-4dac-8267-8492343947ab admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:16.375431 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1293/2599] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:02:16.376669 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d828c77-c52c-4dac-8267-8492343947ab admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:16.386760 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d828c77-c52c-4dac-8267-8492343947ab admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:16.393390 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02325731-b28d-4b0b-92b8-39bb72cdbf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:16.394081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02325731-b28d-4b0b-92b8-39bb72cdbf55 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:16.394362 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02325731-b28d-4b0b-92b8-39bb72cdbf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:16.394634 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02325731-b28d-4b0b-92b8-39bb72cdbf55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:16.395322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02325731-b28d-4b0b-92b8-39bb72cdbf55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:16.398123 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02325731-b28d-4b0b-92b8-39bb72cdbf55 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:16.506804 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e886a8c8-a182-4c06-ba60-20140c358353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a16c7d70bb14cd3b898751084649cd2', 'request_id': 'req-e886a8c8-a182-4c06-ba60-20140c358353'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:16.526687 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1294/2600] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:02:16 2022] POST /identity/v3/projects => generated 403 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:16.530802 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02325731-b28d-4b0b-92b8-39bb72cdbf55 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:16.576648 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e886a8c8-a182-4c06-ba60-20140c358353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a16c7d70bb14cd3b898751084649cd2', 'request_id': 'req-e886a8c8-a182-4c06-ba60-20140c358353'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:16.583708 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e886a8c8-a182-4c06-ba60-20140c358353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a16c7d70bb14cd3b898751084649cd2', 'request_id': 'req-e886a8c8-a182-4c06-ba60-20140c358353'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:16.596079 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e886a8c8-a182-4c06-ba60-20140c358353 admin admin] The token cache is being invalidate because project 5a16c7d70bb14cd3b898751084649cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:16.596366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e886a8c8-a182-4c06-ba60-20140c358353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:16.596525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02325731-b28d-4b0b-92b8-39bb72cdbf55 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:16.597330 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e886a8c8-a182-4c06-ba60-20140c358353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:16.598911 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1307/2601] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:02:16 2022] DELETE /identity/v3/projects/5a16c7d70bb14cd3b898751084649cd2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:16.604402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb442ceb-8fe3-4f37-9034-b6ddbfb98329 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:16.604687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb442ceb-8fe3-4f37-9034-b6ddbfb98329 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:16.604964 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb442ceb-8fe3-4f37-9034-b6ddbfb98329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:16.605145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53714aca-f8e9-43f7-89eb-e15c1d4b96f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:16.605941 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53714aca-f8e9-43f7-89eb-e15c1d4b96f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:16.606288 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53714aca-f8e9-43f7-89eb-e15c1d4b96f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:16.606571 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53714aca-f8e9-43f7-89eb-e15c1d4b96f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:16.607307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53714aca-f8e9-43f7-89eb-e15c1d4b96f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:16.609291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53714aca-f8e9-43f7-89eb-e15c1d4b96f5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:16.624594 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fb442ceb-8fe3-4f37-9034-b6ddbfb98329 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:16.625860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fb442ceb-8fe3-4f37-9034-b6ddbfb98329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:16.634076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1308/2602] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:02:16.642935 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e514f-8458-41aa-9d20-f036e631b3b6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:16.643223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e514f-8458-41aa-9d20-f036e631b3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:16.643498 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e514f-8458-41aa-9d20-f036e631b3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:16.661410 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a99e514f-8458-41aa-9d20-f036e631b3b6 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:16.662597 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a99e514f-8458-41aa-9d20-f036e631b3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:16.670529 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1309/2603] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:02:16.674799 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e514f-8458-41aa-9d20-f036e631b3b6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:16.684018 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e514f-8458-41aa-9d20-f036e631b3b6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:16.689463 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5dfa2-185a-426f-8fb7-18b2766a44aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:16.690122 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5dfa2-185a-426f-8fb7-18b2766a44aa admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:16.690406 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5dfa2-185a-426f-8fb7-18b2766a44aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:16.690683 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5dfa2-185a-426f-8fb7-18b2766a44aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:16.691409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5dfa2-185a-426f-8fb7-18b2766a44aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:02:16.691723 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5dfa2-185a-426f-8fb7-18b2766a44aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:16.693345 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5dfa2-185a-426f-8fb7-18b2766a44aa admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:16.706313 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1310/2604] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:02:16.710675 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5dfa2-185a-426f-8fb7-18b2766a44aa admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:16.720834 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1295/2605] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:02:16 2022] POST /identity/v3/users => generated 302 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:02:16.722618 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5dfa2-185a-426f-8fb7-18b2766a44aa admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:16.726188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53714aca-f8e9-43f7-89eb-e15c1d4b96f5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:16.726350 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7af34-03c7-4bac-a9a9-d47a8d9eb016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:16.727000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7af34-03c7-4bac-a9a9-d47a8d9eb016 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:16.727166 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7af34-03c7-4bac-a9a9-d47a8d9eb016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:16.727441 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7af34-03c7-4bac-a9a9-d47a8d9eb016 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:16.727773 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-53714aca-f8e9-43f7-89eb-e15c1d4b96f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:16.728135 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7af34-03c7-4bac-a9a9-d47a8d9eb016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:16.730094 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7af34-03c7-4bac-a9a9-d47a8d9eb016 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:16.740542 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53714aca-f8e9-43f7-89eb-e15c1d4b96f5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:16.745278 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8326dc-d4ba-4969-a229-c47f3bfd6a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:16.746580 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8326dc-d4ba-4969-a229-c47f3bfd6a57 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:16.746580 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8326dc-d4ba-4969-a229-c47f3bfd6a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:16.746580 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8326dc-d4ba-4969-a229-c47f3bfd6a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:16.747344 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8326dc-d4ba-4969-a229-c47f3bfd6a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:16.748830 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8326dc-d4ba-4969-a229-c47f3bfd6a57 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:16.759483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1296/2606] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:02:16.763110 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8326dc-d4ba-4969-a229-c47f3bfd6a57 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:16.772759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8326dc-d4ba-4969-a229-c47f3bfd6a57 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:16.777513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950b7db-241a-4c63-9569-072bb9e6d425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:16.778153 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950b7db-241a-4c63-9569-072bb9e6d425 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:16.778444 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950b7db-241a-4c63-9569-072bb9e6d425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:16.779225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950b7db-241a-4c63-9569-072bb9e6d425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:16.779934 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950b7db-241a-4c63-9569-072bb9e6d425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:16.781525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950b7db-241a-4c63-9569-072bb9e6d425 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:16.791240 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1297/2607] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:02:16.795880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950b7db-241a-4c63-9569-072bb9e6d425 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:16.806008 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950b7db-241a-4c63-9569-072bb9e6d425 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:16.810724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde785df-9487-4db7-a179-97a28831fc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:16.811578 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde785df-9487-4db7-a179-97a28831fc33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:16.811865 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde785df-9487-4db7-a179-97a28831fc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:16.819271 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde785df-9487-4db7-a179-97a28831fc33 admin admin] PATH_INFO: `/v3/projects/654a11df0aa84bcd9d30ab408097b76c/users/089c73dfccd241ad907b46391fab1be0/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:16.827384 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde785df-9487-4db7-a179-97a28831fc33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=654a11df0aa84bcd9d30ab408097b76c, user_id=089c73dfccd241ad907b46391fab1be0, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:16.830060 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde785df-9487-4db7-a179-97a28831fc33 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:16.839216 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:16.847052 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1311/2608] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:02:16 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:02:16.853795 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7af34-03c7-4bac-a9a9-d47a8d9eb016 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:16.919114 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1298/2609] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:16 2022] PUT /identity/v3/projects/654a11df0aa84bcd9d30ab408097b76c/users/089c73dfccd241ad907b46391fab1be0/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:02:16.923823 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7af34-03c7-4bac-a9a9-d47a8d9eb016 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:16.925172 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295c655-d4d6-41c1-a355-f6333d5af8e0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:16.925601 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295c655-d4d6-41c1-a355-f6333d5af8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:16.926052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295c655-d4d6-41c1-a355-f6333d5af8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:16.946966 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8295c655-d4d6-41c1-a355-f6333d5af8e0 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:16.948497 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8295c655-d4d6-41c1-a355-f6333d5af8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:16.989144 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115bddf-ffd3-4442-acad-244b65be41c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:16.990517 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115bddf-ffd3-4442-acad-244b65be41c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:16.990517 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115bddf-ffd3-4442-acad-244b65be41c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:16.990678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115bddf-ffd3-4442-acad-244b65be41c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:16.991264 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115bddf-ffd3-4442-acad-244b65be41c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:16.994018 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115bddf-ffd3-4442-acad-244b65be41c9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:17.028458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1299/2610] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:17.038939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295c655-d4d6-41c1-a355-f6333d5af8e0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:17.040360 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8295c655-d4d6-41c1-a355-f6333d5af8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:17.051562 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:17.101371 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295c655-d4d6-41c1-a355-f6333d5af8e0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:17.105169 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606123f-da24-4557-8824-e96895103198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:17.105870 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606123f-da24-4557-8824-e96895103198 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:17.106145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606123f-da24-4557-8824-e96895103198 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:17.106415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606123f-da24-4557-8824-e96895103198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:17.108911 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1312/2611] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:02:16 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:02:17.112940 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115bddf-ffd3-4442-acad-244b65be41c9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:17.120605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606123f-da24-4557-8824-e96895103198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:17.122173 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606123f-da24-4557-8824-e96895103198 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:17.123684 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115bddf-ffd3-4442-acad-244b65be41c9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:17.128571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb61b81-14d5-4773-9f41-e42e7ad344c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:17.129236 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb61b81-14d5-4773-9f41-e42e7ad344c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:17.129571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb61b81-14d5-4773-9f41-e42e7ad344c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:17.129837 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb61b81-14d5-4773-9f41-e42e7ad344c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:17.130579 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb61b81-14d5-4773-9f41-e42e7ad344c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:17.132251 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb61b81-14d5-4773-9f41-e42e7ad344c0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:17.134373 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1300/2612] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:02:17.143368 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1313/2613] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:02:17.147289 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606123f-da24-4557-8824-e96895103198 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:17.157205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606123f-da24-4557-8824-e96895103198 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:17.162058 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f524e-e25a-4af3-b091-c9355eae6bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:17.162740 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f524e-e25a-4af3-b091-c9355eae6bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:17.163020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f524e-e25a-4af3-b091-c9355eae6bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:17.163313 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f524e-e25a-4af3-b091-c9355eae6bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:17.167423 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f524e-e25a-4af3-b091-c9355eae6bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:17.167423 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f524e-e25a-4af3-b091-c9355eae6bb8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:17.177112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1301/2614] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:17.181365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb61b81-14d5-4773-9f41-e42e7ad344c0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:17.192034 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb61b81-14d5-4773-9f41-e42e7ad344c0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:17.198818 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958c06d-28df-4f08-bb2a-412c71cb4495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:17.202076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958c06d-28df-4f08-bb2a-412c71cb4495 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:17.202076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958c06d-28df-4f08-bb2a-412c71cb4495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:17.202076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958c06d-28df-4f08-bb2a-412c71cb4495 admin admin] PATH_INFO: `/v3/projects/385f893eb30e4767a469a8279332dcf0/users/1186267f6b0f4f7ba4f493003aabfa77/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:17.219016 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958c06d-28df-4f08-bb2a-412c71cb4495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=385f893eb30e4767a469a8279332dcf0, user_id=1186267f6b0f4f7ba4f493003aabfa77, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:17.221840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958c06d-28df-4f08-bb2a-412c71cb4495 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:17.319919 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1314/2615] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:17 2022] PUT /identity/v3/projects/385f893eb30e4767a469a8279332dcf0/users/1186267f6b0f4f7ba4f493003aabfa77/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:17.330043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c286237-71f9-4a1d-a7eb-7a3023f3593c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:17.330333 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c286237-71f9-4a1d-a7eb-7a3023f3593c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:17.330667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c286237-71f9-4a1d-a7eb-7a3023f3593c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:17.359878 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6c286237-71f9-4a1d-a7eb-7a3023f3593c None None] MFA Rules not processed for user `1186267f6b0f4f7ba4f493003aabfa77`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:17.361088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6c286237-71f9-4a1d-a7eb-7a3023f3593c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:17.427233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1302/2616] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:17.438580 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958c06d-28df-4f08-bb2a-412c71cb4495 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:17.441371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8958c06d-28df-4f08-bb2a-412c71cb4495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:17.507302 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:17.523662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958c06d-28df-4f08-bb2a-412c71cb4495 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:17.530780 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a7b32-16c2-4f36-a821-a97888862f44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:17.531435 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a7b32-16c2-4f36-a821-a97888862f44 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:17.531747 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a7b32-16c2-4f36-a821-a97888862f44 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:17.532019 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a7b32-16c2-4f36-a821-a97888862f44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:17.540942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a7b32-16c2-4f36-a821-a97888862f44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:17.542886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a7b32-16c2-4f36-a821-a97888862f44 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:17.552652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1315/2617] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:18.486498 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa71406-af58-4658-8252-e02d394ff496 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:18.487043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa71406-af58-4658-8252-e02d394ff496 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:18.487241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa71406-af58-4658-8252-e02d394ff496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:18.526853 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-aaa71406-af58-4658-8252-e02d394ff496 None None] MFA Rules not processed for user `089c73dfccd241ad907b46391fab1be0`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:18.528393 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-aaa71406-af58-4658-8252-e02d394ff496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:18.603736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1303/2618] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:02:18.609033 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a7b32-16c2-4f36-a821-a97888862f44 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:18.675317 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a7b32-16c2-4f36-a821-a97888862f44 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:18.679898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b2dd6-9ea9-4158-9b3a-e81fc6ab88bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:18.680610 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b2dd6-9ea9-4158-9b3a-e81fc6ab88bd admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:18.680957 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b2dd6-9ea9-4158-9b3a-e81fc6ab88bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:18.681298 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b2dd6-9ea9-4158-9b3a-e81fc6ab88bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:18.682111 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b2dd6-9ea9-4158-9b3a-e81fc6ab88bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:18.684131 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b2dd6-9ea9-4158-9b3a-e81fc6ab88bd admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:18.806105 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1316/2619] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:02:18 2022] POST /identity/v3/projects => generated 403 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:18.810302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa71406-af58-4658-8252-e02d394ff496 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:18.821394 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa71406-af58-4658-8252-e02d394ff496 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:18.834247 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:18.880527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b13e54-950f-4169-aec3-aad119dfc8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:18.881204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b13e54-950f-4169-aec3-aad119dfc8ab admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:18.881522 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b13e54-950f-4169-aec3-aad119dfc8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:18.881795 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b13e54-950f-4169-aec3-aad119dfc8ab admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:18.882493 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b13e54-950f-4169-aec3-aad119dfc8ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:18.884454 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b13e54-950f-4169-aec3-aad119dfc8ab admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:19.016322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1304/2620] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:02:18 2022] POST /identity/v3/users => generated 308 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:19.023954 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b2dd6-9ea9-4158-9b3a-e81fc6ab88bd admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:19.031600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b2dd6-9ea9-4158-9b3a-e81fc6ab88bd admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:19.036512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10188221-bb5b-4028-a10d-55110225fcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:19.037244 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10188221-bb5b-4028-a10d-55110225fcc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:19.037556 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10188221-bb5b-4028-a10d-55110225fcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:19.037840 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10188221-bb5b-4028-a10d-55110225fcc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:19.038561 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10188221-bb5b-4028-a10d-55110225fcc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:19.040196 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10188221-bb5b-4028-a10d-55110225fcc7 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:19.052045 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1317/2621] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:19.057599 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b13e54-950f-4169-aec3-aad119dfc8ab admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:19.068054 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b13e54-950f-4169-aec3-aad119dfc8ab admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:19.077441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11266c80-8a60-45c7-8d88-85d4b50fcab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:19.078370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11266c80-8a60-45c7-8d88-85d4b50fcab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:19.078653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11266c80-8a60-45c7-8d88-85d4b50fcab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:19.078930 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11266c80-8a60-45c7-8d88-85d4b50fcab1 admin admin] PATH_INFO: `/v3/projects/d6fd268c997d4533beb54dd3af4d7ef7/users/018d60014265423ca33e7252f1ba81d8/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:19.095165 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11266c80-8a60-45c7-8d88-85d4b50fcab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6fd268c997d4533beb54dd3af4d7ef7, user_id=018d60014265423ca33e7252f1ba81d8, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:19.098006 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11266c80-8a60-45c7-8d88-85d4b50fcab1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:19.207043 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1305/2622] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:19 2022] PUT /identity/v3/projects/d6fd268c997d4533beb54dd3af4d7ef7/users/018d60014265423ca33e7252f1ba81d8/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:19.213022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10188221-bb5b-4028-a10d-55110225fcc7 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:19.224523 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10188221-bb5b-4028-a10d-55110225fcc7 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:19.287302 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe8816-d0bf-44c8-9a45-9d7a36a64f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:19.287983 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe8816-d0bf-44c8-9a45-9d7a36a64f51 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:19.288266 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe8816-d0bf-44c8-9a45-9d7a36a64f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:19.288681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe8816-d0bf-44c8-9a45-9d7a36a64f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:19.289351 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe8816-d0bf-44c8-9a45-9d7a36a64f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:19.291006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe8816-d0bf-44c8-9a45-9d7a36a64f51 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:19.302308 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1318/2623] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:19.306390 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11266c80-8a60-45c7-8d88-85d4b50fcab1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:19.321031 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11266c80-8a60-45c7-8d88-85d4b50fcab1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:19.327270 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61238cb5-492e-4d79-991d-4f20e2db3217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:19.328233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61238cb5-492e-4d79-991d-4f20e2db3217 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:19.328562 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61238cb5-492e-4d79-991d-4f20e2db3217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:19.328846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61238cb5-492e-4d79-991d-4f20e2db3217 admin admin] PATH_INFO: `/v3/projects/d6fd268c997d4533beb54dd3af4d7ef7/users/018d60014265423ca33e7252f1ba81d8/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:19.331198 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61238cb5-492e-4d79-991d-4f20e2db3217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6fd268c997d4533beb54dd3af4d7ef7, user_id=018d60014265423ca33e7252f1ba81d8, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:19.334317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61238cb5-492e-4d79-991d-4f20e2db3217 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:19.350320 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1306/2624] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:19 2022] PUT /identity/v3/projects/d6fd268c997d4533beb54dd3af4d7ef7/users/018d60014265423ca33e7252f1ba81d8/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:20.742025 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6461686-4e87-4c60-acea-6e96d406ed9c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:20.742695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6461686-4e87-4c60-acea-6e96d406ed9c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:20.742695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6461686-4e87-4c60-acea-6e96d406ed9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:20.780526 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f6461686-4e87-4c60-acea-6e96d406ed9c None None] MFA Rules not processed for user `018d60014265423ca33e7252f1ba81d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:20.780526 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f6461686-4e87-4c60-acea-6e96d406ed9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:20.832975 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:20.863420 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1319/2625] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:20 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:21.859967 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61238cb5-492e-4d79-991d-4f20e2db3217 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:21.861824 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-61238cb5-492e-4d79-991d-4f20e2db3217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:21.921669 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61238cb5-492e-4d79-991d-4f20e2db3217 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:21.926017 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d882e-e380-4a3c-aad1-f677109cc1cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:21.926673 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d882e-e380-4a3c-aad1-f677109cc1cc service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:21.926977 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d882e-e380-4a3c-aad1-f677109cc1cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:21.927251 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d882e-e380-4a3c-aad1-f677109cc1cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:21.929078 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6d7d882e-e380-4a3c-aad1-f677109cc1cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:21.989890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d882e-e380-4a3c-aad1-f677109cc1cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:21.991416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d882e-e380-4a3c-aad1-f677109cc1cc service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:22.005121 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1307/2626] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:22.361914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6461686-4e87-4c60-acea-6e96d406ed9c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:22.435816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6461686-4e87-4c60-acea-6e96d406ed9c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:22.442616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f24e04-f018-4c47-bbef-9678a6159437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:22.443696 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f24e04-f018-4c47-bbef-9678a6159437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:22.443935 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f24e04-f018-4c47-bbef-9678a6159437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:22.444215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f24e04-f018-4c47-bbef-9678a6159437 admin admin] PATH_INFO: `/v3/users/089c73dfccd241ad907b46391fab1be0` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:22.445675 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f24e04-f018-4c47-bbef-9678a6159437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=089c73dfccd241ad907b46391fab1be0)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:22.447920 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f24e04-f018-4c47-bbef-9678a6159437 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:22.705305 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-85f24e04-f018-4c47-bbef-9678a6159437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '089c73dfccd241ad907b46391fab1be0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:22.705963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-85f24e04-f018-4c47-bbef-9678a6159437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '089c73dfccd241ad907b46391fab1be0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:22.712874 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-85f24e04-f018-4c47-bbef-9678a6159437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '089c73dfccd241ad907b46391fab1be0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:22.775396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-85f24e04-f018-4c47-bbef-9678a6159437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '089c73dfccd241ad907b46391fab1be0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:22.776009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-85f24e04-f018-4c47-bbef-9678a6159437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '089c73dfccd241ad907b46391fab1be0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:22.795641 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1320/2627] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:02:22 2022] DELETE /identity/v3/users/089c73dfccd241ad907b46391fab1be0 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:23.155443 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d882e-e380-4a3c-aad1-f677109cc1cc service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:23.167226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d882e-e380-4a3c-aad1-f677109cc1cc service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:23.189088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:23.225883 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5001e-2603-438c-bbc6-fce6b3102903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:23.226748 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5001e-2603-438c-bbc6-fce6b3102903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:23.227029 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5001e-2603-438c-bbc6-fce6b3102903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:23.227307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5001e-2603-438c-bbc6-fce6b3102903 admin admin] PATH_INFO: `/v3/projects/654a11df0aa84bcd9d30ab408097b76c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:23.228474 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5001e-2603-438c-bbc6-fce6b3102903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=654a11df0aa84bcd9d30ab408097b76c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:23.230405 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5001e-2603-438c-bbc6-fce6b3102903 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:23.381097 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b9a5001e-2603-438c-bbc6-fce6b3102903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '654a11df0aa84bcd9d30ab408097b76c', 'request_id': 'req-b9a5001e-2603-438c-bbc6-fce6b3102903'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:23.386402 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b9a5001e-2603-438c-bbc6-fce6b3102903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '654a11df0aa84bcd9d30ab408097b76c', 'request_id': 'req-b9a5001e-2603-438c-bbc6-fce6b3102903'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:23.393964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b9a5001e-2603-438c-bbc6-fce6b3102903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '654a11df0aa84bcd9d30ab408097b76c', 'request_id': 'req-b9a5001e-2603-438c-bbc6-fce6b3102903'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:23.512971 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b9a5001e-2603-438c-bbc6-fce6b3102903 admin admin] The token cache is being invalidate because project 654a11df0aa84bcd9d30ab408097b76c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:23.513816 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b9a5001e-2603-438c-bbc6-fce6b3102903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:23.514472 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b9a5001e-2603-438c-bbc6-fce6b3102903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:23.516123 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1308/2628] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:02:23 2022] DELETE /identity/v3/projects/654a11df0aa84bcd9d30ab408097b76c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:23.520172 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f24e04-f018-4c47-bbef-9678a6159437 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:23.521680 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-85f24e04-f018-4c47-bbef-9678a6159437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:23.535705 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f24e04-f018-4c47-bbef-9678a6159437 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:23.597482 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee32cc-282c-4363-9070-33e5bb602d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:23.598325 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee32cc-282c-4363-9070-33e5bb602d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:23.598613 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee32cc-282c-4363-9070-33e5bb602d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:23.598889 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee32cc-282c-4363-9070-33e5bb602d8b admin admin] PATH_INFO: `/v3/users/018d60014265423ca33e7252f1ba81d8` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:23.600388 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee32cc-282c-4363-9070-33e5bb602d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=018d60014265423ca33e7252f1ba81d8)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:23.602372 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee32cc-282c-4363-9070-33e5bb602d8b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:23.603927 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:23.858534 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-beee32cc-282c-4363-9070-33e5bb602d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '018d60014265423ca33e7252f1ba81d8'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:23.859216 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-beee32cc-282c-4363-9070-33e5bb602d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '018d60014265423ca33e7252f1ba81d8'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:23.867718 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-beee32cc-282c-4363-9070-33e5bb602d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '018d60014265423ca33e7252f1ba81d8'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:23.987276 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-beee32cc-282c-4363-9070-33e5bb602d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '018d60014265423ca33e7252f1ba81d8'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:23.987962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-beee32cc-282c-4363-9070-33e5bb602d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '018d60014265423ca33e7252f1ba81d8'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:24.006223 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1321/2629] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:02:23 2022] DELETE /identity/v3/users/018d60014265423ca33e7252f1ba81d8 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:24.337719 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5001e-2603-438c-bbc6-fce6b3102903 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:24.339749 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b9a5001e-2603-438c-bbc6-fce6b3102903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:24.353736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5001e-2603-438c-bbc6-fce6b3102903 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:24.411999 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e054ea6-b90e-4b15-91f8-8557755c5c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:24.412873 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e054ea6-b90e-4b15-91f8-8557755c5c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:24.413158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e054ea6-b90e-4b15-91f8-8557755c5c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:24.413467 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e054ea6-b90e-4b15-91f8-8557755c5c2c admin admin] PATH_INFO: `/v3/projects/d6fd268c997d4533beb54dd3af4d7ef7` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:24.414652 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e054ea6-b90e-4b15-91f8-8557755c5c2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6fd268c997d4533beb54dd3af4d7ef7)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:24.416599 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e054ea6-b90e-4b15-91f8-8557755c5c2c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:24.526394 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4e054ea6-b90e-4b15-91f8-8557755c5c2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6fd268c997d4533beb54dd3af4d7ef7', 'request_id': 'req-4e054ea6-b90e-4b15-91f8-8557755c5c2c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:24.531921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:24.533322 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4e054ea6-b90e-4b15-91f8-8557755c5c2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6fd268c997d4533beb54dd3af4d7ef7', 'request_id': 'req-4e054ea6-b90e-4b15-91f8-8557755c5c2c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:24.539856 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4e054ea6-b90e-4b15-91f8-8557755c5c2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6fd268c997d4533beb54dd3af4d7ef7', 'request_id': 'req-4e054ea6-b90e-4b15-91f8-8557755c5c2c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:24.628601 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4e054ea6-b90e-4b15-91f8-8557755c5c2c admin admin] The token cache is being invalidate because project d6fd268c997d4533beb54dd3af4d7ef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:24.628962 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4e054ea6-b90e-4b15-91f8-8557755c5c2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:24.629681 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4e054ea6-b90e-4b15-91f8-8557755c5c2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:24.631232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1309/2630] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:02:24 2022] DELETE /identity/v3/projects/d6fd268c997d4533beb54dd3af4d7ef7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:24.640924 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902af29f-2d00-4f20-8816-0a81910ea1b3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:24.641454 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902af29f-2d00-4f20-8816-0a81910ea1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:24.641649 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902af29f-2d00-4f20-8816-0a81910ea1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:24.660439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-902af29f-2d00-4f20-8816-0a81910ea1b3 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:24.662300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-902af29f-2d00-4f20-8816-0a81910ea1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:24.728654 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1322/2631] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:24.736937 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b071b15-850a-46f5-96ba-e647e56fb0fe None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:24.737311 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b071b15-850a-46f5-96ba-e647e56fb0fe None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:24.737606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b071b15-850a-46f5-96ba-e647e56fb0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:24.756817 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5b071b15-850a-46f5-96ba-e647e56fb0fe None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:24.758079 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5b071b15-850a-46f5-96ba-e647e56fb0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:24.766375 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1310/2632] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:24.770676 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902af29f-2d00-4f20-8816-0a81910ea1b3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:24.783134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902af29f-2d00-4f20-8816-0a81910ea1b3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:24.787832 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a3162-a352-465f-9988-9355546c4f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:24.788494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a3162-a352-465f-9988-9355546c4f25 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:24.788775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a3162-a352-465f-9988-9355546c4f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:24.789059 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a3162-a352-465f-9988-9355546c4f25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:24.789816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a3162-a352-465f-9988-9355546c4f25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:02:24.790122 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a3162-a352-465f-9988-9355546c4f25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:24.791751 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a3162-a352-465f-9988-9355546c4f25 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:24.804332 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1323/2633] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:02:24.808975 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b071b15-850a-46f5-96ba-e647e56fb0fe None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:24.819204 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b071b15-850a-46f5-96ba-e647e56fb0fe None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:24.824101 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09388a-9951-4375-83c3-b3e9b12e5032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:24.824761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09388a-9951-4375-83c3-b3e9b12e5032 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:24.825046 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09388a-9951-4375-83c3-b3e9b12e5032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:24.825397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09388a-9951-4375-83c3-b3e9b12e5032 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:24.826688 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09388a-9951-4375-83c3-b3e9b12e5032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:24.828635 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09388a-9951-4375-83c3-b3e9b12e5032 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:24.972323 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1311/2634] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:02:24 2022] POST /identity/v3/projects => generated 369 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:24.976472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a3162-a352-465f-9988-9355546c4f25 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:24.986879 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a3162-a352-465f-9988-9355546c4f25 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:25.044617 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee736905-fb0d-42cb-8089-99790ff64d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:25.045318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee736905-fb0d-42cb-8089-99790ff64d87 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:25.045609 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee736905-fb0d-42cb-8089-99790ff64d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:25.045887 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee736905-fb0d-42cb-8089-99790ff64d87 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:25.046730 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee736905-fb0d-42cb-8089-99790ff64d87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:25.048691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee736905-fb0d-42cb-8089-99790ff64d87 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:25.058960 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:25.307561 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1324/2635] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:02:24 2022] POST /identity/v3/users => generated 285 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:25.312398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09388a-9951-4375-83c3-b3e9b12e5032 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:25.323227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09388a-9951-4375-83c3-b3e9b12e5032 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:25.328629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecba50-f088-4496-be40-203841f941d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:25.329312 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecba50-f088-4496-be40-203841f941d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:25.329590 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecba50-f088-4496-be40-203841f941d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:25.329868 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecba50-f088-4496-be40-203841f941d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:25.330598 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecba50-f088-4496-be40-203841f941d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:25.332268 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecba50-f088-4496-be40-203841f941d8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:25.346388 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1312/2636] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:02:25.351671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee736905-fb0d-42cb-8089-99790ff64d87 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:25.362592 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee736905-fb0d-42cb-8089-99790ff64d87 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:25.367298 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70201482-b5dd-4ec8-9826-5cae88aa5de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:25.368593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70201482-b5dd-4ec8-9826-5cae88aa5de6 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:25.368593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70201482-b5dd-4ec8-9826-5cae88aa5de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:25.368593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70201482-b5dd-4ec8-9826-5cae88aa5de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:25.369393 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70201482-b5dd-4ec8-9826-5cae88aa5de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:25.371003 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70201482-b5dd-4ec8-9826-5cae88aa5de6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:25.383366 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1325/2637] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:25.387548 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecba50-f088-4496-be40-203841f941d8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:25.398133 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecba50-f088-4496-be40-203841f941d8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:25.403286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a2607-4c6f-4669-a99c-a9749aa503ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:25.404310 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a2607-4c6f-4669-a99c-a9749aa503ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:25.404663 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a2607-4c6f-4669-a99c-a9749aa503ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:25.405011 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a2607-4c6f-4669-a99c-a9749aa503ae admin admin] PATH_INFO: `/v3/projects/0f8db42c7e7045bc9aff37eb82eb36e2/users/da527cc0bca044c180701523e11b08b7/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:25.423518 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a2607-4c6f-4669-a99c-a9749aa503ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f8db42c7e7045bc9aff37eb82eb36e2, user_id=da527cc0bca044c180701523e11b08b7, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:25.426268 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a2607-4c6f-4669-a99c-a9749aa503ae admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:25.491685 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1313/2638] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:25 2022] PUT /identity/v3/projects/0f8db42c7e7045bc9aff37eb82eb36e2/users/da527cc0bca044c180701523e11b08b7/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:25.503122 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b91ed-591e-43f5-817f-3849cebb60b1 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:25.503537 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b91ed-591e-43f5-817f-3849cebb60b1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:25.503710 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b91ed-591e-43f5-817f-3849cebb60b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:25.532126 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7b2b91ed-591e-43f5-817f-3849cebb60b1 None None] MFA Rules not processed for user `da527cc0bca044c180701523e11b08b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:25.533388 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7b2b91ed-591e-43f5-817f-3849cebb60b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:25.598254 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1326/2639] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:25.603123 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a2607-4c6f-4669-a99c-a9749aa503ae admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:25.667440 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a2607-4c6f-4669-a99c-a9749aa503ae admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:25.673193 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d08368-5233-4d77-a0a6-a829d1ff3f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:25.673899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d08368-5233-4d77-a0a6-a829d1ff3f77 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:25.674203 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d08368-5233-4d77-a0a6-a829d1ff3f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:25.674454 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d08368-5233-4d77-a0a6-a829d1ff3f77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:25.675160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d08368-5233-4d77-a0a6-a829d1ff3f77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:25.677068 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d08368-5233-4d77-a0a6-a829d1ff3f77 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:25.783908 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1314/2640] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:02:25 2022] POST /identity/v3/projects => generated 369 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:25.787731 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b91ed-591e-43f5-817f-3849cebb60b1 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:25.799747 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b91ed-591e-43f5-817f-3849cebb60b1 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:25.857210 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584ba3e-7c5c-414d-ac68-63d328ac11ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:25.857915 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584ba3e-7c5c-414d-ac68-63d328ac11ae admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:25.858229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584ba3e-7c5c-414d-ac68-63d328ac11ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:25.858512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584ba3e-7c5c-414d-ac68-63d328ac11ae admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:25.859198 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584ba3e-7c5c-414d-ac68-63d328ac11ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:25.861304 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584ba3e-7c5c-414d-ac68-63d328ac11ae admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:25.993267 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1327/2641] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:02:25 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:25.997573 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d08368-5233-4d77-a0a6-a829d1ff3f77 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:26.007958 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d08368-5233-4d77-a0a6-a829d1ff3f77 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:26.012522 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf86ed-a7c9-4feb-961d-646b817abf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:26.013744 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf86ed-a7c9-4feb-961d-646b817abf8f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:26.014031 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf86ed-a7c9-4feb-961d-646b817abf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:26.014392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf86ed-a7c9-4feb-961d-646b817abf8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:26.015117 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf86ed-a7c9-4feb-961d-646b817abf8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:26.016704 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf86ed-a7c9-4feb-961d-646b817abf8f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:26.027996 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1315/2642] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:26.032914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584ba3e-7c5c-414d-ac68-63d328ac11ae admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:26.043258 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584ba3e-7c5c-414d-ac68-63d328ac11ae admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:26.048008 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff9a59-799d-4cbe-a9ba-245b7951b03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:26.048886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff9a59-799d-4cbe-a9ba-245b7951b03a admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:26.049172 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff9a59-799d-4cbe-a9ba-245b7951b03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:26.049517 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff9a59-799d-4cbe-a9ba-245b7951b03a admin admin] PATH_INFO: `/v3/projects/4cc6cb11a5b64291b8539a718a0a3128/users/9dd2b55155ab4c10bc92f854accf1db0/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:26.064338 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff9a59-799d-4cbe-a9ba-245b7951b03a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc6cb11a5b64291b8539a718a0a3128, user_id=9dd2b55155ab4c10bc92f854accf1db0, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:26.067050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff9a59-799d-4cbe-a9ba-245b7951b03a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:26.153239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1328/2643] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:26 2022] PUT /identity/v3/projects/4cc6cb11a5b64291b8539a718a0a3128/users/9dd2b55155ab4c10bc92f854accf1db0/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:26.157962 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf86ed-a7c9-4feb-961d-646b817abf8f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:26.168267 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf86ed-a7c9-4feb-961d-646b817abf8f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:26.218491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:26.225397 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ca4c4-66bf-438f-8dd2-e07059f14b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:26.226102 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ca4c4-66bf-438f-8dd2-e07059f14b37 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:26.226384 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ca4c4-66bf-438f-8dd2-e07059f14b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:26.226652 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ca4c4-66bf-438f-8dd2-e07059f14b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:26.227357 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ca4c4-66bf-438f-8dd2-e07059f14b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:26.228930 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ca4c4-66bf-438f-8dd2-e07059f14b37 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:26.241398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1316/2644] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:02:26.245632 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff9a59-799d-4cbe-a9ba-245b7951b03a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:26.256806 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff9a59-799d-4cbe-a9ba-245b7951b03a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:26.261761 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a76702-4dc6-494b-9280-0de9cf4bccd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:26.262639 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a76702-4dc6-494b-9280-0de9cf4bccd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:26.263537 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a76702-4dc6-494b-9280-0de9cf4bccd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:26.263810 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a76702-4dc6-494b-9280-0de9cf4bccd9 admin admin] PATH_INFO: `/v3/projects/4cc6cb11a5b64291b8539a718a0a3128/users/9dd2b55155ab4c10bc92f854accf1db0/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:26.265857 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a76702-4dc6-494b-9280-0de9cf4bccd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc6cb11a5b64291b8539a718a0a3128, user_id=9dd2b55155ab4c10bc92f854accf1db0, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:26.268460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a76702-4dc6-494b-9280-0de9cf4bccd9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:26.278972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1329/2645] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:26 2022] PUT /identity/v3/projects/4cc6cb11a5b64291b8539a718a0a3128/users/9dd2b55155ab4c10bc92f854accf1db0/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:26.289540 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb1600-b9e5-4978-922e-6f1a6b4db660 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:26.289827 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb1600-b9e5-4978-922e-6f1a6b4db660 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:26.290108 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb1600-b9e5-4978-922e-6f1a6b4db660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:26.317221 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2acb1600-b9e5-4978-922e-6f1a6b4db660 None None] MFA Rules not processed for user `9dd2b55155ab4c10bc92f854accf1db0`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:26.318399 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2acb1600-b9e5-4978-922e-6f1a6b4db660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:26.386743 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1317/2646] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:26 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:26.398640 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a76702-4dc6-494b-9280-0de9cf4bccd9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:26.400314 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f4a76702-4dc6-494b-9280-0de9cf4bccd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:26.431297 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:26.462485 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a76702-4dc6-494b-9280-0de9cf4bccd9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:26.467018 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b4414-5118-4688-8213-af4b6d1ed46f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:26.467730 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b4414-5118-4688-8213-af4b6d1ed46f service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:26.468012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b4414-5118-4688-8213-af4b6d1ed46f service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:26.468287 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b4414-5118-4688-8213-af4b6d1ed46f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:26.478120 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b4414-5118-4688-8213-af4b6d1ed46f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:26.479574 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b4414-5118-4688-8213-af4b6d1ed46f service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:26.491037 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1330/2647] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:26 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:29.627141 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb1600-b9e5-4978-922e-6f1a6b4db660 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:29.627141 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2acb1600-b9e5-4978-922e-6f1a6b4db660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:29.696206 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb1600-b9e5-4978-922e-6f1a6b4db660 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:29.701411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea97e0-6c94-4159-a6cb-aceb1bcadc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:29.702306 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea97e0-6c94-4159-a6cb-aceb1bcadc0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:29.702594 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea97e0-6c94-4159-a6cb-aceb1bcadc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:29.702870 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea97e0-6c94-4159-a6cb-aceb1bcadc0c admin admin] PATH_INFO: `/v3/users/1186267f6b0f4f7ba4f493003aabfa77` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:29.704086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea97e0-6c94-4159-a6cb-aceb1bcadc0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1186267f6b0f4f7ba4f493003aabfa77)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:29.709490 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea97e0-6c94-4159-a6cb-aceb1bcadc0c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:29.887962 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-11ea97e0-6c94-4159-a6cb-aceb1bcadc0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1186267f6b0f4f7ba4f493003aabfa77'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:30.021690 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-11ea97e0-6c94-4159-a6cb-aceb1bcadc0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1186267f6b0f4f7ba4f493003aabfa77'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:30.022514 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-11ea97e0-6c94-4159-a6cb-aceb1bcadc0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1186267f6b0f4f7ba4f493003aabfa77'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:30.023140 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-11ea97e0-6c94-4159-a6cb-aceb1bcadc0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1186267f6b0f4f7ba4f493003aabfa77'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:30.032401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-11ea97e0-6c94-4159-a6cb-aceb1bcadc0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1186267f6b0f4f7ba4f493003aabfa77'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:30.048545 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:30.051782 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1318/2648] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:02:29 2022] DELETE /identity/v3/users/1186267f6b0f4f7ba4f493003aabfa77 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:30.058000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924d6ae-763e-4757-94ae-f0617fca219c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:30.058523 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924d6ae-763e-4757-94ae-f0617fca219c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:30.058624 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924d6ae-763e-4757-94ae-f0617fca219c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:30.079727 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6924d6ae-763e-4757-94ae-f0617fca219c None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:30.080922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6924d6ae-763e-4757-94ae-f0617fca219c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:30.153239 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1331/2649] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:02:30.164882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea97e0-6c94-4159-a6cb-aceb1bcadc0c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:30.166336 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-11ea97e0-6c94-4159-a6cb-aceb1bcadc0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:30.231592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea97e0-6c94-4159-a6cb-aceb1bcadc0c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:30.235640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd34ac7-559e-469c-8bfd-0168eb3a8853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:30.236561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd34ac7-559e-469c-8bfd-0168eb3a8853 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:30.236782 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd34ac7-559e-469c-8bfd-0168eb3a8853 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:30.237083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd34ac7-559e-469c-8bfd-0168eb3a8853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:30.247941 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd34ac7-559e-469c-8bfd-0168eb3a8853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:30.249404 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd34ac7-559e-469c-8bfd-0168eb3a8853 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:30.259363 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1319/2650] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:30.562881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924d6ae-763e-4757-94ae-f0617fca219c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:30.564353 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6924d6ae-763e-4757-94ae-f0617fca219c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:30.576338 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924d6ae-763e-4757-94ae-f0617fca219c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:30.587521 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356ac2f-ced0-4129-a7cd-5f314bd93b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:30.588347 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356ac2f-ced0-4129-a7cd-5f314bd93b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:30.588989 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356ac2f-ced0-4129-a7cd-5f314bd93b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:30.589605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356ac2f-ced0-4129-a7cd-5f314bd93b91 admin admin] PATH_INFO: `/v3/users/da527cc0bca044c180701523e11b08b7` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:30.591085 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356ac2f-ced0-4129-a7cd-5f314bd93b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da527cc0bca044c180701523e11b08b7)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:30.593494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356ac2f-ced0-4129-a7cd-5f314bd93b91 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:30.755437 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd34ac7-559e-469c-8bfd-0168eb3a8853 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:30.758248 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3bd34ac7-559e-469c-8bfd-0168eb3a8853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:30.777226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd34ac7-559e-469c-8bfd-0168eb3a8853 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:30.780187 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e5be2-e032-44b4-852a-a71f8c678a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:30.781059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e5be2-e032-44b4-852a-a71f8c678a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:30.781707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e5be2-e032-44b4-852a-a71f8c678a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:30.782049 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e5be2-e032-44b4-852a-a71f8c678a38 admin admin] PATH_INFO: `/v3/projects/385f893eb30e4767a469a8279332dcf0` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:30.783166 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e5be2-e032-44b4-852a-a71f8c678a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=385f893eb30e4767a469a8279332dcf0)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:30.785076 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e5be2-e032-44b4-852a-a71f8c678a38 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:30.864750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2356ac2f-ced0-4129-a7cd-5f314bd93b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da527cc0bca044c180701523e11b08b7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:30.865443 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2356ac2f-ced0-4129-a7cd-5f314bd93b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da527cc0bca044c180701523e11b08b7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:30.872719 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2356ac2f-ced0-4129-a7cd-5f314bd93b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da527cc0bca044c180701523e11b08b7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:30.931318 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-627e5be2-e032-44b4-852a-a71f8c678a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385f893eb30e4767a469a8279332dcf0', 'request_id': 'req-627e5be2-e032-44b4-852a-a71f8c678a38'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:30.937308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-627e5be2-e032-44b4-852a-a71f8c678a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385f893eb30e4767a469a8279332dcf0', 'request_id': 'req-627e5be2-e032-44b4-852a-a71f8c678a38'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:30.946822 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-627e5be2-e032-44b4-852a-a71f8c678a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385f893eb30e4767a469a8279332dcf0', 'request_id': 'req-627e5be2-e032-44b4-852a-a71f8c678a38'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:31.004615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2356ac2f-ced0-4129-a7cd-5f314bd93b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da527cc0bca044c180701523e11b08b7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:31.005238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2356ac2f-ced0-4129-a7cd-5f314bd93b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da527cc0bca044c180701523e11b08b7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:31.024456 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1332/2651] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:02:30 2022] DELETE /identity/v3/users/da527cc0bca044c180701523e11b08b7 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:31.029396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07597832-2fdd-4cf4-bec4-111f83d286a2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:31.029715 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07597832-2fdd-4cf4-bec4-111f83d286a2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:31.030112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07597832-2fdd-4cf4-bec4-111f83d286a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:31.048758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-07597832-2fdd-4cf4-bec4-111f83d286a2 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:31.050443 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-07597832-2fdd-4cf4-bec4-111f83d286a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:31.090664 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:31.111739 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1333/2652] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:02:31.122103 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07597832-2fdd-4cf4-bec4-111f83d286a2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:31.123802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-07597832-2fdd-4cf4-bec4-111f83d286a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:31.142090 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-627e5be2-e032-44b4-852a-a71f8c678a38 admin admin] The token cache is being invalidate because project 385f893eb30e4767a469a8279332dcf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:31.142381 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-627e5be2-e032-44b4-852a-a71f8c678a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:31.143226 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-627e5be2-e032-44b4-852a-a71f8c678a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:31.144785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1320/2653] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:02:30 2022] DELETE /identity/v3/projects/385f893eb30e4767a469a8279332dcf0 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:31.149977 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11adaf7-7eb9-457c-ad8f-1ca7a5ec30a3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:31.150256 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11adaf7-7eb9-457c-ad8f-1ca7a5ec30a3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:31.150529 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11adaf7-7eb9-457c-ad8f-1ca7a5ec30a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:31.171372 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e11adaf7-7eb9-457c-ad8f-1ca7a5ec30a3 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:31.173212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e11adaf7-7eb9-457c-ad8f-1ca7a5ec30a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:31.186932 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1321/2654] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:02:31.195125 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f668cbf-2587-4ad2-ac0e-9580099ff0d9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:31.195350 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07597832-2fdd-4cf4-bec4-111f83d286a2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:31.195699 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f668cbf-2587-4ad2-ac0e-9580099ff0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:31.195968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f668cbf-2587-4ad2-ac0e-9580099ff0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:31.202462 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6027aa-0317-4ef6-ac00-258b79f72818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:31.203531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6027aa-0317-4ef6-ac00-258b79f72818 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:31.203856 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6027aa-0317-4ef6-ac00-258b79f72818 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:31.204134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6027aa-0317-4ef6-ac00-258b79f72818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:31.206254 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cd6027aa-0317-4ef6-ac00-258b79f72818 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:31.217129 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3f668cbf-2587-4ad2-ac0e-9580099ff0d9 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:31.218386 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3f668cbf-2587-4ad2-ac0e-9580099ff0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:31.219656 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6027aa-0317-4ef6-ac00-258b79f72818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:31.221093 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6027aa-0317-4ef6-ac00-258b79f72818 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:31.231227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1322/2655] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:02:31.232869 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f668cbf-2587-4ad2-ac0e-9580099ff0d9 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:31.235653 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1334/2656] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:02:31.242778 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f668cbf-2587-4ad2-ac0e-9580099ff0d9 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:31.247689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d97977-8ae1-48b1-8f26-db1dbd134014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:31.248428 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d97977-8ae1-48b1-8f26-db1dbd134014 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:31.248711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d97977-8ae1-48b1-8f26-db1dbd134014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:31.249012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d97977-8ae1-48b1-8f26-db1dbd134014 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:31.249774 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d97977-8ae1-48b1-8f26-db1dbd134014 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:02:31.250085 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d97977-8ae1-48b1-8f26-db1dbd134014 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:31.251711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d97977-8ae1-48b1-8f26-db1dbd134014 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:31.265990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1323/2657] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:02:31.272991 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6027aa-0317-4ef6-ac00-258b79f72818 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:31.285177 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6027aa-0317-4ef6-ac00-258b79f72818 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:31.290304 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf382e-a47d-4416-aa91-594ff55de517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:31.290969 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf382e-a47d-4416-aa91-594ff55de517 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:31.291247 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf382e-a47d-4416-aa91-594ff55de517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:31.291514 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf382e-a47d-4416-aa91-594ff55de517 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:31.292246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf382e-a47d-4416-aa91-594ff55de517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:31.294491 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf382e-a47d-4416-aa91-594ff55de517 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:31.456646 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1335/2658] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:02:31 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:31.457855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d97977-8ae1-48b1-8f26-db1dbd134014 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:31.468376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d97977-8ae1-48b1-8f26-db1dbd134014 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:31.531785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:31.540379 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b3ad2-d855-466f-a332-3a71cc7df85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:31.541319 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b3ad2-d855-466f-a332-3a71cc7df85c admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:31.541609 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b3ad2-d855-466f-a332-3a71cc7df85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:31.541880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b3ad2-d855-466f-a332-3a71cc7df85c admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:31.543188 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b3ad2-d855-466f-a332-3a71cc7df85c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:31.545028 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b3ad2-d855-466f-a332-3a71cc7df85c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:31.653850 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1324/2659] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:02:31 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:31.655134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf382e-a47d-4416-aa91-594ff55de517 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:31.670188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf382e-a47d-4416-aa91-594ff55de517 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:31.671713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b987f-33f4-4c48-8451-1574754312db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:31.672457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b987f-33f4-4c48-8451-1574754312db admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:31.672807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b987f-33f4-4c48-8451-1574754312db admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:31.673163 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b987f-33f4-4c48-8451-1574754312db admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:31.673932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b987f-33f4-4c48-8451-1574754312db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:31.675532 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b987f-33f4-4c48-8451-1574754312db admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:31.687461 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1336/2660] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:31.691592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b3ad2-d855-466f-a332-3a71cc7df85c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:31.703079 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b3ad2-d855-466f-a332-3a71cc7df85c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:31.708483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e1969-2cd1-4c5d-9720-bd5058b58f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:31.709163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e1969-2cd1-4c5d-9720-bd5058b58f6f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:31.714439 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e1969-2cd1-4c5d-9720-bd5058b58f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:31.714439 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e1969-2cd1-4c5d-9720-bd5058b58f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:31.714439 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e1969-2cd1-4c5d-9720-bd5058b58f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:31.714439 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e1969-2cd1-4c5d-9720-bd5058b58f6f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:31.723847 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1325/2661] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:31.728707 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b987f-33f4-4c48-8451-1574754312db admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:31.739452 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b987f-33f4-4c48-8451-1574754312db admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:31.744840 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e1969-2cd1-4c5d-9720-bd5058b58f6f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:31.745118 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e17ff-954e-4478-a1aa-ac53352a9218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:31.745874 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e17ff-954e-4478-a1aa-ac53352a9218 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:31.746181 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e17ff-954e-4478-a1aa-ac53352a9218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:31.746470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e17ff-954e-4478-a1aa-ac53352a9218 admin admin] PATH_INFO: `/v3/projects/ca1fabba58504cdba84e334bd3cf9513/users/ac6e4dc226994688988e278c8df86467/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:31.748917 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7c5e1969-2cd1-4c5d-9720-bd5058b58f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:31.765407 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e1969-2cd1-4c5d-9720-bd5058b58f6f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:31.770883 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921e6c5-9de0-475d-8ca2-31d92a3fd621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:31.771802 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921e6c5-9de0-475d-8ca2-31d92a3fd621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:31.772104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921e6c5-9de0-475d-8ca2-31d92a3fd621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:31.772362 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921e6c5-9de0-475d-8ca2-31d92a3fd621 admin admin] PATH_INFO: `/v3/projects/0f8db42c7e7045bc9aff37eb82eb36e2` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:31.773042 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e17ff-954e-4478-a1aa-ac53352a9218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1fabba58504cdba84e334bd3cf9513, user_id=ac6e4dc226994688988e278c8df86467, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:31.773645 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921e6c5-9de0-475d-8ca2-31d92a3fd621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f8db42c7e7045bc9aff37eb82eb36e2)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:31.775570 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921e6c5-9de0-475d-8ca2-31d92a3fd621 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:31.776338 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e17ff-954e-4478-a1aa-ac53352a9218 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:31.922132 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1337/2662] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:31 2022] PUT /identity/v3/projects/ca1fabba58504cdba84e334bd3cf9513/users/ac6e4dc226994688988e278c8df86467/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:31.933530 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8f18d-c762-484b-ac78-8fda80592d7e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:31.933815 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8f18d-c762-484b-ac78-8fda80592d7e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:31.934087 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8f18d-c762-484b-ac78-8fda80592d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:31.945813 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8921e6c5-9de0-475d-8ca2-31d92a3fd621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f8db42c7e7045bc9aff37eb82eb36e2', 'request_id': 'req-8921e6c5-9de0-475d-8ca2-31d92a3fd621'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:31.951718 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8921e6c5-9de0-475d-8ca2-31d92a3fd621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f8db42c7e7045bc9aff37eb82eb36e2', 'request_id': 'req-8921e6c5-9de0-475d-8ca2-31d92a3fd621'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:31.958926 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8921e6c5-9de0-475d-8ca2-31d92a3fd621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f8db42c7e7045bc9aff37eb82eb36e2', 'request_id': 'req-8921e6c5-9de0-475d-8ca2-31d92a3fd621'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:31.965087 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-41f8f18d-c762-484b-ac78-8fda80592d7e None None] MFA Rules not processed for user `ac6e4dc226994688988e278c8df86467`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:31.966439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-41f8f18d-c762-484b-ac78-8fda80592d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:32.034218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1338/2663] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:02:32.046143 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8f18d-c762-484b-ac78-8fda80592d7e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:32.047509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-41f8f18d-c762-484b-ac78-8fda80592d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:32.069395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:32.130895 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8f18d-c762-484b-ac78-8fda80592d7e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:32.136728 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881663ab-f28a-4676-8253-2cc53a80ba02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:32.137420 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881663ab-f28a-4676-8253-2cc53a80ba02 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:32.137768 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881663ab-f28a-4676-8253-2cc53a80ba02 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:32.137986 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881663ab-f28a-4676-8253-2cc53a80ba02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:32.140344 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8921e6c5-9de0-475d-8ca2-31d92a3fd621 admin admin] The token cache is being invalidate because project 0f8db42c7e7045bc9aff37eb82eb36e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:32.140616 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8921e6c5-9de0-475d-8ca2-31d92a3fd621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:32.141231 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8921e6c5-9de0-475d-8ca2-31d92a3fd621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:32.143642 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1326/2664] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:02:31 2022] DELETE /identity/v3/projects/0f8db42c7e7045bc9aff37eb82eb36e2 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:32.146522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881663ab-f28a-4676-8253-2cc53a80ba02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:32.150645 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921e6c5-9de0-475d-8ca2-31d92a3fd621 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:32.150789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881663ab-f28a-4676-8253-2cc53a80ba02 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:32.150899 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8921e6c5-9de0-475d-8ca2-31d92a3fd621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:32.158627 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1339/2665] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:02:32.223020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921e6c5-9de0-475d-8ca2-31d92a3fd621 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:32.228675 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656de92-cd61-426c-aea4-0f9ac04fb688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:32.229593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656de92-cd61-426c-aea4-0f9ac04fb688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:32.229869 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656de92-cd61-426c-aea4-0f9ac04fb688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:32.230144 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656de92-cd61-426c-aea4-0f9ac04fb688 admin admin] PATH_INFO: `/v3/users/9dd2b55155ab4c10bc92f854accf1db0` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:32.231973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656de92-cd61-426c-aea4-0f9ac04fb688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd2b55155ab4c10bc92f854accf1db0)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:32.234042 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656de92-cd61-426c-aea4-0f9ac04fb688 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:32.489999 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8656de92-cd61-426c-aea4-0f9ac04fb688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd2b55155ab4c10bc92f854accf1db0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:32.558786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8656de92-cd61-426c-aea4-0f9ac04fb688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd2b55155ab4c10bc92f854accf1db0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:32.559483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8656de92-cd61-426c-aea4-0f9ac04fb688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd2b55155ab4c10bc92f854accf1db0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:32.560150 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8656de92-cd61-426c-aea4-0f9ac04fb688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd2b55155ab4c10bc92f854accf1db0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:32.565411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=80,keystone:INSERT=5,keystone:DELETE=15 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:32.568533 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8656de92-cd61-426c-aea4-0f9ac04fb688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd2b55155ab4c10bc92f854accf1db0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:32.586612 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1327/2666] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:02:32 2022] DELETE /identity/v3/users/9dd2b55155ab4c10bc92f854accf1db0 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:02:32.999762 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d5e28-f145-48a6-9370-602d0b62ffb2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:33.000151 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d5e28-f145-48a6-9370-602d0b62ffb2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:33.000432 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d5e28-f145-48a6-9370-602d0b62ffb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:33.019191 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c10d5e28-f145-48a6-9370-602d0b62ffb2 None None] MFA Rules not processed for user `5d6ddab73db44710bcb5bba4c0cfbcfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:33.020622 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c10d5e28-f145-48a6-9370-602d0b62ffb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:33.079508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1340/2667] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:33.094891 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656de92-cd61-426c-aea4-0f9ac04fb688 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:33.096478 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8656de92-cd61-426c-aea4-0f9ac04fb688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:33.186517 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656de92-cd61-426c-aea4-0f9ac04fb688 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:33.191398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3fb1c-8334-4bc9-831a-0dcf6853ce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:33.192279 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3fb1c-8334-4bc9-831a-0dcf6853ce65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:33.192587 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3fb1c-8334-4bc9-831a-0dcf6853ce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:33.192862 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3fb1c-8334-4bc9-831a-0dcf6853ce65 admin admin] PATH_INFO: `/v3/projects/4cc6cb11a5b64291b8539a718a0a3128` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:33.194136 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3fb1c-8334-4bc9-831a-0dcf6853ce65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc6cb11a5b64291b8539a718a0a3128)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:33.196096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3fb1c-8334-4bc9-831a-0dcf6853ce65 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:33.307967 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a5b3fb1c-8334-4bc9-831a-0dcf6853ce65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc6cb11a5b64291b8539a718a0a3128', 'request_id': 'req-a5b3fb1c-8334-4bc9-831a-0dcf6853ce65'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:33.313722 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a5b3fb1c-8334-4bc9-831a-0dcf6853ce65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc6cb11a5b64291b8539a718a0a3128', 'request_id': 'req-a5b3fb1c-8334-4bc9-831a-0dcf6853ce65'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:33.320277 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a5b3fb1c-8334-4bc9-831a-0dcf6853ce65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc6cb11a5b64291b8539a718a0a3128', 'request_id': 'req-a5b3fb1c-8334-4bc9-831a-0dcf6853ce65'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:33.411187 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a5b3fb1c-8334-4bc9-831a-0dcf6853ce65 admin admin] The token cache is being invalidate because project 4cc6cb11a5b64291b8539a718a0a3128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:33.411591 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a5b3fb1c-8334-4bc9-831a-0dcf6853ce65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:33.412438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a5b3fb1c-8334-4bc9-831a-0dcf6853ce65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:33.414126 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1328/2668] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:02:33 2022] DELETE /identity/v3/projects/4cc6cb11a5b64291b8539a718a0a3128 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:02:33.419460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e0124-30eb-479d-85a3-b4ec56ff22f1 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:33.420263 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e0124-30eb-479d-85a3-b4ec56ff22f1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:33.420263 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e0124-30eb-479d-85a3-b4ec56ff22f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:33.440636 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-769e0124-30eb-479d-85a3-b4ec56ff22f1 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:33.441879 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-769e0124-30eb-479d-85a3-b4ec56ff22f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:33.508902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1341/2669] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:33.517769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e6e61-65d5-46d3-b1dd-ce7e84fec0f8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:33.518056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e6e61-65d5-46d3-b1dd-ce7e84fec0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:33.518321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e6e61-65d5-46d3-b1dd-ce7e84fec0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:33.539038 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a98e6e61-65d5-46d3-b1dd-ce7e84fec0f8 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:33.540350 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a98e6e61-65d5-46d3-b1dd-ce7e84fec0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:33.549709 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1329/2670] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:02:33.554456 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e0124-30eb-479d-85a3-b4ec56ff22f1 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:33.564387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e0124-30eb-479d-85a3-b4ec56ff22f1 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:33.569441 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafec7a-082c-4a14-b9d9-3e5667b9cf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:33.570158 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafec7a-082c-4a14-b9d9-3e5667b9cf6c admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:33.570414 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafec7a-082c-4a14-b9d9-3e5667b9cf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:33.570717 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafec7a-082c-4a14-b9d9-3e5667b9cf6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:33.571538 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafec7a-082c-4a14-b9d9-3e5667b9cf6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:02:33.571842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafec7a-082c-4a14-b9d9-3e5667b9cf6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:33.573728 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafec7a-082c-4a14-b9d9-3e5667b9cf6c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:33.589740 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1342/2671] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:02:33.591240 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e6e61-65d5-46d3-b1dd-ce7e84fec0f8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:33.601890 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e6e61-65d5-46d3-b1dd-ce7e84fec0f8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:33.606983 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f68d5-8ebf-4cad-a694-587e1c75a3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:33.607651 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f68d5-8ebf-4cad-a694-587e1c75a3f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:33.607937 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f68d5-8ebf-4cad-a694-587e1c75a3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:33.608363 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f68d5-8ebf-4cad-a694-587e1c75a3f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:33.612150 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f68d5-8ebf-4cad-a694-587e1c75a3f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:33.612150 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f68d5-8ebf-4cad-a694-587e1c75a3f0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:33.729087 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1330/2672] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:02:33 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:33.733373 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafec7a-082c-4a14-b9d9-3e5667b9cf6c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:33.743913 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafec7a-082c-4a14-b9d9-3e5667b9cf6c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:33.781346 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:33.807289 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b48f5e-7962-46f0-badb-78f32eb0b7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:33.807960 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b48f5e-7962-46f0-badb-78f32eb0b7a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:33.808334 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b48f5e-7962-46f0-badb-78f32eb0b7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:33.808571 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b48f5e-7962-46f0-badb-78f32eb0b7a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:33.809272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b48f5e-7962-46f0-badb-78f32eb0b7a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:33.811229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b48f5e-7962-46f0-badb-78f32eb0b7a4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:33.959032 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1343/2673] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:02:33 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:02:33.962979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f68d5-8ebf-4cad-a694-587e1c75a3f0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:33.974674 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f68d5-8ebf-4cad-a694-587e1c75a3f0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:33.979765 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf87905-1cc8-4b0a-8632-dbbf3b6b9f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:33.980671 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf87905-1cc8-4b0a-8632-dbbf3b6b9f98 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:33.980979 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf87905-1cc8-4b0a-8632-dbbf3b6b9f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:33.981746 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf87905-1cc8-4b0a-8632-dbbf3b6b9f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:33.982465 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf87905-1cc8-4b0a-8632-dbbf3b6b9f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:33.984810 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf87905-1cc8-4b0a-8632-dbbf3b6b9f98 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:34.003110 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1331/2674] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:34.008594 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b48f5e-7962-46f0-badb-78f32eb0b7a4 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:34.019535 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b48f5e-7962-46f0-badb-78f32eb0b7a4 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:34.024498 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52584021-4300-48b6-95af-a74b52c79c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:34.025322 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52584021-4300-48b6-95af-a74b52c79c5b admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:34.028681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52584021-4300-48b6-95af-a74b52c79c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:34.028681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52584021-4300-48b6-95af-a74b52c79c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:34.028681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52584021-4300-48b6-95af-a74b52c79c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:34.028681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52584021-4300-48b6-95af-a74b52c79c5b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:34.042850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1344/2675] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:02:34.044011 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf87905-1cc8-4b0a-8632-dbbf3b6b9f98 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:34.054798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf87905-1cc8-4b0a-8632-dbbf3b6b9f98 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:34.059127 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e7a1a-23e1-4689-8dfb-48d50f35229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:34.060199 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e7a1a-23e1-4689-8dfb-48d50f35229b admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:34.060485 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e7a1a-23e1-4689-8dfb-48d50f35229b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:34.060759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e7a1a-23e1-4689-8dfb-48d50f35229b admin admin] PATH_INFO: `/v3/projects/0a181aab6910428e920ed3c75af1be05/users/c2ead50944094b6d81ddd41cc28e81b3/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:34.080016 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e7a1a-23e1-4689-8dfb-48d50f35229b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a181aab6910428e920ed3c75af1be05, user_id=c2ead50944094b6d81ddd41cc28e81b3, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:34.082761 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e7a1a-23e1-4689-8dfb-48d50f35229b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:34.159458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1332/2676] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:34 2022] PUT /identity/v3/projects/0a181aab6910428e920ed3c75af1be05/users/c2ead50944094b6d81ddd41cc28e81b3/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:34.170922 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73917fde-11d0-440e-b64c-7c3ddab89e7b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:34.171209 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73917fde-11d0-440e-b64c-7c3ddab89e7b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:34.171489 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73917fde-11d0-440e-b64c-7c3ddab89e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:34.198448 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-73917fde-11d0-440e-b64c-7c3ddab89e7b None None] MFA Rules not processed for user `c2ead50944094b6d81ddd41cc28e81b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:34.199738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-73917fde-11d0-440e-b64c-7c3ddab89e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:34.279512 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1345/2677] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:34.285454 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e7a1a-23e1-4689-8dfb-48d50f35229b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:34.291746 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:34.355250 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e7a1a-23e1-4689-8dfb-48d50f35229b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:34.362897 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76557538-f8b8-4f0d-a76e-b4868afab44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:34.363683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76557538-f8b8-4f0d-a76e-b4868afab44b admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:34.364350 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76557538-f8b8-4f0d-a76e-b4868afab44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:34.364705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76557538-f8b8-4f0d-a76e-b4868afab44b admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:34.365648 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76557538-f8b8-4f0d-a76e-b4868afab44b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:34.367900 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76557538-f8b8-4f0d-a76e-b4868afab44b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:34.480663 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1333/2678] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:02:34 2022] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:34.484764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73917fde-11d0-440e-b64c-7c3ddab89e7b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:34.496204 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73917fde-11d0-440e-b64c-7c3ddab89e7b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:34.552138 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c10f6-f7a1-46ca-ade4-9d0b770aeaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:34.552809 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c10f6-f7a1-46ca-ade4-9d0b770aeaf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:34.553088 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c10f6-f7a1-46ca-ade4-9d0b770aeaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:34.553401 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c10f6-f7a1-46ca-ade4-9d0b770aeaf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:34.554098 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c10f6-f7a1-46ca-ade4-9d0b770aeaf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:34.556502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c10f6-f7a1-46ca-ade4-9d0b770aeaf1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:34.634000 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1346/2679] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:02:34 2022] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:02:34.638390 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76557538-f8b8-4f0d-a76e-b4868afab44b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:34.649906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76557538-f8b8-4f0d-a76e-b4868afab44b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:34.654643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e831865-9bf6-42b7-8315-427c5555059f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:34.655308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e831865-9bf6-42b7-8315-427c5555059f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:34.655596 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e831865-9bf6-42b7-8315-427c5555059f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:34.655935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e831865-9bf6-42b7-8315-427c5555059f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:34.656657 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e831865-9bf6-42b7-8315-427c5555059f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:34.658380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e831865-9bf6-42b7-8315-427c5555059f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:34.670070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1334/2680] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:34.675038 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c10f6-f7a1-46ca-ade4-9d0b770aeaf1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:34.685529 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c10f6-f7a1-46ca-ade4-9d0b770aeaf1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:34.690773 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce9a82-ad61-4983-8289-480bbc89e9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:34.691662 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce9a82-ad61-4983-8289-480bbc89e9ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:34.693886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce9a82-ad61-4983-8289-480bbc89e9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:34.693886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce9a82-ad61-4983-8289-480bbc89e9ef admin admin] PATH_INFO: `/v3/projects/78051e9f9c3d41e9a5be02e40401e29c/users/20737a8c72ad42c2996ef7cf637d3532/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:34.708329 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce9a82-ad61-4983-8289-480bbc89e9ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=78051e9f9c3d41e9a5be02e40401e29c, user_id=20737a8c72ad42c2996ef7cf637d3532, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:34.711033 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce9a82-ad61-4983-8289-480bbc89e9ef admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:34.815753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1347/2681] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:34 2022] PUT /identity/v3/projects/78051e9f9c3d41e9a5be02e40401e29c/users/20737a8c72ad42c2996ef7cf637d3532/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:02:34.819686 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e831865-9bf6-42b7-8315-427c5555059f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:34.829773 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e831865-9bf6-42b7-8315-427c5555059f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:34.887173 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316891db-6b58-4a87-be4b-bfed1e986107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:34.887873 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316891db-6b58-4a87-be4b-bfed1e986107 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:34.888274 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316891db-6b58-4a87-be4b-bfed1e986107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:34.888554 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316891db-6b58-4a87-be4b-bfed1e986107 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:34.889282 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316891db-6b58-4a87-be4b-bfed1e986107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:34.890907 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316891db-6b58-4a87-be4b-bfed1e986107 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:34.901374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1335/2682] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:34.905508 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce9a82-ad61-4983-8289-480bbc89e9ef admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:34.916756 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce9a82-ad61-4983-8289-480bbc89e9ef admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:34.921661 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b124708-ca40-4731-832e-aab79b562607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:34.922572 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b124708-ca40-4731-832e-aab79b562607 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:34.922857 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b124708-ca40-4731-832e-aab79b562607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:34.923134 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b124708-ca40-4731-832e-aab79b562607 admin admin] PATH_INFO: `/v3/projects/78051e9f9c3d41e9a5be02e40401e29c/users/20737a8c72ad42c2996ef7cf637d3532/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:34.925129 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b124708-ca40-4731-832e-aab79b562607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78051e9f9c3d41e9a5be02e40401e29c, user_id=20737a8c72ad42c2996ef7cf637d3532, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:34.927822 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b124708-ca40-4731-832e-aab79b562607 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:34.931172 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:34.938725 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1348/2683] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:34 2022] PUT /identity/v3/projects/78051e9f9c3d41e9a5be02e40401e29c/users/20737a8c72ad42c2996ef7cf637d3532/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:34.949081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafed8b5-4a94-41cc-8a5f-56dcae918a21 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:34.949427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafed8b5-4a94-41cc-8a5f-56dcae918a21 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:34.949705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafed8b5-4a94-41cc-8a5f-56dcae918a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:34.977742 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dafed8b5-4a94-41cc-8a5f-56dcae918a21 None None] MFA Rules not processed for user `20737a8c72ad42c2996ef7cf637d3532`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:34.979012 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dafed8b5-4a94-41cc-8a5f-56dcae918a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:35.043110 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:35.048411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1336/2684] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:35.060771 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b124708-ca40-4731-832e-aab79b562607 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:35.069752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7b124708-ca40-4731-832e-aab79b562607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:35.124181 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b124708-ca40-4731-832e-aab79b562607 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:35.127888 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ef1c0-84b2-4c18-9128-253f050652dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:35.128661 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ef1c0-84b2-4c18-9128-253f050652dd service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:35.128940 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ef1c0-84b2-4c18-9128-253f050652dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:35.129205 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ef1c0-84b2-4c18-9128-253f050652dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:35.138295 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ef1c0-84b2-4c18-9128-253f050652dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:35.139734 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ef1c0-84b2-4c18-9128-253f050652dd service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:35.149124 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1349/2685] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:35.368280 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafed8b5-4a94-41cc-8a5f-56dcae918a21 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:35.378536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafed8b5-4a94-41cc-8a5f-56dcae918a21 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:35.382128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d38bba-deaf-438b-91fa-7cd1e706dd1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:35.383061 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d38bba-deaf-438b-91fa-7cd1e706dd1e service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:35.383061 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d38bba-deaf-438b-91fa-7cd1e706dd1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:35.383307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d38bba-deaf-438b-91fa-7cd1e706dd1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:35.443467 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d38bba-deaf-438b-91fa-7cd1e706dd1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:35.444976 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d38bba-deaf-438b-91fa-7cd1e706dd1e service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:35.455107 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1337/2686] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:35.484761 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ef1c0-84b2-4c18-9128-253f050652dd service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:35.484761 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e39ef1c0-84b2-4c18-9128-253f050652dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:35.556254 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ef1c0-84b2-4c18-9128-253f050652dd service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:35.561720 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247658a-20d9-4bff-8a1f-d835c56dfd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:35.562753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247658a-20d9-4bff-8a1f-d835c56dfd40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:35.563097 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247658a-20d9-4bff-8a1f-d835c56dfd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:35.563435 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247658a-20d9-4bff-8a1f-d835c56dfd40 admin admin] PATH_INFO: `/v3/users/ac6e4dc226994688988e278c8df86467` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:35.564760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247658a-20d9-4bff-8a1f-d835c56dfd40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac6e4dc226994688988e278c8df86467)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:35.566776 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247658a-20d9-4bff-8a1f-d835c56dfd40 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:35.908705 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4247658a-20d9-4bff-8a1f-d835c56dfd40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac6e4dc226994688988e278c8df86467'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:35.909585 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4247658a-20d9-4bff-8a1f-d835c56dfd40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac6e4dc226994688988e278c8df86467'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:35.919022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4247658a-20d9-4bff-8a1f-d835c56dfd40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac6e4dc226994688988e278c8df86467'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:36.003336 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d38bba-deaf-438b-91fa-7cd1e706dd1e service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:36.010713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4247658a-20d9-4bff-8a1f-d835c56dfd40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac6e4dc226994688988e278c8df86467'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:36.011339 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4247658a-20d9-4bff-8a1f-d835c56dfd40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac6e4dc226994688988e278c8df86467'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:36.015540 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d38bba-deaf-438b-91fa-7cd1e706dd1e service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:36.021428 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e2fb5-d791-4e1e-ade1-1228a3cef760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:36.022510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e2fb5-d791-4e1e-ade1-1228a3cef760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:36.022850 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e2fb5-d791-4e1e-ade1-1228a3cef760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:36.023198 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e2fb5-d791-4e1e-ade1-1228a3cef760 admin admin] PATH_INFO: `/v3/users/c2ead50944094b6d81ddd41cc28e81b3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:36.024462 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e2fb5-d791-4e1e-ade1-1228a3cef760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2ead50944094b6d81ddd41cc28e81b3)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:36.026532 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e2fb5-d791-4e1e-ade1-1228a3cef760 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:36.034625 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1350/2687] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:02:35 2022] DELETE /identity/v3/users/ac6e4dc226994688988e278c8df86467 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:36.039583 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68224ba3-e1de-476e-bca0-09c7c2ea4dd5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:36.039817 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68224ba3-e1de-476e-bca0-09c7c2ea4dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:36.040091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68224ba3-e1de-476e-bca0-09c7c2ea4dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:36.061394 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-68224ba3-e1de-476e-bca0-09c7c2ea4dd5 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:36.062526 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-68224ba3-e1de-476e-bca0-09c7c2ea4dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:36.076023 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:36.125240 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1351/2688] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:02:36.135484 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68224ba3-e1de-476e-bca0-09c7c2ea4dd5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:36.137067 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-68224ba3-e1de-476e-bca0-09c7c2ea4dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:36.197084 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68224ba3-e1de-476e-bca0-09c7c2ea4dd5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:36.200809 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d309c-408e-4248-8cf7-ee0d27d8ca71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:36.201482 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d309c-408e-4248-8cf7-ee0d27d8ca71 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:36.201762 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d309c-408e-4248-8cf7-ee0d27d8ca71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:36.202033 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d309c-408e-4248-8cf7-ee0d27d8ca71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:36.211443 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d309c-408e-4248-8cf7-ee0d27d8ca71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:36.218599 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d309c-408e-4248-8cf7-ee0d27d8ca71 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:36.222358 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1352/2689] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:02:36.304960 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-264e2fb5-d791-4e1e-ade1-1228a3cef760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2ead50944094b6d81ddd41cc28e81b3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:36.404095 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-264e2fb5-d791-4e1e-ade1-1228a3cef760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2ead50944094b6d81ddd41cc28e81b3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:36.404798 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-264e2fb5-d791-4e1e-ade1-1228a3cef760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2ead50944094b6d81ddd41cc28e81b3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:36.405689 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-264e2fb5-d791-4e1e-ade1-1228a3cef760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2ead50944094b6d81ddd41cc28e81b3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:36.413205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-264e2fb5-d791-4e1e-ade1-1228a3cef760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2ead50944094b6d81ddd41cc28e81b3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:36.432451 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1338/2690] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:02:36 2022] DELETE /identity/v3/users/c2ead50944094b6d81ddd41cc28e81b3 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:02:36.437025 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a6320-551b-4379-b718-bea07e8f6cbd None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:36.437336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a6320-551b-4379-b718-bea07e8f6cbd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:36.437615 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a6320-551b-4379-b718-bea07e8f6cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:36.456554 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1d7a6320-551b-4379-b718-bea07e8f6cbd None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:36.458086 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1d7a6320-551b-4379-b718-bea07e8f6cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:36.535322 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1353/2691] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:36.546194 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e2fb5-d791-4e1e-ade1-1228a3cef760 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:36.548435 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-264e2fb5-d791-4e1e-ade1-1228a3cef760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:36.609542 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e2fb5-d791-4e1e-ade1-1228a3cef760 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:36.613959 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb1340-d114-4655-bf9a-fa254bb5a7f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:36.620632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb1340-d114-4655-bf9a-fa254bb5a7f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:36.620632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb1340-d114-4655-bf9a-fa254bb5a7f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:36.620632 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb1340-d114-4655-bf9a-fa254bb5a7f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:36.628177 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb1340-d114-4655-bf9a-fa254bb5a7f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:36.629874 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb1340-d114-4655-bf9a-fa254bb5a7f5 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:36.641221 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1339/2692] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:36.766266 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a6320-551b-4379-b718-bea07e8f6cbd None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:36.768720 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1d7a6320-551b-4379-b718-bea07e8f6cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:36.781569 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a6320-551b-4379-b718-bea07e8f6cbd None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:36.786423 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779dd716-e7ed-4f4a-be09-60ee3a2c7d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:36.787355 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779dd716-e7ed-4f4a-be09-60ee3a2c7d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:36.787641 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779dd716-e7ed-4f4a-be09-60ee3a2c7d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:36.787919 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779dd716-e7ed-4f4a-be09-60ee3a2c7d61 admin admin] PATH_INFO: `/v3/projects/ca1fabba58504cdba84e334bd3cf9513` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:36.789175 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779dd716-e7ed-4f4a-be09-60ee3a2c7d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca1fabba58504cdba84e334bd3cf9513)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:36.791217 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779dd716-e7ed-4f4a-be09-60ee3a2c7d61 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:37.001404 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-779dd716-e7ed-4f4a-be09-60ee3a2c7d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca1fabba58504cdba84e334bd3cf9513', 'request_id': 'req-779dd716-e7ed-4f4a-be09-60ee3a2c7d61'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:37.170756 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-779dd716-e7ed-4f4a-be09-60ee3a2c7d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca1fabba58504cdba84e334bd3cf9513', 'request_id': 'req-779dd716-e7ed-4f4a-be09-60ee3a2c7d61'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:37.173215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:37.197841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-779dd716-e7ed-4f4a-be09-60ee3a2c7d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca1fabba58504cdba84e334bd3cf9513', 'request_id': 'req-779dd716-e7ed-4f4a-be09-60ee3a2c7d61'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:37.214412 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-779dd716-e7ed-4f4a-be09-60ee3a2c7d61 admin admin] The token cache is being invalidate because project ca1fabba58504cdba84e334bd3cf9513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:37.214701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-779dd716-e7ed-4f4a-be09-60ee3a2c7d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:37.215362 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-779dd716-e7ed-4f4a-be09-60ee3a2c7d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:37.216928 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1354/2693] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:02:36 2022] DELETE /identity/v3/projects/ca1fabba58504cdba84e334bd3cf9513 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:37.225337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead7999-8b1f-4417-a06e-bc57f61e6d74 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:37.225337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead7999-8b1f-4417-a06e-bc57f61e6d74 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:37.225337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead7999-8b1f-4417-a06e-bc57f61e6d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:37.249777 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6ead7999-8b1f-4417-a06e-bc57f61e6d74 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:37.251141 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6ead7999-8b1f-4417-a06e-bc57f61e6d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:37.257817 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:37.292416 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779dd716-e7ed-4f4a-be09-60ee3a2c7d61 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:37.293752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-779dd716-e7ed-4f4a-be09-60ee3a2c7d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:37.331182 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1340/2694] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:37.339056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8bfde-6923-487d-9f30-aafe1b535809 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:37.339347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8bfde-6923-487d-9f30-aafe1b535809 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:37.339650 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8bfde-6923-487d-9f30-aafe1b535809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:37.361163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dee8bfde-6923-487d-9f30-aafe1b535809 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:37.361163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dee8bfde-6923-487d-9f30-aafe1b535809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:37.369993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1341/2695] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:02:37.375376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8bfde-6923-487d-9f30-aafe1b535809 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:37.378985 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779dd716-e7ed-4f4a-be09-60ee3a2c7d61 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:37.384487 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df2b62-41b3-4de4-99c2-48289b1aade2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:37.385287 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8bfde-6923-487d-9f30-aafe1b535809 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:37.385617 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df2b62-41b3-4de4-99c2-48289b1aade2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:37.385933 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df2b62-41b3-4de4-99c2-48289b1aade2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:37.386228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df2b62-41b3-4de4-99c2-48289b1aade2 admin admin] PATH_INFO: `/v3/projects/0a181aab6910428e920ed3c75af1be05` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:37.388163 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df2b62-41b3-4de4-99c2-48289b1aade2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a181aab6910428e920ed3c75af1be05)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:37.390407 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e529d60-ba64-44c1-98bc-dc590977e401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:37.390566 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df2b62-41b3-4de4-99c2-48289b1aade2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:37.391546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e529d60-ba64-44c1-98bc-dc590977e401 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:37.391834 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e529d60-ba64-44c1-98bc-dc590977e401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:37.392112 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e529d60-ba64-44c1-98bc-dc590977e401 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:37.392882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e529d60-ba64-44c1-98bc-dc590977e401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:02:37.393189 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e529d60-ba64-44c1-98bc-dc590977e401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:37.395685 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e529d60-ba64-44c1-98bc-dc590977e401 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:37.407918 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1342/2696] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:02:37.413197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e529d60-ba64-44c1-98bc-dc590977e401 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:37.423520 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e529d60-ba64-44c1-98bc-dc590977e401 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:37.429063 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba5be4-2b40-4308-b830-3f2c8051ef48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:37.429763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba5be4-2b40-4308-b830-3f2c8051ef48 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:37.434251 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba5be4-2b40-4308-b830-3f2c8051ef48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:37.434251 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba5be4-2b40-4308-b830-3f2c8051ef48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:37.434251 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba5be4-2b40-4308-b830-3f2c8051ef48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:37.434251 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba5be4-2b40-4308-b830-3f2c8051ef48 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:37.547625 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-98df2b62-41b3-4de4-99c2-48289b1aade2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a181aab6910428e920ed3c75af1be05', 'request_id': 'req-98df2b62-41b3-4de4-99c2-48289b1aade2'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:37.583213 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1343/2697] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:02:37 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:02:37.587384 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba5be4-2b40-4308-b830-3f2c8051ef48 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:37.666195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba5be4-2b40-4308-b830-3f2c8051ef48 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:37.667107 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-98df2b62-41b3-4de4-99c2-48289b1aade2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a181aab6910428e920ed3c75af1be05', 'request_id': 'req-98df2b62-41b3-4de4-99c2-48289b1aade2'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:37.671026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5f5ab-5508-46d2-b45d-ca90b3e61e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:37.671652 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5f5ab-5508-46d2-b45d-ca90b3e61e44 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:37.671938 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5f5ab-5508-46d2-b45d-ca90b3e61e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:37.672214 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5f5ab-5508-46d2-b45d-ca90b3e61e44 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:37.672906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5f5ab-5508-46d2-b45d-ca90b3e61e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:37.674805 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-98df2b62-41b3-4de4-99c2-48289b1aade2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a181aab6910428e920ed3c75af1be05', 'request_id': 'req-98df2b62-41b3-4de4-99c2-48289b1aade2'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:37.675474 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5f5ab-5508-46d2-b45d-ca90b3e61e44 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:37.685862 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-98df2b62-41b3-4de4-99c2-48289b1aade2 admin admin] The token cache is being invalidate because project 0a181aab6910428e920ed3c75af1be05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:37.686157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-98df2b62-41b3-4de4-99c2-48289b1aade2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:37.686830 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-98df2b62-41b3-4de4-99c2-48289b1aade2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:37.688550 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1355/2698] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:02:37 2022] DELETE /identity/v3/projects/0a181aab6910428e920ed3c75af1be05 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:02:37.692592 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df2b62-41b3-4de4-99c2-48289b1aade2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:37.694022 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-98df2b62-41b3-4de4-99c2-48289b1aade2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:37.749325 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1344/2699] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:02:37 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:02:37.753372 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5f5ab-5508-46d2-b45d-ca90b3e61e44 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:37.755770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a2d5f5ab-5508-46d2-b45d-ca90b3e61e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:37.769776 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5f5ab-5508-46d2-b45d-ca90b3e61e44 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:37.772895 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df2b62-41b3-4de4-99c2-48289b1aade2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:37.774611 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d6a3e-82f9-45a4-a3d3-3cad2c084a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:37.775291 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d6a3e-82f9-45a4-a3d3-3cad2c084a5b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:37.776912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d6a3e-82f9-45a4-a3d3-3cad2c084a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:37.776912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d6a3e-82f9-45a4-a3d3-3cad2c084a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:37.777094 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d6a3e-82f9-45a4-a3d3-3cad2c084a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:37.778940 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d6a3e-82f9-45a4-a3d3-3cad2c084a5b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:37.779436 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd790fd-c5c0-4867-b98a-bba0e09fbba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:37.780899 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd790fd-c5c0-4867-b98a-bba0e09fbba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:37.780899 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd790fd-c5c0-4867-b98a-bba0e09fbba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:37.781102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd790fd-c5c0-4867-b98a-bba0e09fbba9 admin admin] PATH_INFO: `/v3/users/20737a8c72ad42c2996ef7cf637d3532` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:37.782898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd790fd-c5c0-4867-b98a-bba0e09fbba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20737a8c72ad42c2996ef7cf637d3532)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:37.785659 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd790fd-c5c0-4867-b98a-bba0e09fbba9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:37.792401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1345/2700] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:02:37.796791 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d6a3e-82f9-45a4-a3d3-3cad2c084a5b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:37.807435 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d6a3e-82f9-45a4-a3d3-3cad2c084a5b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:37.813037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c2001-6251-499a-9874-afb0bc3ddd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:37.813773 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c2001-6251-499a-9874-afb0bc3ddd23 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:37.814196 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c2001-6251-499a-9874-afb0bc3ddd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:37.814480 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c2001-6251-499a-9874-afb0bc3ddd23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:37.815358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c2001-6251-499a-9874-afb0bc3ddd23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:37.817155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c2001-6251-499a-9874-afb0bc3ddd23 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:37.831652 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1346/2701] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:02:37.835140 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c2001-6251-499a-9874-afb0bc3ddd23 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:37.847441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c2001-6251-499a-9874-afb0bc3ddd23 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:37.856866 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed443442-3bc5-49fa-a8d3-976aa3f714b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:37.863156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed443442-3bc5-49fa-a8d3-976aa3f714b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:37.863156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed443442-3bc5-49fa-a8d3-976aa3f714b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:37.863156 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed443442-3bc5-49fa-a8d3-976aa3f714b3 admin admin] PATH_INFO: `/v3/projects/67decd495af2475aa3b850c7a3f675d7/users/0e01711239484f74be0850cbfd5b2638/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:37.891893 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed443442-3bc5-49fa-a8d3-976aa3f714b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67decd495af2475aa3b850c7a3f675d7, user_id=0e01711239484f74be0850cbfd5b2638, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:37.892510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed443442-3bc5-49fa-a8d3-976aa3f714b3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:38.087351 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1347/2702] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:37 2022] PUT /identity/v3/projects/67decd495af2475aa3b850c7a3f675d7/users/0e01711239484f74be0850cbfd5b2638/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:02:38.096399 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4cd790fd-c5c0-4867-b98a-bba0e09fbba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20737a8c72ad42c2996ef7cf637d3532'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:38.097407 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4cd790fd-c5c0-4867-b98a-bba0e09fbba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20737a8c72ad42c2996ef7cf637d3532'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:38.098117 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb1886-750d-4abb-9aa6-cd3f506baa30 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:38.098409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb1886-750d-4abb-9aa6-cd3f506baa30 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:38.098688 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb1886-750d-4abb-9aa6-cd3f506baa30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:38.105807 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4cd790fd-c5c0-4867-b98a-bba0e09fbba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20737a8c72ad42c2996ef7cf637d3532'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:38.129341 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f7bb1886-750d-4abb-9aa6-cd3f506baa30 None None] MFA Rules not processed for user `0e01711239484f74be0850cbfd5b2638`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:38.130579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f7bb1886-750d-4abb-9aa6-cd3f506baa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:38.200744 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1348/2703] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:38.206182 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb1886-750d-4abb-9aa6-cd3f506baa30 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:38.215370 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4cd790fd-c5c0-4867-b98a-bba0e09fbba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20737a8c72ad42c2996ef7cf637d3532'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:38.216035 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4cd790fd-c5c0-4867-b98a-bba0e09fbba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20737a8c72ad42c2996ef7cf637d3532'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:38.236066 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1356/2704] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:02:37 2022] DELETE /identity/v3/users/20737a8c72ad42c2996ef7cf637d3532 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:02:38.282192 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb1886-750d-4abb-9aa6-cd3f506baa30 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:38.354558 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5abfe1-f974-4571-afb5-7559314e9ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:38.355147 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5abfe1-f974-4571-afb5-7559314e9ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:38.355519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5abfe1-f974-4571-afb5-7559314e9ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:38.355859 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5abfe1-f974-4571-afb5-7559314e9ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:38.356935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5abfe1-f974-4571-afb5-7559314e9ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:38.358859 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5abfe1-f974-4571-afb5-7559314e9ad2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:38.519049 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1349/2705] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:02:38 2022] POST /identity/v3/projects => generated 381 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:02:38.521363 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd790fd-c5c0-4867-b98a-bba0e09fbba9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:38.522996 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4cd790fd-c5c0-4867-b98a-bba0e09fbba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:38.536524 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd790fd-c5c0-4867-b98a-bba0e09fbba9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:38.598092 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dde9ea-3fb6-405a-8e72-07412ad4dc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:38.598782 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dde9ea-3fb6-405a-8e72-07412ad4dc76 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:38.599215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dde9ea-3fb6-405a-8e72-07412ad4dc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:38.600472 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dde9ea-3fb6-405a-8e72-07412ad4dc76 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:38.601204 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dde9ea-3fb6-405a-8e72-07412ad4dc76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:38.603245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dde9ea-3fb6-405a-8e72-07412ad4dc76 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:38.680598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:38.686977 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1357/2706] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:02:38 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:38.692001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5abfe1-f974-4571-afb5-7559314e9ad2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:38.706904 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5abfe1-f974-4571-afb5-7559314e9ad2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:38.713006 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de2288-9a93-46be-85cf-12091a8962cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:38.716870 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de2288-9a93-46be-85cf-12091a8962cd admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:38.716870 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de2288-9a93-46be-85cf-12091a8962cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:38.716870 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de2288-9a93-46be-85cf-12091a8962cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:38.716870 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de2288-9a93-46be-85cf-12091a8962cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:38.716870 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de2288-9a93-46be-85cf-12091a8962cd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:38.730163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1350/2707] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:38.736291 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dde9ea-3fb6-405a-8e72-07412ad4dc76 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:38.743999 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:38.754006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dde9ea-3fb6-405a-8e72-07412ad4dc76 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:38.764945 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98f026-e822-4d0b-be62-0a71f0101f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:38.767103 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98f026-e822-4d0b-be62-0a71f0101f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:38.768425 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98f026-e822-4d0b-be62-0a71f0101f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:38.769148 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98f026-e822-4d0b-be62-0a71f0101f30 admin admin] PATH_INFO: `/v3/projects/5ee5d94588e04becb431fb0424802069/users/e48c76713cfa4fbf9d49c3dcdd338392/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:38.800833 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98f026-e822-4d0b-be62-0a71f0101f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee5d94588e04becb431fb0424802069, user_id=e48c76713cfa4fbf9d49c3dcdd338392, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:38.806572 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98f026-e822-4d0b-be62-0a71f0101f30 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:38.995006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1358/2708] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:38 2022] PUT /identity/v3/projects/5ee5d94588e04becb431fb0424802069/users/e48c76713cfa4fbf9d49c3dcdd338392/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:39.003119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de2288-9a93-46be-85cf-12091a8962cd admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:39.028352 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de2288-9a93-46be-85cf-12091a8962cd admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:39.028497 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98f026-e822-4d0b-be62-0a71f0101f30 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:39.028497 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1c98f026-e822-4d0b-be62-0a71f0101f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:39.107165 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d03c8c-1795-4cf4-8288-afcb2002b1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:39.108023 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d03c8c-1795-4cf4-8288-afcb2002b1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:39.109205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d03c8c-1795-4cf4-8288-afcb2002b1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:39.109205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d03c8c-1795-4cf4-8288-afcb2002b1e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:39.110175 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d03c8c-1795-4cf4-8288-afcb2002b1e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:39.112958 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d03c8c-1795-4cf4-8288-afcb2002b1e4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:39.131854 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1351/2709] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:39.136575 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d03c8c-1795-4cf4-8288-afcb2002b1e4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:39.152338 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d03c8c-1795-4cf4-8288-afcb2002b1e4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:39.158344 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780ba35-f410-4b0d-b5b2-9cbeeba5dcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:39.160257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780ba35-f410-4b0d-b5b2-9cbeeba5dcc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:39.162247 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780ba35-f410-4b0d-b5b2-9cbeeba5dcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:39.162577 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780ba35-f410-4b0d-b5b2-9cbeeba5dcc1 admin admin] PATH_INFO: `/v3/projects/5ee5d94588e04becb431fb0424802069/users/e48c76713cfa4fbf9d49c3dcdd338392/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:39.165217 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780ba35-f410-4b0d-b5b2-9cbeeba5dcc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee5d94588e04becb431fb0424802069, user_id=e48c76713cfa4fbf9d49c3dcdd338392, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:39.169371 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98f026-e822-4d0b-be62-0a71f0101f30 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:39.169519 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780ba35-f410-4b0d-b5b2-9cbeeba5dcc1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:39.176121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eccb60-c05c-4f98-9179-f855349343c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:39.177044 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eccb60-c05c-4f98-9179-f855349343c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:39.177461 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eccb60-c05c-4f98-9179-f855349343c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:39.177765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eccb60-c05c-4f98-9179-f855349343c9 admin admin] PATH_INFO: `/v3/projects/78051e9f9c3d41e9a5be02e40401e29c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:39.179858 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eccb60-c05c-4f98-9179-f855349343c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78051e9f9c3d41e9a5be02e40401e29c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:39.182158 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eccb60-c05c-4f98-9179-f855349343c9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:39.190368 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1352/2710] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:39 2022] PUT /identity/v3/projects/5ee5d94588e04becb431fb0424802069/users/e48c76713cfa4fbf9d49c3dcdd338392/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:39.203571 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89771bc-0086-4743-abbe-f9c7658ae208 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:39.204138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89771bc-0086-4743-abbe-f9c7658ae208 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:39.204617 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89771bc-0086-4743-abbe-f9c7658ae208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:39.237525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a89771bc-0086-4743-abbe-f9c7658ae208 None None] MFA Rules not processed for user `e48c76713cfa4fbf9d49c3dcdd338392`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:39.238770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a89771bc-0086-4743-abbe-f9c7658ae208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:39.318624 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1353/2711] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:39.320916 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-36eccb60-c05c-4f98-9179-f855349343c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78051e9f9c3d41e9a5be02e40401e29c', 'request_id': 'req-36eccb60-c05c-4f98-9179-f855349343c9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:39.331546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89771bc-0086-4743-abbe-f9c7658ae208 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:39.332916 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a89771bc-0086-4743-abbe-f9c7658ae208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:39.394007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89771bc-0086-4743-abbe-f9c7658ae208 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:39.404433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-36eccb60-c05c-4f98-9179-f855349343c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78051e9f9c3d41e9a5be02e40401e29c', 'request_id': 'req-36eccb60-c05c-4f98-9179-f855349343c9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:39.425493 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-36eccb60-c05c-4f98-9179-f855349343c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78051e9f9c3d41e9a5be02e40401e29c', 'request_id': 'req-36eccb60-c05c-4f98-9179-f855349343c9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:39.454566 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-36eccb60-c05c-4f98-9179-f855349343c9 admin admin] The token cache is being invalidate because project 78051e9f9c3d41e9a5be02e40401e29c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:39.455141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-36eccb60-c05c-4f98-9179-f855349343c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:39.457499 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-36eccb60-c05c-4f98-9179-f855349343c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:39.463158 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1359/2712] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:02:39 2022] DELETE /identity/v3/projects/78051e9f9c3d41e9a5be02e40401e29c => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:39.465317 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01658638-655b-424e-ab2a-6427f729ae42 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:39.465721 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01658638-655b-424e-ab2a-6427f729ae42 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:39.466177 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01658638-655b-424e-ab2a-6427f729ae42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:39.494033 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:39.495428 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99227a2e-92d9-4735-8130-351cf3074cba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:39.496162 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99227a2e-92d9-4735-8130-351cf3074cba service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:39.496447 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99227a2e-92d9-4735-8130-351cf3074cba service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:39.496732 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99227a2e-92d9-4735-8130-351cf3074cba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:39.500385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-01658638-655b-424e-ab2a-6427f729ae42 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:39.503948 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-99227a2e-92d9-4735-8130-351cf3074cba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:39.515864 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-01658638-655b-424e-ab2a-6427f729ae42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:39.612521 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1360/2713] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:39.613856 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99227a2e-92d9-4735-8130-351cf3074cba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:39.615647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99227a2e-92d9-4735-8130-351cf3074cba service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:39.626138 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f5908-21e8-4849-ab72-170aaf3984d2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:39.626842 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f5908-21e8-4849-ab72-170aaf3984d2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:39.627496 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f5908-21e8-4849-ab72-170aaf3984d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:39.628415 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1354/2714] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:02:39.652692 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b05f5908-21e8-4849-ab72-170aaf3984d2 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:39.654292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b05f5908-21e8-4849-ab72-170aaf3984d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:39.667048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1361/2715] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:39.672643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99227a2e-92d9-4735-8130-351cf3074cba service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:39.686943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99227a2e-92d9-4735-8130-351cf3074cba service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:39.697653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba3993-9443-4de5-bb5d-3b37eb3cb92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:39.697653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba3993-9443-4de5-bb5d-3b37eb3cb92b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:39.697653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba3993-9443-4de5-bb5d-3b37eb3cb92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:39.697653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba3993-9443-4de5-bb5d-3b37eb3cb92b admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:39.698179 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba3993-9443-4de5-bb5d-3b37eb3cb92b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:02:39.698179 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba3993-9443-4de5-bb5d-3b37eb3cb92b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:39.698179 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba3993-9443-4de5-bb5d-3b37eb3cb92b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:39.711791 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1355/2716] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:02:39.722536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f5908-21e8-4849-ab72-170aaf3984d2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:39.730864 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:DELETE=9,keystone:SELECT=86,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:39.736214 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f5908-21e8-4849-ab72-170aaf3984d2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:39.741896 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d5fea-087a-4999-8017-cff56ba5d7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:39.744216 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d5fea-087a-4999-8017-cff56ba5d7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:39.744528 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d5fea-087a-4999-8017-cff56ba5d7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:39.744779 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d5fea-087a-4999-8017-cff56ba5d7d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:39.745538 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d5fea-087a-4999-8017-cff56ba5d7d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:39.747599 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d5fea-087a-4999-8017-cff56ba5d7d3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:39.847253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1362/2717] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:02:39 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:39.851929 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba3993-9443-4de5-bb5d-3b37eb3cb92b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:39.876824 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba3993-9443-4de5-bb5d-3b37eb3cb92b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:39.958077 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e5338-5051-4366-a83c-ba7812b11deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:39.958772 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e5338-5051-4366-a83c-ba7812b11deb admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:39.959064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e5338-5051-4366-a83c-ba7812b11deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:39.959337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e5338-5051-4366-a83c-ba7812b11deb admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:39.960073 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e5338-5051-4366-a83c-ba7812b11deb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:39.962248 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e5338-5051-4366-a83c-ba7812b11deb admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:40.176551 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1356/2718] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:02:39 2022] POST /identity/v3/users => generated 287 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:40.180919 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d5fea-087a-4999-8017-cff56ba5d7d3 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:40.191750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d5fea-087a-4999-8017-cff56ba5d7d3 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:40.196537 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764ab81-71c2-4e68-a703-0790e35c3aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:40.197226 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764ab81-71c2-4e68-a703-0790e35c3aad admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:40.197542 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764ab81-71c2-4e68-a703-0790e35c3aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:40.197815 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764ab81-71c2-4e68-a703-0790e35c3aad admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:40.198536 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764ab81-71c2-4e68-a703-0790e35c3aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:40.200139 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764ab81-71c2-4e68-a703-0790e35c3aad admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:40.211609 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1363/2719] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:40.216334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e5338-5051-4366-a83c-ba7812b11deb admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:40.229612 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e5338-5051-4366-a83c-ba7812b11deb admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:40.234336 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e648e-8d22-4222-8f79-a614185a0093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:40.235034 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e648e-8d22-4222-8f79-a614185a0093 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:40.235316 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e648e-8d22-4222-8f79-a614185a0093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:40.235585 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e648e-8d22-4222-8f79-a614185a0093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:40.236304 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e648e-8d22-4222-8f79-a614185a0093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:40.237995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e648e-8d22-4222-8f79-a614185a0093 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:40.249006 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1357/2720] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:40.253205 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764ab81-71c2-4e68-a703-0790e35c3aad admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:40.263564 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764ab81-71c2-4e68-a703-0790e35c3aad admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:40.269002 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75173b8-e701-489e-aded-7b91d520be0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:40.269932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75173b8-e701-489e-aded-7b91d520be0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:40.270213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75173b8-e701-489e-aded-7b91d520be0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:40.270485 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75173b8-e701-489e-aded-7b91d520be0a admin admin] PATH_INFO: `/v3/projects/aa13d7d13a4c4f579185e8628ca7996b/users/e08afeeb8ac34e28ac36bdf9fa10dfd0/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:40.287810 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75173b8-e701-489e-aded-7b91d520be0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa13d7d13a4c4f579185e8628ca7996b, user_id=e08afeeb8ac34e28ac36bdf9fa10dfd0, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:40.290666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75173b8-e701-489e-aded-7b91d520be0a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:40.419390 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1364/2721] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:40 2022] PUT /identity/v3/projects/aa13d7d13a4c4f579185e8628ca7996b/users/e08afeeb8ac34e28ac36bdf9fa10dfd0/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:40.431391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17d18f-e6bf-4864-a296-cb789d335218 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:40.431391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17d18f-e6bf-4864-a296-cb789d335218 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:40.431622 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17d18f-e6bf-4864-a296-cb789d335218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:40.463095 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3a17d18f-e6bf-4864-a296-cb789d335218 None None] MFA Rules not processed for user `e08afeeb8ac34e28ac36bdf9fa10dfd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:40.464383 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3a17d18f-e6bf-4864-a296-cb789d335218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:40.522317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:40.547535 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1358/2722] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:40.553245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75173b8-e701-489e-aded-7b91d520be0a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:40.656471 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75173b8-e701-489e-aded-7b91d520be0a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:40.661924 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8010f4a-6225-4e6a-bd8a-22994c1cafd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:40.662601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8010f4a-6225-4e6a-bd8a-22994c1cafd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:40.662891 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8010f4a-6225-4e6a-bd8a-22994c1cafd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:40.663166 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8010f4a-6225-4e6a-bd8a-22994c1cafd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:40.663863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8010f4a-6225-4e6a-bd8a-22994c1cafd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:40.666226 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8010f4a-6225-4e6a-bd8a-22994c1cafd5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:40.780745 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1365/2723] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:02:40 2022] POST /identity/v3/projects => generated 373 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:40.782087 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17d18f-e6bf-4864-a296-cb789d335218 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:40.792935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17d18f-e6bf-4864-a296-cb789d335218 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:40.849551 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773bd2a-db5f-4802-8239-03f0ab216562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:40.850546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773bd2a-db5f-4802-8239-03f0ab216562 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:40.850935 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773bd2a-db5f-4802-8239-03f0ab216562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:40.851256 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773bd2a-db5f-4802-8239-03f0ab216562 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:40.851989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773bd2a-db5f-4802-8239-03f0ab216562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:40.854014 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773bd2a-db5f-4802-8239-03f0ab216562 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:40.976456 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1359/2724] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:02:40 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:02:40.980701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8010f4a-6225-4e6a-bd8a-22994c1cafd5 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:40.991801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8010f4a-6225-4e6a-bd8a-22994c1cafd5 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:40.996408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa02a8-49b0-4998-8855-91e003c15a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:40.997150 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa02a8-49b0-4998-8855-91e003c15a77 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:40.997478 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa02a8-49b0-4998-8855-91e003c15a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:40.997760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa02a8-49b0-4998-8855-91e003c15a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:40.998533 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa02a8-49b0-4998-8855-91e003c15a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:41.000119 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa02a8-49b0-4998-8855-91e003c15a77 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:41.011227 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1366/2725] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:41.015471 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773bd2a-db5f-4802-8239-03f0ab216562 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:41.025596 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773bd2a-db5f-4802-8239-03f0ab216562 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:41.030378 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df668a63-5f98-4647-a574-b9e22558aa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:41.031316 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df668a63-5f98-4647-a574-b9e22558aa96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:41.031597 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df668a63-5f98-4647-a574-b9e22558aa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:41.031861 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df668a63-5f98-4647-a574-b9e22558aa96 admin admin] PATH_INFO: `/v3/projects/5d42767924474a6e949b0f4c0321cbff/users/4b6fadbfef7549a8b10ff4d20f122793/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:41.047436 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df668a63-5f98-4647-a574-b9e22558aa96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d42767924474a6e949b0f4c0321cbff, user_id=4b6fadbfef7549a8b10ff4d20f122793, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:41.050997 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df668a63-5f98-4647-a574-b9e22558aa96 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:41.223364 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1360/2726] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:41 2022] PUT /identity/v3/projects/5d42767924474a6e949b0f4c0321cbff/users/4b6fadbfef7549a8b10ff4d20f122793/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:41.227638 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa02a8-49b0-4998-8855-91e003c15a77 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:41.247593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa02a8-49b0-4998-8855-91e003c15a77 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:41.277473 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df668a63-5f98-4647-a574-b9e22558aa96 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:41.321369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8576d8-1a96-457d-b20b-e730693eedce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:41.322015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8576d8-1a96-457d-b20b-e730693eedce admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:41.322299 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8576d8-1a96-457d-b20b-e730693eedce admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:41.322572 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8576d8-1a96-457d-b20b-e730693eedce admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:41.323293 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8576d8-1a96-457d-b20b-e730693eedce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:41.324888 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8576d8-1a96-457d-b20b-e730693eedce admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:41.334903 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1367/2727] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:41.338891 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8576d8-1a96-457d-b20b-e730693eedce admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:41.349600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8576d8-1a96-457d-b20b-e730693eedce admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:41.353061 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df668a63-5f98-4647-a574-b9e22558aa96 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:41.354691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e98b73-35fb-4217-81ca-19c0eb4ef0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:41.355650 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e98b73-35fb-4217-81ca-19c0eb4ef0b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:41.356007 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e98b73-35fb-4217-81ca-19c0eb4ef0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:41.356356 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e98b73-35fb-4217-81ca-19c0eb4ef0b0 admin admin] PATH_INFO: `/v3/projects/5d42767924474a6e949b0f4c0321cbff/users/4b6fadbfef7549a8b10ff4d20f122793/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:41.357874 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e878ef-9f4b-49b6-bd07-3c01783d568f tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48c76713cfa4fbf9d49c3dcdd338392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee5d94588e04becb431fb0424802069', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:41.358510 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e98b73-35fb-4217-81ca-19c0eb4ef0b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d42767924474a6e949b0f4c0321cbff, user_id=4b6fadbfef7549a8b10ff4d20f122793, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:41.358616 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e878ef-9f4b-49b6-bd07-3c01783d568f tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:41.358847 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e878ef-9f4b-49b6-bd07-3c01783d568f tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:41.359092 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e878ef-9f4b-49b6-bd07-3c01783d568f tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:41.359906 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e878ef-9f4b-49b6-bd07-3c01783d568f tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:02:41.360147 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e878ef-9f4b-49b6-bd07-3c01783d568f tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:41.362121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e98b73-35fb-4217-81ca-19c0eb4ef0b0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:41.362391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e878ef-9f4b-49b6-bd07-3c01783d568f tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:41.372948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1368/2728] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:41 2022] PUT /identity/v3/projects/5d42767924474a6e949b0f4c0321cbff/users/4b6fadbfef7549a8b10ff4d20f122793/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:02:41.376138 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1361/2729] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:02:41.382610 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e98b73-35fb-4217-81ca-19c0eb4ef0b0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:41.383134 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c254d-447d-4367-8354-7b6d74c6b6ae None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:41.383492 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c254d-447d-4367-8354-7b6d74c6b6ae None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:41.383843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c254d-447d-4367-8354-7b6d74c6b6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:41.411662 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-aa6c254d-447d-4367-8354-7b6d74c6b6ae None None] MFA Rules not processed for user `4b6fadbfef7549a8b10ff4d20f122793`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:41.412981 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-aa6c254d-447d-4367-8354-7b6d74c6b6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:41.423369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:41.456563 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e98b73-35fb-4217-81ca-19c0eb4ef0b0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:41.461594 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2f72a-6d8f-402c-8508-db1b38e0ba48 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48c76713cfa4fbf9d49c3dcdd338392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee5d94588e04becb431fb0424802069', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:41.462261 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2f72a-6d8f-402c-8508-db1b38e0ba48 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:41.462549 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2f72a-6d8f-402c-8508-db1b38e0ba48 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:41.462837 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2f72a-6d8f-402c-8508-db1b38e0ba48 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:41.463527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2f72a-6d8f-402c-8508-db1b38e0ba48 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:41.465456 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2f72a-6d8f-402c-8508-db1b38e0ba48 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:41.488175 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1362/2730] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:41.499272 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c254d-447d-4367-8354-7b6d74c6b6ae None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:41.500637 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-aa6c254d-447d-4367-8354-7b6d74c6b6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:41.556726 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c254d-447d-4367-8354-7b6d74c6b6ae None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:41.560345 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb7a0a-1109-4220-959a-4e75708f8ef4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:41.560986 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb7a0a-1109-4220-959a-4e75708f8ef4 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:41.561897 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb7a0a-1109-4220-959a-4e75708f8ef4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:41.561897 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb7a0a-1109-4220-959a-4e75708f8ef4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:41.574387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1369/2731] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:02:41 2022] POST /identity/v3/projects => generated 354 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:41.575739 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2f72a-6d8f-402c-8508-db1b38e0ba48 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:41.599678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:41.624232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb7a0a-1109-4220-959a-4e75708f8ef4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:41.625724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb7a0a-1109-4220-959a-4e75708f8ef4 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:41.634787 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1363/2732] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:02:41.637454 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2f72a-6d8f-402c-8508-db1b38e0ba48 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:41.641438 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2894f-9695-4d21-9572-d49a4cf84cb2 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48c76713cfa4fbf9d49c3dcdd338392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee5d94588e04becb431fb0424802069', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:41.642096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2894f-9695-4d21-9572-d49a4cf84cb2 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:41.642382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2894f-9695-4d21-9572-d49a4cf84cb2 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:41.643177 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2894f-9695-4d21-9572-d49a4cf84cb2 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:41.643897 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2894f-9695-4d21-9572-d49a4cf84cb2 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:02:41.644200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2894f-9695-4d21-9572-d49a4cf84cb2 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:41.645815 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2894f-9695-4d21-9572-d49a4cf84cb2 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:41.661332 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1370/2733] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:02:41.698140 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb7a0a-1109-4220-959a-4e75708f8ef4 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:41.710184 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb7a0a-1109-4220-959a-4e75708f8ef4 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:41.716085 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e6451-681e-4b52-ae44-a2b0cc4987e0 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48c76713cfa4fbf9d49c3dcdd338392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee5d94588e04becb431fb0424802069', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:41.716958 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e6451-681e-4b52-ae44-a2b0cc4987e0 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:41.717243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e6451-681e-4b52-ae44-a2b0cc4987e0 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:41.717747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e6451-681e-4b52-ae44-a2b0cc4987e0 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] PATH_INFO: `/v3/projects/b1dd1d9c67e6426c99bc322932ccdb89` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:41.718946 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e6451-681e-4b52-ae44-a2b0cc4987e0 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b1dd1d9c67e6426c99bc322932ccdb89)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:41.723669 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e6451-681e-4b52-ae44-a2b0cc4987e0 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:41.845348 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ce0e6451-681e-4b52-ae44-a2b0cc4987e0 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1dd1d9c67e6426c99bc322932ccdb89', 'request_id': 'req-ce0e6451-681e-4b52-ae44-a2b0cc4987e0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:41.851229 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ce0e6451-681e-4b52-ae44-a2b0cc4987e0 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1dd1d9c67e6426c99bc322932ccdb89', 'request_id': 'req-ce0e6451-681e-4b52-ae44-a2b0cc4987e0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:41.857568 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ce0e6451-681e-4b52-ae44-a2b0cc4987e0 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1dd1d9c67e6426c99bc322932ccdb89', 'request_id': 'req-ce0e6451-681e-4b52-ae44-a2b0cc4987e0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:41.986921 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ce0e6451-681e-4b52-ae44-a2b0cc4987e0 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] The token cache is being invalidate because project b1dd1d9c67e6426c99bc322932ccdb89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:41.987212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ce0e6451-681e-4b52-ae44-a2b0cc4987e0 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:41.987863 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ce0e6451-681e-4b52-ae44-a2b0cc4987e0 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:41.989512 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1364/2734] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:02:41 2022] DELETE /identity/v3/projects/b1dd1d9c67e6426c99bc322932ccdb89 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:42.444513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:42.774787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2894f-9695-4d21-9572-d49a4cf84cb2 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:42.776539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3de2894f-9695-4d21-9572-d49a4cf84cb2 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:42.797498 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:42.844089 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2894f-9695-4d21-9572-d49a4cf84cb2 tempest-VolumeQuotaClassesTest-1732178096 tempest-VolumeQuotaClassesTest-1732178096-project-admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:42.964345 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1381795-6581-445c-bbe5-0ebe97d96372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:42.965352 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1381795-6581-445c-bbe5-0ebe97d96372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:42.965555 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1381795-6581-445c-bbe5-0ebe97d96372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:42.965838 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1381795-6581-445c-bbe5-0ebe97d96372 admin admin] PATH_INFO: `/v3/users/0e01711239484f74be0850cbfd5b2638` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:42.967110 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1381795-6581-445c-bbe5-0ebe97d96372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e01711239484f74be0850cbfd5b2638)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:42.969123 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1381795-6581-445c-bbe5-0ebe97d96372 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:43.219903 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e1381795-6581-445c-bbe5-0ebe97d96372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e01711239484f74be0850cbfd5b2638'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:43.220616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e1381795-6581-445c-bbe5-0ebe97d96372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e01711239484f74be0850cbfd5b2638'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:43.228964 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e1381795-6581-445c-bbe5-0ebe97d96372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e01711239484f74be0850cbfd5b2638'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:43.329847 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e1381795-6581-445c-bbe5-0ebe97d96372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e01711239484f74be0850cbfd5b2638'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:43.331071 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e1381795-6581-445c-bbe5-0ebe97d96372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e01711239484f74be0850cbfd5b2638'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:43.350164 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1371/2735] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:02:42 2022] DELETE /identity/v3/users/0e01711239484f74be0850cbfd5b2638 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:43.355117 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd097f-7438-47d8-86ae-be395da328af None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:43.355683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd097f-7438-47d8-86ae-be395da328af None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:43.355809 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd097f-7438-47d8-86ae-be395da328af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:43.376069 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4cdd097f-7438-47d8-86ae-be395da328af None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:43.377820 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4cdd097f-7438-47d8-86ae-be395da328af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:43.387662 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:43.430183 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:43.440881 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1365/2736] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:43.450562 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1381795-6581-445c-bbe5-0ebe97d96372 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:43.452879 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e1381795-6581-445c-bbe5-0ebe97d96372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:43.521687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1381795-6581-445c-bbe5-0ebe97d96372 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:43.522112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe41b65-33c0-4a3d-bd56-5365ab8c47f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:43.522848 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe41b65-33c0-4a3d-bd56-5365ab8c47f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:43.523136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe41b65-33c0-4a3d-bd56-5365ab8c47f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:43.523418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe41b65-33c0-4a3d-bd56-5365ab8c47f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:43.534753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe41b65-33c0-4a3d-bd56-5365ab8c47f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:43.537510 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe41b65-33c0-4a3d-bd56-5365ab8c47f9 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:43.552403 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1372/2737] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:44.080699 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd097f-7438-47d8-86ae-be395da328af None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:44.082205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4cdd097f-7438-47d8-86ae-be395da328af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:44.095739 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd097f-7438-47d8-86ae-be395da328af None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:44.100741 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c27c4-de2f-4bea-883a-ce90b7c4c7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:44.101735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c27c4-de2f-4bea-883a-ce90b7c4c7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:44.102084 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c27c4-de2f-4bea-883a-ce90b7c4c7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:44.102436 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c27c4-de2f-4bea-883a-ce90b7c4c7c6 admin admin] PATH_INFO: `/v3/projects/67decd495af2475aa3b850c7a3f675d7` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:44.103655 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c27c4-de2f-4bea-883a-ce90b7c4c7c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67decd495af2475aa3b850c7a3f675d7)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:44.105703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c27c4-de2f-4bea-883a-ce90b7c4c7c6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:44.212321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-542c27c4-de2f-4bea-883a-ce90b7c4c7c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67decd495af2475aa3b850c7a3f675d7', 'request_id': 'req-542c27c4-de2f-4bea-883a-ce90b7c4c7c6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:44.218005 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-542c27c4-de2f-4bea-883a-ce90b7c4c7c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67decd495af2475aa3b850c7a3f675d7', 'request_id': 'req-542c27c4-de2f-4bea-883a-ce90b7c4c7c6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:44.224458 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-542c27c4-de2f-4bea-883a-ce90b7c4c7c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67decd495af2475aa3b850c7a3f675d7', 'request_id': 'req-542c27c4-de2f-4bea-883a-ce90b7c4c7c6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:44.312454 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-542c27c4-de2f-4bea-883a-ce90b7c4c7c6 admin admin] The token cache is being invalidate because project 67decd495af2475aa3b850c7a3f675d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:44.312716 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-542c27c4-de2f-4bea-883a-ce90b7c4c7c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:44.313402 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-542c27c4-de2f-4bea-883a-ce90b7c4c7c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:44.315526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1366/2738] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:02:44 2022] DELETE /identity/v3/projects/67decd495af2475aa3b850c7a3f675d7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:44.319557 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe41b65-33c0-4a3d-bd56-5365ab8c47f9 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:44.329870 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe41b65-33c0-4a3d-bd56-5365ab8c47f9 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:44.389941 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd478e7-7b44-43a7-9b23-7de1957adece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:44.390818 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd478e7-7b44-43a7-9b23-7de1957adece admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:44.391094 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd478e7-7b44-43a7-9b23-7de1957adece admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:44.391364 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd478e7-7b44-43a7-9b23-7de1957adece admin admin] PATH_INFO: `/v3/users/e48c76713cfa4fbf9d49c3dcdd338392` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:44.393213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd478e7-7b44-43a7-9b23-7de1957adece admin admin] RBAC: Authorizing `identity:delete_user(user_id=e48c76713cfa4fbf9d49c3dcdd338392)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:44.395122 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd478e7-7b44-43a7-9b23-7de1957adece admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:44.666321 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9fd478e7-7b44-43a7-9b23-7de1957adece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e48c76713cfa4fbf9d49c3dcdd338392'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:44.666809 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9fd478e7-7b44-43a7-9b23-7de1957adece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e48c76713cfa4fbf9d49c3dcdd338392'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:44.675439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9fd478e7-7b44-43a7-9b23-7de1957adece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e48c76713cfa4fbf9d49c3dcdd338392'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:44.833021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9fd478e7-7b44-43a7-9b23-7de1957adece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e48c76713cfa4fbf9d49c3dcdd338392'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:44.833617 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9fd478e7-7b44-43a7-9b23-7de1957adece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e48c76713cfa4fbf9d49c3dcdd338392'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:44.842596 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:44.853791 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1373/2739] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:02:44 2022] DELETE /identity/v3/users/e48c76713cfa4fbf9d49c3dcdd338392 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:45.405438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c27c4-de2f-4bea-883a-ce90b7c4c7c6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:45.409439 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-542c27c4-de2f-4bea-883a-ce90b7c4c7c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:45.421051 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c27c4-de2f-4bea-883a-ce90b7c4c7c6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:45.481693 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ee10e-beda-4ea1-a23d-f4ccd56d6b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:45.482566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ee10e-beda-4ea1-a23d-f4ccd56d6b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:45.482855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ee10e-beda-4ea1-a23d-f4ccd56d6b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:45.483131 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ee10e-beda-4ea1-a23d-f4ccd56d6b74 admin admin] PATH_INFO: `/v3/projects/5ee5d94588e04becb431fb0424802069` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:45.484340 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ee10e-beda-4ea1-a23d-f4ccd56d6b74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee5d94588e04becb431fb0424802069)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:45.486326 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ee10e-beda-4ea1-a23d-f4ccd56d6b74 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:45.660234 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:45.664375 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bf3ee10e-beda-4ea1-a23d-f4ccd56d6b74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee5d94588e04becb431fb0424802069', 'request_id': 'req-bf3ee10e-beda-4ea1-a23d-f4ccd56d6b74'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:45.670046 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bf3ee10e-beda-4ea1-a23d-f4ccd56d6b74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee5d94588e04becb431fb0424802069', 'request_id': 'req-bf3ee10e-beda-4ea1-a23d-f4ccd56d6b74'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:45.677536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bf3ee10e-beda-4ea1-a23d-f4ccd56d6b74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee5d94588e04becb431fb0424802069', 'request_id': 'req-bf3ee10e-beda-4ea1-a23d-f4ccd56d6b74'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:45.798288 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bf3ee10e-beda-4ea1-a23d-f4ccd56d6b74 admin admin] The token cache is being invalidate because project 5ee5d94588e04becb431fb0424802069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:45.799262 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bf3ee10e-beda-4ea1-a23d-f4ccd56d6b74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:45.800030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bf3ee10e-beda-4ea1-a23d-f4ccd56d6b74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:45.801655 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1367/2740] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:02:45 2022] DELETE /identity/v3/projects/5ee5d94588e04becb431fb0424802069 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:45.806586 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3b951-b85a-44e4-91c4-ea3790b4e6d3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:45.807084 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3b951-b85a-44e4-91c4-ea3790b4e6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:45.807184 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3b951-b85a-44e4-91c4-ea3790b4e6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:45.831384 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d6f3b951-b85a-44e4-91c4-ea3790b4e6d3 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:45.840464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d6f3b951-b85a-44e4-91c4-ea3790b4e6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:45.906075 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1374/2741] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:45.914913 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad840ced-21cd-48ae-9f15-2a7a84f18a0d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:45.915288 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad840ced-21cd-48ae-9f15-2a7a84f18a0d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:45.915638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad840ced-21cd-48ae-9f15-2a7a84f18a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:45.937801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ad840ced-21cd-48ae-9f15-2a7a84f18a0d None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:45.939168 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ad840ced-21cd-48ae-9f15-2a7a84f18a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:45.948293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1368/2742] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:02:45.952861 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3b951-b85a-44e4-91c4-ea3790b4e6d3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:45.962983 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3b951-b85a-44e4-91c4-ea3790b4e6d3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:45.972076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231169a-9bf3-41a3-8114-554801287c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:45.972076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231169a-9bf3-41a3-8114-554801287c37 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:45.972076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231169a-9bf3-41a3-8114-554801287c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:45.972076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231169a-9bf3-41a3-8114-554801287c37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:45.972743 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231169a-9bf3-41a3-8114-554801287c37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:02:45.972743 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231169a-9bf3-41a3-8114-554801287c37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:45.972743 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231169a-9bf3-41a3-8114-554801287c37 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:45.985790 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1375/2743] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:02:45.990653 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad840ced-21cd-48ae-9f15-2a7a84f18a0d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:46.012800 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad840ced-21cd-48ae-9f15-2a7a84f18a0d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:46.025209 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ed692-8e56-4368-ac3d-595306049ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:46.026125 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ed692-8e56-4368-ac3d-595306049ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:46.026471 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ed692-8e56-4368-ac3d-595306049ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:46.026813 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ed692-8e56-4368-ac3d-595306049ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:46.027585 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ed692-8e56-4368-ac3d-595306049ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:46.030071 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ed692-8e56-4368-ac3d-595306049ca4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:46.148677 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1369/2744] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:02:45 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:46.149934 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231169a-9bf3-41a3-8114-554801287c37 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:46.160793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231169a-9bf3-41a3-8114-554801287c37 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:46.215897 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62844f80-1429-4203-8cea-2a042ec1e33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:46.216565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62844f80-1429-4203-8cea-2a042ec1e33e admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:46.216866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62844f80-1429-4203-8cea-2a042ec1e33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:46.217121 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62844f80-1429-4203-8cea-2a042ec1e33e admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:46.217843 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62844f80-1429-4203-8cea-2a042ec1e33e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:46.219740 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62844f80-1429-4203-8cea-2a042ec1e33e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:46.331644 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1376/2745] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:02:46 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:46.335376 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ed692-8e56-4368-ac3d-595306049ca4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:46.345966 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ed692-8e56-4368-ac3d-595306049ca4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:46.350940 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a4423-b792-46a0-947d-76835b05672a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:46.351623 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a4423-b792-46a0-947d-76835b05672a admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:46.351902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a4423-b792-46a0-947d-76835b05672a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:46.352175 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a4423-b792-46a0-947d-76835b05672a admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:46.352888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a4423-b792-46a0-947d-76835b05672a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:46.354525 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a4423-b792-46a0-947d-76835b05672a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:46.365065 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1370/2746] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:46.369275 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62844f80-1429-4203-8cea-2a042ec1e33e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:46.379929 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62844f80-1429-4203-8cea-2a042ec1e33e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:46.384643 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506eab4-90f5-4298-b986-a68d7c7384bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:46.385339 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506eab4-90f5-4298-b986-a68d7c7384bb admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:46.385652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506eab4-90f5-4298-b986-a68d7c7384bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:46.385906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506eab4-90f5-4298-b986-a68d7c7384bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:46.386667 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506eab4-90f5-4298-b986-a68d7c7384bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:46.388260 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506eab4-90f5-4298-b986-a68d7c7384bb admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:46.399186 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1377/2747] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:46.403440 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a4423-b792-46a0-947d-76835b05672a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:46.413644 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a4423-b792-46a0-947d-76835b05672a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:46.418369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3458d-b364-48ea-bd6e-45fc9e46d118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:46.419250 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3458d-b364-48ea-bd6e-45fc9e46d118 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:46.419529 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3458d-b364-48ea-bd6e-45fc9e46d118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:46.419794 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3458d-b364-48ea-bd6e-45fc9e46d118 admin admin] PATH_INFO: `/v3/projects/80f82517ba02405b98c7eff836b00349/users/f6e6541fb03c46769962a28e10c4191d/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:46.434600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3458d-b364-48ea-bd6e-45fc9e46d118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f82517ba02405b98c7eff836b00349, user_id=f6e6541fb03c46769962a28e10c4191d, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:46.437361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3458d-b364-48ea-bd6e-45fc9e46d118 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:46.524796 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1371/2748] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:46 2022] PUT /identity/v3/projects/80f82517ba02405b98c7eff836b00349/users/f6e6541fb03c46769962a28e10c4191d/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:02:46.537194 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73565e-a554-4600-b51b-348c7e42ef80 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:46.537521 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73565e-a554-4600-b51b-348c7e42ef80 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:46.537809 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73565e-a554-4600-b51b-348c7e42ef80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:46.566412 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fd73565e-a554-4600-b51b-348c7e42ef80 None None] MFA Rules not processed for user `f6e6541fb03c46769962a28e10c4191d`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:46.567635 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fd73565e-a554-4600-b51b-348c7e42ef80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:46.635369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1378/2749] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:46.638426 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:46.640007 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3458d-b364-48ea-bd6e-45fc9e46d118 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:46.705390 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3458d-b364-48ea-bd6e-45fc9e46d118 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:46.710334 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318830c-7853-49af-9f5a-33a510abb4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:46.711004 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318830c-7853-49af-9f5a-33a510abb4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:46.711293 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318830c-7853-49af-9f5a-33a510abb4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:46.711580 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318830c-7853-49af-9f5a-33a510abb4f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:46.712266 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318830c-7853-49af-9f5a-33a510abb4f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:46.714254 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318830c-7853-49af-9f5a-33a510abb4f3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:46.840309 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1372/2750] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:02:46 2022] POST /identity/v3/projects => generated 383 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:46.844419 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73565e-a554-4600-b51b-348c7e42ef80 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:46.855832 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73565e-a554-4600-b51b-348c7e42ef80 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:46.920766 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae37422-be2a-4135-b0ef-e0f85be2753d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:46.921501 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae37422-be2a-4135-b0ef-e0f85be2753d admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:46.921795 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae37422-be2a-4135-b0ef-e0f85be2753d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:46.922048 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae37422-be2a-4135-b0ef-e0f85be2753d admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:46.922824 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae37422-be2a-4135-b0ef-e0f85be2753d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:46.925278 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae37422-be2a-4135-b0ef-e0f85be2753d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:47.085786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318830c-7853-49af-9f5a-33a510abb4f3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:47.087585 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3318830c-7853-49af-9f5a-33a510abb4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:47.102171 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318830c-7853-49af-9f5a-33a510abb4f3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:47.107359 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26286d9a-e901-4655-b0ad-7f947621c204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:47.108260 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26286d9a-e901-4655-b0ad-7f947621c204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:47.108548 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26286d9a-e901-4655-b0ad-7f947621c204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:47.108857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26286d9a-e901-4655-b0ad-7f947621c204 admin admin] PATH_INFO: `/v3/users/e08afeeb8ac34e28ac36bdf9fa10dfd0` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:47.110103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26286d9a-e901-4655-b0ad-7f947621c204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e08afeeb8ac34e28ac36bdf9fa10dfd0)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:47.112645 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26286d9a-e901-4655-b0ad-7f947621c204 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:47.129318 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1379/2751] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:02:46 2022] POST /identity/v3/users => generated 298 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:47.134623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae37422-be2a-4135-b0ef-e0f85be2753d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:47.140758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae37422-be2a-4135-b0ef-e0f85be2753d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:47.146008 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d04349-4993-4ea4-ab21-d50ba3199a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:47.147037 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d04349-4993-4ea4-ab21-d50ba3199a6a admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:47.147395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d04349-4993-4ea4-ab21-d50ba3199a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:47.147752 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d04349-4993-4ea4-ab21-d50ba3199a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:47.148488 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d04349-4993-4ea4-ab21-d50ba3199a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:47.150151 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d04349-4993-4ea4-ab21-d50ba3199a6a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:47.162007 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1380/2752] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:47.166017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d04349-4993-4ea4-ab21-d50ba3199a6a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:47.177091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d04349-4993-4ea4-ab21-d50ba3199a6a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:47.182124 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75c79c-387c-4da6-9e60-efa400c65634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:47.183063 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75c79c-387c-4da6-9e60-efa400c65634 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:47.183344 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75c79c-387c-4da6-9e60-efa400c65634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:47.183620 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75c79c-387c-4da6-9e60-efa400c65634 admin admin] PATH_INFO: `/v3/projects/3dd4ea949e3643efad55b6c7bde32396/users/41c5bcb4fbb84a06bc4367f5ca4a9133/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:47.200869 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75c79c-387c-4da6-9e60-efa400c65634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd4ea949e3643efad55b6c7bde32396, user_id=41c5bcb4fbb84a06bc4367f5ca4a9133, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:47.204940 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75c79c-387c-4da6-9e60-efa400c65634 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:47.302482 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1381/2753] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:47 2022] PUT /identity/v3/projects/3dd4ea949e3643efad55b6c7bde32396/users/41c5bcb4fbb84a06bc4367f5ca4a9133/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:47.306424 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75c79c-387c-4da6-9e60-efa400c65634 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:47.331747 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:47.333623 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-26286d9a-e901-4655-b0ad-7f947621c204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e08afeeb8ac34e28ac36bdf9fa10dfd0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:47.371389 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75c79c-387c-4da6-9e60-efa400c65634 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:47.376159 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fac50-04ea-4469-8874-6498beed4dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:47.376836 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fac50-04ea-4469-8874-6498beed4dda admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:47.377145 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fac50-04ea-4469-8874-6498beed4dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:47.377455 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fac50-04ea-4469-8874-6498beed4dda admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:47.378180 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955fac50-04ea-4469-8874-6498beed4dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:47.379790 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955fac50-04ea-4469-8874-6498beed4dda admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:47.399630 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1382/2754] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:02:47.404009 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fac50-04ea-4469-8874-6498beed4dda admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:47.414418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fac50-04ea-4469-8874-6498beed4dda admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:47.419198 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e5fbe-a503-46b2-b10a-96905a67e413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:47.420123 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e5fbe-a503-46b2-b10a-96905a67e413 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:47.420409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e5fbe-a503-46b2-b10a-96905a67e413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:47.420687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e5fbe-a503-46b2-b10a-96905a67e413 admin admin] PATH_INFO: `/v3/projects/3dd4ea949e3643efad55b6c7bde32396/users/41c5bcb4fbb84a06bc4367f5ca4a9133/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:47.422802 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e5fbe-a503-46b2-b10a-96905a67e413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd4ea949e3643efad55b6c7bde32396, user_id=41c5bcb4fbb84a06bc4367f5ca4a9133, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:47.426128 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e5fbe-a503-46b2-b10a-96905a67e413 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:47.426802 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-26286d9a-e901-4655-b0ad-7f947621c204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e08afeeb8ac34e28ac36bdf9fa10dfd0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:47.427727 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-26286d9a-e901-4655-b0ad-7f947621c204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e08afeeb8ac34e28ac36bdf9fa10dfd0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:47.428560 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-26286d9a-e901-4655-b0ad-7f947621c204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e08afeeb8ac34e28ac36bdf9fa10dfd0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:47.436972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1383/2755] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:47 2022] PUT /identity/v3/projects/3dd4ea949e3643efad55b6c7bde32396/users/41c5bcb4fbb84a06bc4367f5ca4a9133/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:02:47.437607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-26286d9a-e901-4655-b0ad-7f947621c204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e08afeeb8ac34e28ac36bdf9fa10dfd0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:47.447233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4caf7a-eb11-449b-bfe4-4591477f3f00 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:47.447616 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4caf7a-eb11-449b-bfe4-4591477f3f00 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:47.447964 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4caf7a-eb11-449b-bfe4-4591477f3f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:47.459080 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1373/2756] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:02:47 2022] DELETE /identity/v3/users/e08afeeb8ac34e28ac36bdf9fa10dfd0 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:02:47.463643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032d302-4a6f-49af-a0f6-cdf24a028e9f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:47.463938 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032d302-4a6f-49af-a0f6-cdf24a028e9f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:47.464223 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032d302-4a6f-49af-a0f6-cdf24a028e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:47.478825 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9a4caf7a-eb11-449b-bfe4-4591477f3f00 None None] MFA Rules not processed for user `41c5bcb4fbb84a06bc4367f5ca4a9133`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:47.480147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9a4caf7a-eb11-449b-bfe4-4591477f3f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:47.483629 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c032d302-4a6f-49af-a0f6-cdf24a028e9f None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:47.484875 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c032d302-4a6f-49af-a0f6-cdf24a028e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:47.552005 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1374/2757] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:02:47.560949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1384/2758] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:02:47.562178 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032d302-4a6f-49af-a0f6-cdf24a028e9f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:47.563692 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c032d302-4a6f-49af-a0f6-cdf24a028e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:47.572422 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4caf7a-eb11-449b-bfe4-4591477f3f00 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:47.573949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9a4caf7a-eb11-449b-bfe4-4591477f3f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:47.630163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032d302-4a6f-49af-a0f6-cdf24a028e9f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:47.635002 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee306c38-fe74-4681-a770-dcaba8ad3b7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:47.635690 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee306c38-fe74-4681-a770-dcaba8ad3b7a service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:47.636041 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee306c38-fe74-4681-a770-dcaba8ad3b7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:47.636325 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee306c38-fe74-4681-a770-dcaba8ad3b7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:47.639600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4caf7a-eb11-449b-bfe4-4591477f3f00 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:47.644330 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77defc-4157-4082-95e0-6195ffc62961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:47.644995 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77defc-4157-4082-95e0-6195ffc62961 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:47.645324 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77defc-4157-4082-95e0-6195ffc62961 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:47.645603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77defc-4157-4082-95e0-6195ffc62961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:47.650020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee306c38-fe74-4681-a770-dcaba8ad3b7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:47.651441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee306c38-fe74-4681-a770-dcaba8ad3b7a service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:47.655799 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77defc-4157-4082-95e0-6195ffc62961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:47.657281 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77defc-4157-4082-95e0-6195ffc62961 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:47.663117 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1375/2759] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:02:47.664963 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:47.670414 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1385/2760] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:02:47.786061 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee306c38-fe74-4681-a770-dcaba8ad3b7a service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:47.795268 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee306c38-fe74-4681-a770-dcaba8ad3b7a service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:47.801158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a022537-1194-4fc5-a223-fda563996436 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:47.801649 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a022537-1194-4fc5-a223-fda563996436 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:47.801988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a022537-1194-4fc5-a223-fda563996436 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:47.802249 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a022537-1194-4fc5-a223-fda563996436 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:47.804117 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2a022537-1194-4fc5-a223-fda563996436 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:47.864240 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a022537-1194-4fc5-a223-fda563996436 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:47.865615 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a022537-1194-4fc5-a223-fda563996436 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:47.874521 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1376/2761] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:48.183746 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77defc-4157-4082-95e0-6195ffc62961 service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:48.185361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4a77defc-4157-4082-95e0-6195ffc62961 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:48.200955 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77defc-4157-4082-95e0-6195ffc62961 service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:48.206248 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2883f3-ea70-4444-9a61-e519aba0ea9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:48.207206 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2883f3-ea70-4444-9a61-e519aba0ea9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:48.207688 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2883f3-ea70-4444-9a61-e519aba0ea9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:48.208034 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2883f3-ea70-4444-9a61-e519aba0ea9a admin admin] PATH_INFO: `/v3/projects/aa13d7d13a4c4f579185e8628ca7996b` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:48.209743 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2883f3-ea70-4444-9a61-e519aba0ea9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa13d7d13a4c4f579185e8628ca7996b)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:48.212378 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2883f3-ea70-4444-9a61-e519aba0ea9a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:48.328180 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8b2883f3-ea70-4444-9a61-e519aba0ea9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa13d7d13a4c4f579185e8628ca7996b', 'request_id': 'req-8b2883f3-ea70-4444-9a61-e519aba0ea9a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:48.420859 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8b2883f3-ea70-4444-9a61-e519aba0ea9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa13d7d13a4c4f579185e8628ca7996b', 'request_id': 'req-8b2883f3-ea70-4444-9a61-e519aba0ea9a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:48.428147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8b2883f3-ea70-4444-9a61-e519aba0ea9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa13d7d13a4c4f579185e8628ca7996b', 'request_id': 'req-8b2883f3-ea70-4444-9a61-e519aba0ea9a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:48.439043 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8b2883f3-ea70-4444-9a61-e519aba0ea9a admin admin] The token cache is being invalidate because project aa13d7d13a4c4f579185e8628ca7996b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:48.439330 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8b2883f3-ea70-4444-9a61-e519aba0ea9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:48.439984 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8b2883f3-ea70-4444-9a61-e519aba0ea9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:48.441564 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1386/2762] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:02:48 2022] DELETE /identity/v3/projects/aa13d7d13a4c4f579185e8628ca7996b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:48.445845 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a022537-1194-4fc5-a223-fda563996436 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:48.452512 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:48.457279 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a022537-1194-4fc5-a223-fda563996436 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:48.516517 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6964f-08c4-4967-bb0b-a51a921c8f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:48.518055 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6964f-08c4-4967-bb0b-a51a921c8f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:48.518427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6964f-08c4-4967-bb0b-a51a921c8f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:48.518711 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6964f-08c4-4967-bb0b-a51a921c8f8f admin admin] PATH_INFO: `/v3/users/4b6fadbfef7549a8b10ff4d20f122793` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:48.519928 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6964f-08c4-4967-bb0b-a51a921c8f8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b6fadbfef7549a8b10ff4d20f122793)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:48.521902 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6964f-08c4-4967-bb0b-a51a921c8f8f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:48.762483 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3bd6964f-08c4-4967-bb0b-a51a921c8f8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b6fadbfef7549a8b10ff4d20f122793'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:48.843770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3bd6964f-08c4-4967-bb0b-a51a921c8f8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b6fadbfef7549a8b10ff4d20f122793'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:48.844382 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3bd6964f-08c4-4967-bb0b-a51a921c8f8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b6fadbfef7549a8b10ff4d20f122793'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:48.844984 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3bd6964f-08c4-4967-bb0b-a51a921c8f8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b6fadbfef7549a8b10ff4d20f122793'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:48.853369 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3bd6964f-08c4-4967-bb0b-a51a921c8f8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b6fadbfef7549a8b10ff4d20f122793'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:48.871452 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1377/2763] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:02:48 2022] DELETE /identity/v3/users/4b6fadbfef7549a8b10ff4d20f122793 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:49.382733 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2883f3-ea70-4444-9a61-e519aba0ea9a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:49.384310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8b2883f3-ea70-4444-9a61-e519aba0ea9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:49.399589 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2883f3-ea70-4444-9a61-e519aba0ea9a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:49.442194 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:49.468430 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c22c72-8a31-4d20-b16f-2c0195ca7b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:49.469340 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c22c72-8a31-4d20-b16f-2c0195ca7b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:49.469624 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c22c72-8a31-4d20-b16f-2c0195ca7b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:49.469898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c22c72-8a31-4d20-b16f-2c0195ca7b1a admin admin] PATH_INFO: `/v3/projects/5d42767924474a6e949b0f4c0321cbff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:49.471171 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c22c72-8a31-4d20-b16f-2c0195ca7b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d42767924474a6e949b0f4c0321cbff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:49.473185 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c22c72-8a31-4d20-b16f-2c0195ca7b1a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:49.714457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-41c22c72-8a31-4d20-b16f-2c0195ca7b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d42767924474a6e949b0f4c0321cbff', 'request_id': 'req-41c22c72-8a31-4d20-b16f-2c0195ca7b1a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.912012 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-41c22c72-8a31-4d20-b16f-2c0195ca7b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d42767924474a6e949b0f4c0321cbff', 'request_id': 'req-41c22c72-8a31-4d20-b16f-2c0195ca7b1a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.918847 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-41c22c72-8a31-4d20-b16f-2c0195ca7b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d42767924474a6e949b0f4c0321cbff', 'request_id': 'req-41c22c72-8a31-4d20-b16f-2c0195ca7b1a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.929941 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-41c22c72-8a31-4d20-b16f-2c0195ca7b1a admin admin] The token cache is being invalidate because project 5d42767924474a6e949b0f4c0321cbff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:49.930229 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-41c22c72-8a31-4d20-b16f-2c0195ca7b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.930872 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-41c22c72-8a31-4d20-b16f-2c0195ca7b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.932748 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1387/2764] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:02:49 2022] DELETE /identity/v3/projects/5d42767924474a6e949b0f4c0321cbff => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:49.937373 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a3388-7089-482e-a26d-acf970ddcb17 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:49.937846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a3388-7089-482e-a26d-acf970ddcb17 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:49.937943 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a3388-7089-482e-a26d-acf970ddcb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:49.956576 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e26a3388-7089-482e-a26d-acf970ddcb17 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:49.957868 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e26a3388-7089-482e-a26d-acf970ddcb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:50.016491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1378/2765] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:50.078261 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc5fbe-697e-431a-9490-be7be1c5ec9b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.078547 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc5fbe-697e-431a-9490-be7be1c5ec9b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.078839 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc5fbe-697e-431a-9490-be7be1c5ec9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.098610 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-94cc5fbe-697e-431a-9490-be7be1c5ec9b None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:50.100099 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-94cc5fbe-697e-431a-9490-be7be1c5ec9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:50.108162 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1388/2766] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:50.113339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a3388-7089-482e-a26d-acf970ddcb17 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:50.123441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a3388-7089-482e-a26d-acf970ddcb17 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:50.129418 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9161e6-08e1-4d76-98d8-545ec1946e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:50.130228 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9161e6-08e1-4d76-98d8-545ec1946e09 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.130617 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9161e6-08e1-4d76-98d8-545ec1946e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.131026 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9161e6-08e1-4d76-98d8-545ec1946e09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.131908 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9161e6-08e1-4d76-98d8-545ec1946e09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:02:50.132450 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9161e6-08e1-4d76-98d8-545ec1946e09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:50.134486 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9161e6-08e1-4d76-98d8-545ec1946e09 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:50.151561 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1379/2767] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:02:50.152863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc5fbe-697e-431a-9490-be7be1c5ec9b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:50.162310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc5fbe-697e-431a-9490-be7be1c5ec9b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:50.167923 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4f42b-e375-41f7-af71-bddcfd9d3956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:50.168678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4f42b-e375-41f7-af71-bddcfd9d3956 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.169015 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4f42b-e375-41f7-af71-bddcfd9d3956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.169323 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4f42b-e375-41f7-af71-bddcfd9d3956 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.170135 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4f42b-e375-41f7-af71-bddcfd9d3956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:50.171895 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4f42b-e375-41f7-af71-bddcfd9d3956 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:50.285978 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1389/2768] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:02:50 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:02:50.289956 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9161e6-08e1-4d76-98d8-545ec1946e09 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:50.300271 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9161e6-08e1-4d76-98d8-545ec1946e09 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:50.310547 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:50.360887 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7088f-8c6b-4bd8-a3da-2c75b283af76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:50.366821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7088f-8c6b-4bd8-a3da-2c75b283af76 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.366821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7088f-8c6b-4bd8-a3da-2c75b283af76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.366821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7088f-8c6b-4bd8-a3da-2c75b283af76 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.366821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7088f-8c6b-4bd8-a3da-2c75b283af76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:50.366821 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7088f-8c6b-4bd8-a3da-2c75b283af76 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:50.525035 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1380/2769] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:02:50 2022] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:50.529147 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4f42b-e375-41f7-af71-bddcfd9d3956 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:50.540814 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4f42b-e375-41f7-af71-bddcfd9d3956 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:50.545395 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85d4e1-855c-4857-8ac2-0344f132b634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:50.550745 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85d4e1-855c-4857-8ac2-0344f132b634 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.550745 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85d4e1-855c-4857-8ac2-0344f132b634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.550745 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85d4e1-855c-4857-8ac2-0344f132b634 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.550745 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85d4e1-855c-4857-8ac2-0344f132b634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:50.550745 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85d4e1-855c-4857-8ac2-0344f132b634 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:50.564623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1390/2770] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:02:50.566255 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7088f-8c6b-4bd8-a3da-2c75b283af76 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:50.577314 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7088f-8c6b-4bd8-a3da-2c75b283af76 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:50.582920 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a58f8c-19a8-463b-b444-f4d838446dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:50.583594 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a58f8c-19a8-463b-b444-f4d838446dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.583879 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a58f8c-19a8-463b-b444-f4d838446dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.584164 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a58f8c-19a8-463b-b444-f4d838446dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.584942 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a58f8c-19a8-463b-b444-f4d838446dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:50.586600 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a58f8c-19a8-463b-b444-f4d838446dd9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:50.597862 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1381/2771] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:50.602440 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85d4e1-855c-4857-8ac2-0344f132b634 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:50.613200 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85d4e1-855c-4857-8ac2-0344f132b634 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:50.618026 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175c8e1-d978-4832-812e-df47d16a7551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:50.619024 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175c8e1-d978-4832-812e-df47d16a7551 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.619330 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175c8e1-d978-4832-812e-df47d16a7551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.619620 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175c8e1-d978-4832-812e-df47d16a7551 admin admin] PATH_INFO: `/v3/projects/5709ce2fac32449a929d5a4064fdd532/users/fd4ebe90383349929464a3dca691b92b/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.638349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175c8e1-d978-4832-812e-df47d16a7551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5709ce2fac32449a929d5a4064fdd532, user_id=fd4ebe90383349929464a3dca691b92b, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:50.641139 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175c8e1-d978-4832-812e-df47d16a7551 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:50.731483 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1391/2772] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:50 2022] PUT /identity/v3/projects/5709ce2fac32449a929d5a4064fdd532/users/fd4ebe90383349929464a3dca691b92b/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:50.746192 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c396f21-4b5b-47e3-a7b7-72fffd4d5598 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.746337 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c396f21-4b5b-47e3-a7b7-72fffd4d5598 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.746575 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c396f21-4b5b-47e3-a7b7-72fffd4d5598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.773983 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1c396f21-4b5b-47e3-a7b7-72fffd4d5598 None None] MFA Rules not processed for user `fd4ebe90383349929464a3dca691b92b`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:50.775394 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1c396f21-4b5b-47e3-a7b7-72fffd4d5598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:50.849169 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1382/2773] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:50.860485 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175c8e1-d978-4832-812e-df47d16a7551 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:50.862881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9175c8e1-d978-4832-812e-df47d16a7551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:50.932098 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175c8e1-d978-4832-812e-df47d16a7551 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:50.935980 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735a613-e2ef-4744-9eed-52c7ae0db6f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:50.936635 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735a613-e2ef-4744-9eed-52c7ae0db6f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.936918 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735a613-e2ef-4744-9eed-52c7ae0db6f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.937194 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735a613-e2ef-4744-9eed-52c7ae0db6f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.946141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735a613-e2ef-4744-9eed-52c7ae0db6f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:50.947577 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735a613-e2ef-4744-9eed-52c7ae0db6f7 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:50.956544 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1392/2774] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:52.169536 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c396f21-4b5b-47e3-a7b7-72fffd4d5598 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:52.170019 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1c396f21-4b5b-47e3-a7b7-72fffd4d5598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:52.235580 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c396f21-4b5b-47e3-a7b7-72fffd4d5598 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:52.240616 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa5db0-35e5-4aeb-8bae-7faa22c9939a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:52.241517 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa5db0-35e5-4aeb-8bae-7faa22c9939a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:52.241814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa5db0-35e5-4aeb-8bae-7faa22c9939a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:52.242107 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa5db0-35e5-4aeb-8bae-7faa22c9939a admin admin] PATH_INFO: `/v3/users/f6e6541fb03c46769962a28e10c4191d` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:52.243345 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa5db0-35e5-4aeb-8bae-7faa22c9939a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e6541fb03c46769962a28e10c4191d)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:52.245357 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa5db0-35e5-4aeb-8bae-7faa22c9939a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:52.267657 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:52.497907 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-16aa5db0-35e5-4aeb-8bae-7faa22c9939a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e6541fb03c46769962a28e10c4191d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:52.650476 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-16aa5db0-35e5-4aeb-8bae-7faa22c9939a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e6541fb03c46769962a28e10c4191d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:52.651146 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-16aa5db0-35e5-4aeb-8bae-7faa22c9939a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e6541fb03c46769962a28e10c4191d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:52.651880 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-16aa5db0-35e5-4aeb-8bae-7faa22c9939a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e6541fb03c46769962a28e10c4191d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:52.659401 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-16aa5db0-35e5-4aeb-8bae-7faa22c9939a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e6541fb03c46769962a28e10c4191d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:52.676730 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1383/2775] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:02:52 2022] DELETE /identity/v3/users/f6e6541fb03c46769962a28e10c4191d => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:52.681854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fc3d6-2489-4e4f-b9d6-6c53052575cb None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:52.682323 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fc3d6-2489-4e4f-b9d6-6c53052575cb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:52.682496 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fc3d6-2489-4e4f-b9d6-6c53052575cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:52.689409 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:52.702018 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-908fc3d6-2489-4e4f-b9d6-6c53052575cb None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:52.703490 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-908fc3d6-2489-4e4f-b9d6-6c53052575cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:52.764962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1393/2776] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:02:52.775128 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa5db0-35e5-4aeb-8bae-7faa22c9939a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:52.776533 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-16aa5db0-35e5-4aeb-8bae-7faa22c9939a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:52.836361 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa5db0-35e5-4aeb-8bae-7faa22c9939a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:52.840016 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ced33-72b0-4215-ba60-367ecb73c997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:52.840675 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ced33-72b0-4215-ba60-367ecb73c997 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:52.840958 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ced33-72b0-4215-ba60-367ecb73c997 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:52.841237 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ced33-72b0-4215-ba60-367ecb73c997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:52.851665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ced33-72b0-4215-ba60-367ecb73c997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:52.853106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ced33-72b0-4215-ba60-367ecb73c997 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:52.863126 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1384/2777] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:02:52.905798 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896f528-30fc-453d-87ab-22d696831ce0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:52.906089 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896f528-30fc-453d-87ab-22d696831ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:52.906358 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896f528-30fc-453d-87ab-22d696831ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:52.927402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0896f528-30fc-453d-87ab-22d696831ce0 None None] MFA Rules not processed for user `fd4ebe90383349929464a3dca691b92b`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:52.929124 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0896f528-30fc-453d-87ab-22d696831ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:52.993346 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1394/2778] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:53.344106 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ced33-72b0-4215-ba60-367ecb73c997 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:53.345989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-231ced33-72b0-4215-ba60-367ecb73c997 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:53.365389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ced33-72b0-4215-ba60-367ecb73c997 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:53.370358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6b8de-9c30-4548-a369-8cb37ba7d6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:53.371221 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6b8de-9c30-4548-a369-8cb37ba7d6e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:53.371585 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6b8de-9c30-4548-a369-8cb37ba7d6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:53.371868 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6b8de-9c30-4548-a369-8cb37ba7d6e4 admin admin] PATH_INFO: `/v3/projects/80f82517ba02405b98c7eff836b00349` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:53.373088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6b8de-9c30-4548-a369-8cb37ba7d6e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80f82517ba02405b98c7eff836b00349)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:53.375113 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6b8de-9c30-4548-a369-8cb37ba7d6e4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:53.491940 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aac6b8de-9c30-4548-a369-8cb37ba7d6e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80f82517ba02405b98c7eff836b00349', 'request_id': 'req-aac6b8de-9c30-4548-a369-8cb37ba7d6e4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:53.499229 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aac6b8de-9c30-4548-a369-8cb37ba7d6e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80f82517ba02405b98c7eff836b00349', 'request_id': 'req-aac6b8de-9c30-4548-a369-8cb37ba7d6e4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:53.506553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aac6b8de-9c30-4548-a369-8cb37ba7d6e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80f82517ba02405b98c7eff836b00349', 'request_id': 'req-aac6b8de-9c30-4548-a369-8cb37ba7d6e4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:53.592527 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aac6b8de-9c30-4548-a369-8cb37ba7d6e4 admin admin] The token cache is being invalidate because project 80f82517ba02405b98c7eff836b00349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:53.592922 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aac6b8de-9c30-4548-a369-8cb37ba7d6e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:53.593630 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aac6b8de-9c30-4548-a369-8cb37ba7d6e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:53.598824 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1385/2779] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:02:53 2022] DELETE /identity/v3/projects/80f82517ba02405b98c7eff836b00349 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:53.600655 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896f528-30fc-453d-87ab-22d696831ce0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:53.611854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896f528-30fc-453d-87ab-22d696831ce0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:53.676314 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf70da-9d7c-4b23-9a9c-9bdc7615b221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:53.677687 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf70da-9d7c-4b23-9a9c-9bdc7615b221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:53.678037 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf70da-9d7c-4b23-9a9c-9bdc7615b221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:53.678387 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf70da-9d7c-4b23-9a9c-9bdc7615b221 admin admin] PATH_INFO: `/v3/users/41c5bcb4fbb84a06bc4367f5ca4a9133` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:53.679686 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf70da-9d7c-4b23-9a9c-9bdc7615b221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41c5bcb4fbb84a06bc4367f5ca4a9133)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:53.681743 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf70da-9d7c-4b23-9a9c-9bdc7615b221 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:54.014399 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-21bf70da-9d7c-4b23-9a9c-9bdc7615b221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41c5bcb4fbb84a06bc4367f5ca4a9133'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.015148 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-21bf70da-9d7c-4b23-9a9c-9bdc7615b221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41c5bcb4fbb84a06bc4367f5ca4a9133'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.020277 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:54.023252 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-21bf70da-9d7c-4b23-9a9c-9bdc7615b221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41c5bcb4fbb84a06bc4367f5ca4a9133'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.177481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-21bf70da-9d7c-4b23-9a9c-9bdc7615b221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41c5bcb4fbb84a06bc4367f5ca4a9133'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.178149 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-21bf70da-9d7c-4b23-9a9c-9bdc7615b221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41c5bcb4fbb84a06bc4367f5ca4a9133'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.201436 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1395/2780] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:02:53 2022] DELETE /identity/v3/users/41c5bcb4fbb84a06bc4367f5ca4a9133 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:55.057825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6b8de-9c30-4548-a369-8cb37ba7d6e4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:55.059308 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-aac6b8de-9c30-4548-a369-8cb37ba7d6e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:55.073429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6b8de-9c30-4548-a369-8cb37ba7d6e4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:55.133779 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:55.170733 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448027f2-68f4-4b85-9f93-9b342e79c639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:55.171597 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448027f2-68f4-4b85-9f93-9b342e79c639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:55.171874 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448027f2-68f4-4b85-9f93-9b342e79c639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:55.172146 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448027f2-68f4-4b85-9f93-9b342e79c639 admin admin] PATH_INFO: `/v3/projects/3dd4ea949e3643efad55b6c7bde32396` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:55.173349 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448027f2-68f4-4b85-9f93-9b342e79c639 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dd4ea949e3643efad55b6c7bde32396)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:55.175829 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448027f2-68f4-4b85-9f93-9b342e79c639 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:55.337811 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-448027f2-68f4-4b85-9f93-9b342e79c639 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dd4ea949e3643efad55b6c7bde32396', 'request_id': 'req-448027f2-68f4-4b85-9f93-9b342e79c639'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:55.344212 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-448027f2-68f4-4b85-9f93-9b342e79c639 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dd4ea949e3643efad55b6c7bde32396', 'request_id': 'req-448027f2-68f4-4b85-9f93-9b342e79c639'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:55.352419 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-448027f2-68f4-4b85-9f93-9b342e79c639 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dd4ea949e3643efad55b6c7bde32396', 'request_id': 'req-448027f2-68f4-4b85-9f93-9b342e79c639'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:55.501032 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-448027f2-68f4-4b85-9f93-9b342e79c639 admin admin] The token cache is being invalidate because project 3dd4ea949e3643efad55b6c7bde32396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:55.504197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-448027f2-68f4-4b85-9f93-9b342e79c639 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:55.504197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-448027f2-68f4-4b85-9f93-9b342e79c639 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:55.504197 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1386/2781] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:02:55 2022] DELETE /identity/v3/projects/3dd4ea949e3643efad55b6c7bde32396 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:55.509797 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93101b9-2b57-4499-88b0-8a8ae6f57076 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:55.510317 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93101b9-2b57-4499-88b0-8a8ae6f57076 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:55.510415 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93101b9-2b57-4499-88b0-8a8ae6f57076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:55.529454 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a93101b9-2b57-4499-88b0-8a8ae6f57076 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:55.530692 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a93101b9-2b57-4499-88b0-8a8ae6f57076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:55.597643 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1396/2782] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:55.605597 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672999c-5dd8-45fa-b66a-9b6a9f826bf8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:55.605885 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672999c-5dd8-45fa-b66a-9b6a9f826bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:55.606179 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672999c-5dd8-45fa-b66a-9b6a9f826bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:55.625835 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a672999c-5dd8-45fa-b66a-9b6a9f826bf8 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:55.629545 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a672999c-5dd8-45fa-b66a-9b6a9f826bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:55.639606 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1387/2783] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:55.647540 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93101b9-2b57-4499-88b0-8a8ae6f57076 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:55.658253 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93101b9-2b57-4499-88b0-8a8ae6f57076 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:55.664246 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38264525-e7c2-496a-b284-0e6a5a7cd468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:55.664978 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38264525-e7c2-496a-b284-0e6a5a7cd468 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:55.665285 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38264525-e7c2-496a-b284-0e6a5a7cd468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:55.665594 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38264525-e7c2-496a-b284-0e6a5a7cd468 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:55.666398 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38264525-e7c2-496a-b284-0e6a5a7cd468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:02:55.666738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38264525-e7c2-496a-b284-0e6a5a7cd468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:55.668509 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38264525-e7c2-496a-b284-0e6a5a7cd468 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:55.686427 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1397/2784] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:02:55.687611 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672999c-5dd8-45fa-b66a-9b6a9f826bf8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:55.698065 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672999c-5dd8-45fa-b66a-9b6a9f826bf8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:55.704250 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02280bb3-7c8d-48de-b03e-7cb3c9227257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:55.704918 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02280bb3-7c8d-48de-b03e-7cb3c9227257 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:55.705210 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02280bb3-7c8d-48de-b03e-7cb3c9227257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:55.705589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02280bb3-7c8d-48de-b03e-7cb3c9227257 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:55.706370 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02280bb3-7c8d-48de-b03e-7cb3c9227257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:55.710843 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02280bb3-7c8d-48de-b03e-7cb3c9227257 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:55.871214 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1388/2785] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:02:55 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:55.875518 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38264525-e7c2-496a-b284-0e6a5a7cd468 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:55.886902 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38264525-e7c2-496a-b284-0e6a5a7cd468 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:55.952957 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c3c13-36fc-4f04-931d-9d3592337021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:55.953709 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c3c13-36fc-4f04-931d-9d3592337021 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:55.954014 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c3c13-36fc-4f04-931d-9d3592337021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:55.954288 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c3c13-36fc-4f04-931d-9d3592337021 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:55.954993 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c3c13-36fc-4f04-931d-9d3592337021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:55.957101 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c3c13-36fc-4f04-931d-9d3592337021 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:56.330096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1398/2786] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:02:55 2022] POST /identity/v3/users => generated 293 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:56.336987 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02280bb3-7c8d-48de-b03e-7cb3c9227257 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:56.347797 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02280bb3-7c8d-48de-b03e-7cb3c9227257 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:56.353484 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1fba8-27a1-4a83-a91d-3a56bb00c211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:56.354174 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1fba8-27a1-4a83-a91d-3a56bb00c211 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:56.354460 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1fba8-27a1-4a83-a91d-3a56bb00c211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:56.354881 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1fba8-27a1-4a83-a91d-3a56bb00c211 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:56.355605 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1fba8-27a1-4a83-a91d-3a56bb00c211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:56.357287 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1fba8-27a1-4a83-a91d-3a56bb00c211 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:56.368107 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1389/2787] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:56.372444 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c3c13-36fc-4f04-931d-9d3592337021 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:56.385827 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c3c13-36fc-4f04-931d-9d3592337021 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:56.387790 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d5f98-3766-4a48-b4bc-5d8bf83b9fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:56.388453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d5f98-3766-4a48-b4bc-5d8bf83b9fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:56.388738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d5f98-3766-4a48-b4bc-5d8bf83b9fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:56.389013 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d5f98-3766-4a48-b4bc-5d8bf83b9fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:56.389782 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d5f98-3766-4a48-b4bc-5d8bf83b9fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:56.391438 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d5f98-3766-4a48-b4bc-5d8bf83b9fc5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:56.402568 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1399/2788] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:56.407001 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1fba8-27a1-4a83-a91d-3a56bb00c211 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:56.417835 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1fba8-27a1-4a83-a91d-3a56bb00c211 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:56.424414 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac0480-2e93-45a5-b47c-26ea01f08c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:56.425391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac0480-2e93-45a5-b47c-26ea01f08c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:56.425687 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac0480-2e93-45a5-b47c-26ea01f08c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:56.426025 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac0480-2e93-45a5-b47c-26ea01f08c26 admin admin] PATH_INFO: `/v3/projects/12fc57e7f3d74ffdade874f69e3ae316/users/52d44cdb54a9462589f69aa40f7b7a3f/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:56.441481 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac0480-2e93-45a5-b47c-26ea01f08c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12fc57e7f3d74ffdade874f69e3ae316, user_id=52d44cdb54a9462589f69aa40f7b7a3f, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:56.444432 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac0480-2e93-45a5-b47c-26ea01f08c26 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:56.606808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1390/2789] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:56 2022] PUT /identity/v3/projects/12fc57e7f3d74ffdade874f69e3ae316/users/52d44cdb54a9462589f69aa40f7b7a3f/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:02:56.618635 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c90bb1-29aa-4f56-b8b2-d266fbb9cc41 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:56.619238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c90bb1-29aa-4f56-b8b2-d266fbb9cc41 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:56.619238 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c90bb1-29aa-4f56-b8b2-d266fbb9cc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:56.650847 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-16c90bb1-29aa-4f56-b8b2-d266fbb9cc41 None None] MFA Rules not processed for user `52d44cdb54a9462589f69aa40f7b7a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:56.652365 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-16c90bb1-29aa-4f56-b8b2-d266fbb9cc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:56.677663 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:56.719433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1400/2790] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:56.725704 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac0480-2e93-45a5-b47c-26ea01f08c26 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:56.777019 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:56.789020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac0480-2e93-45a5-b47c-26ea01f08c26 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:56.794505 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68258d-d8b2-4f16-9137-d3f2c994ad12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:56.795169 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68258d-d8b2-4f16-9137-d3f2c994ad12 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:56.795454 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68258d-d8b2-4f16-9137-d3f2c994ad12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:56.795735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68258d-d8b2-4f16-9137-d3f2c994ad12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:56.796443 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68258d-d8b2-4f16-9137-d3f2c994ad12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:56.799675 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68258d-d8b2-4f16-9137-d3f2c994ad12 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:56.934690 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1391/2791] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:02:56 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:56.938620 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c90bb1-29aa-4f56-b8b2-d266fbb9cc41 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:56.950667 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c90bb1-29aa-4f56-b8b2-d266fbb9cc41 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:57.008790 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c89b1-d4f8-4a83-af5b-eb03558d2732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:57.009502 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c89b1-d4f8-4a83-af5b-eb03558d2732 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:57.009787 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c89b1-d4f8-4a83-af5b-eb03558d2732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:57.010064 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c89b1-d4f8-4a83-af5b-eb03558d2732 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:57.010760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c89b1-d4f8-4a83-af5b-eb03558d2732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:57.012683 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c89b1-d4f8-4a83-af5b-eb03558d2732 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:57.125222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1401/2792] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:02:56 2022] POST /identity/v3/users => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:57.129993 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68258d-d8b2-4f16-9137-d3f2c994ad12 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:57.141217 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68258d-d8b2-4f16-9137-d3f2c994ad12 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:57.146569 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769abeba-8f41-4103-baba-453212022728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:57.147244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769abeba-8f41-4103-baba-453212022728 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:57.147555 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769abeba-8f41-4103-baba-453212022728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:57.147846 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769abeba-8f41-4103-baba-453212022728 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:57.148570 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769abeba-8f41-4103-baba-453212022728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:57.150198 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769abeba-8f41-4103-baba-453212022728 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:57.161797 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1392/2793] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:57.166292 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c89b1-d4f8-4a83-af5b-eb03558d2732 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:57.176504 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c89b1-d4f8-4a83-af5b-eb03558d2732 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:57.181214 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a266c-f6ec-4825-b6f5-0017c4fad45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:57.182145 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a266c-f6ec-4825-b6f5-0017c4fad45a admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:57.182435 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a266c-f6ec-4825-b6f5-0017c4fad45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:57.182707 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a266c-f6ec-4825-b6f5-0017c4fad45a admin admin] PATH_INFO: `/v3/projects/2d3fcf346a1144609da152265e7aa8cb/users/8ddb5f3a9d6a48e6b6a7ab3af3749601/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:57.200198 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a266c-f6ec-4825-b6f5-0017c4fad45a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d3fcf346a1144609da152265e7aa8cb, user_id=8ddb5f3a9d6a48e6b6a7ab3af3749601, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:57.202897 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a266c-f6ec-4825-b6f5-0017c4fad45a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:57.313152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1402/2794] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:57 2022] PUT /identity/v3/projects/2d3fcf346a1144609da152265e7aa8cb/users/8ddb5f3a9d6a48e6b6a7ab3af3749601/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:57.317201 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769abeba-8f41-4103-baba-453212022728 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:57.327254 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769abeba-8f41-4103-baba-453212022728 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:57.383499 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ec6d8-fd50-449d-8260-86b059ac131c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:57.384186 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ec6d8-fd50-449d-8260-86b059ac131c admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:57.384429 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ec6d8-fd50-449d-8260-86b059ac131c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:57.384706 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ec6d8-fd50-449d-8260-86b059ac131c admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:57.385463 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ec6d8-fd50-449d-8260-86b059ac131c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:57.387092 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ec6d8-fd50-449d-8260-86b059ac131c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:57.397753 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1393/2795] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:57.401906 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a266c-f6ec-4825-b6f5-0017c4fad45a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:57.413084 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a266c-f6ec-4825-b6f5-0017c4fad45a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:57.418598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120875c2-b1bd-46b7-915c-45b7e416fc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:57.420378 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120875c2-b1bd-46b7-915c-45b7e416fc57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:57.420378 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120875c2-b1bd-46b7-915c-45b7e416fc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:57.420378 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120875c2-b1bd-46b7-915c-45b7e416fc57 admin admin] PATH_INFO: `/v3/projects/2d3fcf346a1144609da152265e7aa8cb/users/8ddb5f3a9d6a48e6b6a7ab3af3749601/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:57.422008 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120875c2-b1bd-46b7-915c-45b7e416fc57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d3fcf346a1144609da152265e7aa8cb, user_id=8ddb5f3a9d6a48e6b6a7ab3af3749601, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:57.424684 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120875c2-b1bd-46b7-915c-45b7e416fc57 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:57.435710 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1403/2796] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:02:57 2022] PUT /identity/v3/projects/2d3fcf346a1144609da152265e7aa8cb/users/8ddb5f3a9d6a48e6b6a7ab3af3749601/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:57.446558 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873e191-485b-43c9-92e0-978deac91dbf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:57.446854 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873e191-485b-43c9-92e0-978deac91dbf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:57.447136 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873e191-485b-43c9-92e0-978deac91dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:57.474104 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c873e191-485b-43c9-92e0-978deac91dbf None None] MFA Rules not processed for user `8ddb5f3a9d6a48e6b6a7ab3af3749601`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:57.475578 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c873e191-485b-43c9-92e0-978deac91dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:57.543828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1394/2797] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:02:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:57.555803 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120875c2-b1bd-46b7-915c-45b7e416fc57 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:57.557555 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-120875c2-b1bd-46b7-915c-45b7e416fc57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:57.616279 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120875c2-b1bd-46b7-915c-45b7e416fc57 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:57.620007 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2c754-481e-43ae-af01-bfe0c95c0c7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:57.620973 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2c754-481e-43ae-af01-bfe0c95c0c7d service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:57.620973 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2c754-481e-43ae-af01-bfe0c95c0c7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:57.621196 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2c754-481e-43ae-af01-bfe0c95c0c7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:57.652260 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:57.679941 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2c754-481e-43ae-af01-bfe0c95c0c7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:57.681429 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2c754-481e-43ae-af01-bfe0c95c0c7d service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:57.692594 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1404/2798] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:02:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:03:00.387022 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873e191-485b-43c9-92e0-978deac91dbf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:00.390930 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c873e191-485b-43c9-92e0-978deac91dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:00.459964 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:00.470301 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873e191-485b-43c9-92e0-978deac91dbf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:00.479691 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f9c3f-fe86-4c89-8992-72c78e5675a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:00.482088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f9c3f-fe86-4c89-8992-72c78e5675a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:00.482735 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f9c3f-fe86-4c89-8992-72c78e5675a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:00.483247 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f9c3f-fe86-4c89-8992-72c78e5675a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:00.486378 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-324f9c3f-fe86-4c89-8992-72c78e5675a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:00.570477 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f9c3f-fe86-4c89-8992-72c78e5675a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:00.571973 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f9c3f-fe86-4c89-8992-72c78e5675a7 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:00.583303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1395/2799] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:03:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:03:03.285683 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2c754-481e-43ae-af01-bfe0c95c0c7d service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:03.296384 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2c754-481e-43ae-af01-bfe0c95c0c7d service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:03.301850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccc253-3ddb-4d73-b97b-4a67a296af7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:03.302511 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccc253-3ddb-4d73-b97b-4a67a296af7b service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:03.302799 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccc253-3ddb-4d73-b97b-4a67a296af7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:03.303155 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccc253-3ddb-4d73-b97b-4a67a296af7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:03.313181 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccc253-3ddb-4d73-b97b-4a67a296af7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:03.314666 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccc253-3ddb-4d73-b97b-4a67a296af7b service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:03.330932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1405/2800] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:03:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:03:11.067160 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=29 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:12.763131 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f9c3f-fe86-4c89-8992-72c78e5675a7 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:12.830787 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f9c3f-fe86-4c89-8992-72c78e5675a7 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:12.836020 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b3bb2-b678-4224-ab7a-9a3cbca462ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:12.836925 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b3bb2-b678-4224-ab7a-9a3cbca462ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:12.837207 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b3bb2-b678-4224-ab7a-9a3cbca462ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:12.837556 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b3bb2-b678-4224-ab7a-9a3cbca462ed admin admin] PATH_INFO: `/v3/users/52d44cdb54a9462589f69aa40f7b7a3f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:12.838755 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b3bb2-b678-4224-ab7a-9a3cbca462ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=52d44cdb54a9462589f69aa40f7b7a3f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:12.840743 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b3bb2-b678-4224-ab7a-9a3cbca462ed admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:13.081044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-131b3bb2-b678-4224-ab7a-9a3cbca462ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52d44cdb54a9462589f69aa40f7b7a3f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:13.198095 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-131b3bb2-b678-4224-ab7a-9a3cbca462ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52d44cdb54a9462589f69aa40f7b7a3f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:13.198712 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-131b3bb2-b678-4224-ab7a-9a3cbca462ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52d44cdb54a9462589f69aa40f7b7a3f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:13.199352 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-131b3bb2-b678-4224-ab7a-9a3cbca462ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52d44cdb54a9462589f69aa40f7b7a3f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:13.206887 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-131b3bb2-b678-4224-ab7a-9a3cbca462ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52d44cdb54a9462589f69aa40f7b7a3f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:13.224599 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1396/2801] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:03:12 2022] DELETE /identity/v3/users/52d44cdb54a9462589f69aa40f7b7a3f => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:03:13.229601 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f0b52-3b39-4ad8-8c2c-0fc8db79229a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:13.230096 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f0b52-3b39-4ad8-8c2c-0fc8db79229a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:13.230197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f0b52-3b39-4ad8-8c2c-0fc8db79229a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:13.247870 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-019f0b52-3b39-4ad8-8c2c-0fc8db79229a None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:13.249092 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-019f0b52-3b39-4ad8-8c2c-0fc8db79229a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:13.312228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1406/2802] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:03:13.326765 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b3bb2-b678-4224-ab7a-9a3cbca462ed admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:13.328206 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-131b3bb2-b678-4224-ab7a-9a3cbca462ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:13.388240 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b3bb2-b678-4224-ab7a-9a3cbca462ed admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:13.392034 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579885f-a650-4913-aa89-398306f82857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:13.392690 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579885f-a650-4913-aa89-398306f82857 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:13.392976 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579885f-a650-4913-aa89-398306f82857 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:13.393272 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579885f-a650-4913-aa89-398306f82857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:13.402990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579885f-a650-4913-aa89-398306f82857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:13.404444 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579885f-a650-4913-aa89-398306f82857 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:13.414805 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1397/2803] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:03:13.817228 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f0b52-3b39-4ad8-8c2c-0fc8db79229a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:13.818750 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-019f0b52-3b39-4ad8-8c2c-0fc8db79229a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:13.831369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f0b52-3b39-4ad8-8c2c-0fc8db79229a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:13.835980 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3bdb5-bb00-4d53-99c7-2d780f09fd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:13.836852 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3bdb5-bb00-4d53-99c7-2d780f09fd1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:13.837136 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3bdb5-bb00-4d53-99c7-2d780f09fd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:13.837565 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3bdb5-bb00-4d53-99c7-2d780f09fd1f admin admin] PATH_INFO: `/v3/projects/12fc57e7f3d74ffdade874f69e3ae316` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:13.838760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3bdb5-bb00-4d53-99c7-2d780f09fd1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=12fc57e7f3d74ffdade874f69e3ae316)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:13.840949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3bdb5-bb00-4d53-99c7-2d780f09fd1f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:13.963695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b2c3bdb5-bb00-4d53-99c7-2d780f09fd1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12fc57e7f3d74ffdade874f69e3ae316', 'request_id': 'req-b2c3bdb5-bb00-4d53-99c7-2d780f09fd1f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:14.055094 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b2c3bdb5-bb00-4d53-99c7-2d780f09fd1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12fc57e7f3d74ffdade874f69e3ae316', 'request_id': 'req-b2c3bdb5-bb00-4d53-99c7-2d780f09fd1f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:14.062167 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b2c3bdb5-bb00-4d53-99c7-2d780f09fd1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12fc57e7f3d74ffdade874f69e3ae316', 'request_id': 'req-b2c3bdb5-bb00-4d53-99c7-2d780f09fd1f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:14.079418 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b2c3bdb5-bb00-4d53-99c7-2d780f09fd1f admin admin] The token cache is being invalidate because project 12fc57e7f3d74ffdade874f69e3ae316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:03:14.079794 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b2c3bdb5-bb00-4d53-99c7-2d780f09fd1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:14.080422 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b2c3bdb5-bb00-4d53-99c7-2d780f09fd1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:14.082112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1407/2804] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:03:13 2022] DELETE /identity/v3/projects/12fc57e7f3d74ffdade874f69e3ae316 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:03:14.086140 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579885f-a650-4913-aa89-398306f82857 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:14.097441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579885f-a650-4913-aa89-398306f82857 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:14.119218 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:14.161225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b0970-2f53-4738-9512-78ca00b52392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:14.162200 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b0970-2f53-4738-9512-78ca00b52392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:14.162438 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b0970-2f53-4738-9512-78ca00b52392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:14.162696 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b0970-2f53-4738-9512-78ca00b52392 admin admin] PATH_INFO: `/v3/users/8ddb5f3a9d6a48e6b6a7ab3af3749601` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:14.164008 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b0970-2f53-4738-9512-78ca00b52392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ddb5f3a9d6a48e6b6a7ab3af3749601)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:14.166045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b0970-2f53-4738-9512-78ca00b52392 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:14.369857 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-250b0970-2f53-4738-9512-78ca00b52392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ddb5f3a9d6a48e6b6a7ab3af3749601'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:14.454988 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-250b0970-2f53-4738-9512-78ca00b52392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ddb5f3a9d6a48e6b6a7ab3af3749601'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:14.455613 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-250b0970-2f53-4738-9512-78ca00b52392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ddb5f3a9d6a48e6b6a7ab3af3749601'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:14.456228 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-250b0970-2f53-4738-9512-78ca00b52392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ddb5f3a9d6a48e6b6a7ab3af3749601'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:14.463990 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-250b0970-2f53-4738-9512-78ca00b52392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ddb5f3a9d6a48e6b6a7ab3af3749601'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:14.482479 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1398/2805] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:03:14 2022] DELETE /identity/v3/users/8ddb5f3a9d6a48e6b6a7ab3af3749601 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:03:15.079545 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3bdb5-bb00-4d53-99c7-2d780f09fd1f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:15.081652 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b2c3bdb5-bb00-4d53-99c7-2d780f09fd1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:15.095701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3bdb5-bb00-4d53-99c7-2d780f09fd1f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:15.144748 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:15.162765 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386da291-342d-449f-98d6-e8b2fa9d4587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:15.163758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386da291-342d-449f-98d6-e8b2fa9d4587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:15.164151 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386da291-342d-449f-98d6-e8b2fa9d4587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:15.164527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386da291-342d-449f-98d6-e8b2fa9d4587 admin admin] PATH_INFO: `/v3/projects/2d3fcf346a1144609da152265e7aa8cb` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:15.166504 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386da291-342d-449f-98d6-e8b2fa9d4587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d3fcf346a1144609da152265e7aa8cb)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:15.169152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386da291-342d-449f-98d6-e8b2fa9d4587 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:15.274361 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-386da291-342d-449f-98d6-e8b2fa9d4587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d3fcf346a1144609da152265e7aa8cb', 'request_id': 'req-386da291-342d-449f-98d6-e8b2fa9d4587'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:15.369304 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-386da291-342d-449f-98d6-e8b2fa9d4587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d3fcf346a1144609da152265e7aa8cb', 'request_id': 'req-386da291-342d-449f-98d6-e8b2fa9d4587'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:15.376310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-386da291-342d-449f-98d6-e8b2fa9d4587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d3fcf346a1144609da152265e7aa8cb', 'request_id': 'req-386da291-342d-449f-98d6-e8b2fa9d4587'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:15.388266 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-386da291-342d-449f-98d6-e8b2fa9d4587 admin admin] The token cache is being invalidate because project 2d3fcf346a1144609da152265e7aa8cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:03:15.388550 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-386da291-342d-449f-98d6-e8b2fa9d4587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:15.389194 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-386da291-342d-449f-98d6-e8b2fa9d4587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:15.390845 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1408/2806] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:03:15 2022] DELETE /identity/v3/projects/2d3fcf346a1144609da152265e7aa8cb => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:03:15.396996 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92bfaa-7bda-405b-9552-849437a7a91c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:15.397582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92bfaa-7bda-405b-9552-849437a7a91c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:15.397582 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92bfaa-7bda-405b-9552-849437a7a91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:15.415714 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8e92bfaa-7bda-405b-9552-849437a7a91c None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:15.416903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8e92bfaa-7bda-405b-9552-849437a7a91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:15.475855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1399/2807] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:03:15.484420 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7ab72-10fc-4bfa-a08e-873507c30b69 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:15.484707 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7ab72-10fc-4bfa-a08e-873507c30b69 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:15.484983 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7ab72-10fc-4bfa-a08e-873507c30b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:15.504635 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4da7ab72-10fc-4bfa-a08e-873507c30b69 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:15.505859 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4da7ab72-10fc-4bfa-a08e-873507c30b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:15.513789 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1409/2808] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:03:15.517948 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92bfaa-7bda-405b-9552-849437a7a91c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:15.527732 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92bfaa-7bda-405b-9552-849437a7a91c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:15.532518 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb8d50-a5d2-4215-96b4-a65fe240ff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:15.533240 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb8d50-a5d2-4215-96b4-a65fe240ff8f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:15.533509 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb8d50-a5d2-4215-96b4-a65fe240ff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:15.533785 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb8d50-a5d2-4215-96b4-a65fe240ff8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:15.535044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb8d50-a5d2-4215-96b4-a65fe240ff8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:03:15.535347 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb8d50-a5d2-4215-96b4-a65fe240ff8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:15.536944 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb8d50-a5d2-4215-96b4-a65fe240ff8f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:15.548609 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1400/2809] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:03:15.553693 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7ab72-10fc-4bfa-a08e-873507c30b69 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:15.562775 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7ab72-10fc-4bfa-a08e-873507c30b69 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:15.567453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c5f8b-fe59-4fc0-aa26-e056ac23ecae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:15.568102 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c5f8b-fe59-4fc0-aa26-e056ac23ecae admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:15.568382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c5f8b-fe59-4fc0-aa26-e056ac23ecae admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:15.568684 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c5f8b-fe59-4fc0-aa26-e056ac23ecae admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:15.569428 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c5f8b-fe59-4fc0-aa26-e056ac23ecae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:15.571316 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c5f8b-fe59-4fc0-aa26-e056ac23ecae admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:15.680039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1410/2810] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:03:15 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:03:15.684428 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb8d50-a5d2-4215-96b4-a65fe240ff8f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:15.695146 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb8d50-a5d2-4215-96b4-a65fe240ff8f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:15.722763 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:15.754757 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e454e-de83-4e83-8223-56b01c59a012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:15.755500 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e454e-de83-4e83-8223-56b01c59a012 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:15.755805 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e454e-de83-4e83-8223-56b01c59a012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:15.756122 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e454e-de83-4e83-8223-56b01c59a012 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:15.756814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e454e-de83-4e83-8223-56b01c59a012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:15.758736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e454e-de83-4e83-8223-56b01c59a012 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:15.844287 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1401/2811] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:03:15 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:03:15.849073 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c5f8b-fe59-4fc0-aa26-e056ac23ecae admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:15.860085 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c5f8b-fe59-4fc0-aa26-e056ac23ecae admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:15.865712 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16433d27-5959-40a9-b5e9-e68f96dcf9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:15.866396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16433d27-5959-40a9-b5e9-e68f96dcf9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:15.866675 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16433d27-5959-40a9-b5e9-e68f96dcf9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:15.866942 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16433d27-5959-40a9-b5e9-e68f96dcf9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:15.867658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16433d27-5959-40a9-b5e9-e68f96dcf9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:15.869439 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16433d27-5959-40a9-b5e9-e68f96dcf9c2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:15.880338 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1411/2812] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:03:15.884770 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e454e-de83-4e83-8223-56b01c59a012 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:15.895463 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e454e-de83-4e83-8223-56b01c59a012 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:15.900132 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a92db-8bc0-4855-89fd-780cf9fd68b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:15.900794 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a92db-8bc0-4855-89fd-780cf9fd68b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:15.901072 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a92db-8bc0-4855-89fd-780cf9fd68b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:15.901387 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a92db-8bc0-4855-89fd-780cf9fd68b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:15.902105 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a92db-8bc0-4855-89fd-780cf9fd68b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:15.903697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a92db-8bc0-4855-89fd-780cf9fd68b9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:15.914464 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1402/2813] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:03:15.918564 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16433d27-5959-40a9-b5e9-e68f96dcf9c2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:15.929017 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16433d27-5959-40a9-b5e9-e68f96dcf9c2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:15.934372 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b96c7f-d73f-482e-a5a6-f967f87dd63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:15.935198 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b96c7f-d73f-482e-a5a6-f967f87dd63b admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:15.935474 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b96c7f-d73f-482e-a5a6-f967f87dd63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:15.935747 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b96c7f-d73f-482e-a5a6-f967f87dd63b admin admin] PATH_INFO: `/v3/projects/c7e70210d8064765be5bbb95d636b36c/users/404b6447fa654c7f944115437047afcd/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:15.950642 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b96c7f-d73f-482e-a5a6-f967f87dd63b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e70210d8064765be5bbb95d636b36c, user_id=404b6447fa654c7f944115437047afcd, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:15.953300 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b96c7f-d73f-482e-a5a6-f967f87dd63b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:16.021870 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1412/2814] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:03:15 2022] PUT /identity/v3/projects/c7e70210d8064765be5bbb95d636b36c/users/404b6447fa654c7f944115437047afcd/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:03:16.035307 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c3534-f7c3-4536-8cec-36d594439ae1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:16.035595 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c3534-f7c3-4536-8cec-36d594439ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:16.035869 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c3534-f7c3-4536-8cec-36d594439ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:16.062231 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a37c3534-f7c3-4536-8cec-36d594439ae1 None None] MFA Rules not processed for user `404b6447fa654c7f944115437047afcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:16.063453 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a37c3534-f7c3-4536-8cec-36d594439ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:16.129960 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1403/2815] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:03:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:03:16.141369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b96c7f-d73f-482e-a5a6-f967f87dd63b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:16.143152 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-64b96c7f-d73f-482e-a5a6-f967f87dd63b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:16.200981 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b96c7f-d73f-482e-a5a6-f967f87dd63b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:16.204638 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9257e-d029-453d-bf2f-c3e381b3b2af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:16.205310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9257e-d029-453d-bf2f-c3e381b3b2af service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:16.205600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9257e-d029-453d-bf2f-c3e381b3b2af service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:16.206408 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9257e-d029-453d-bf2f-c3e381b3b2af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:16.214940 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9257e-d029-453d-bf2f-c3e381b3b2af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:16.216446 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9257e-d029-453d-bf2f-c3e381b3b2af service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:16.226429 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1413/2816] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:03:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:03:16.248780 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c3534-f7c3-4536-8cec-36d594439ae1 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:16.312056 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c3534-f7c3-4536-8cec-36d594439ae1 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:16.317238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e30dd5-a522-4bce-9fd4-6ed098b08763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:16.318146 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e30dd5-a522-4bce-9fd4-6ed098b08763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:16.318420 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e30dd5-a522-4bce-9fd4-6ed098b08763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:16.318685 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e30dd5-a522-4bce-9fd4-6ed098b08763 admin admin] PATH_INFO: `/v3/users/404b6447fa654c7f944115437047afcd` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:16.319910 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e30dd5-a522-4bce-9fd4-6ed098b08763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=404b6447fa654c7f944115437047afcd)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:16.321911 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e30dd5-a522-4bce-9fd4-6ed098b08763 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:16.537412 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:16.543490 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d3e30dd5-a522-4bce-9fd4-6ed098b08763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '404b6447fa654c7f944115437047afcd'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:16.632155 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d3e30dd5-a522-4bce-9fd4-6ed098b08763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '404b6447fa654c7f944115437047afcd'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:16.632831 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d3e30dd5-a522-4bce-9fd4-6ed098b08763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '404b6447fa654c7f944115437047afcd'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:16.633528 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d3e30dd5-a522-4bce-9fd4-6ed098b08763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '404b6447fa654c7f944115437047afcd'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:16.641103 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d3e30dd5-a522-4bce-9fd4-6ed098b08763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '404b6447fa654c7f944115437047afcd'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:16.659954 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1404/2817] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:03:16 2022] DELETE /identity/v3/users/404b6447fa654c7f944115437047afcd => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:03:16.664460 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7558720-10c2-435b-883c-565698ddd904 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:16.664821 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7558720-10c2-435b-883c-565698ddd904 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:16.665105 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7558720-10c2-435b-883c-565698ddd904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:16.682488 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b7558720-10c2-435b-883c-565698ddd904 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:16.683700 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b7558720-10c2-435b-883c-565698ddd904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:16.689002 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:16.743352 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1414/2818] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:03:16.753882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e30dd5-a522-4bce-9fd4-6ed098b08763 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:16.755339 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d3e30dd5-a522-4bce-9fd4-6ed098b08763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:16.814216 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e30dd5-a522-4bce-9fd4-6ed098b08763 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:16.818571 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c2cb3-1b36-4155-9c07-74641cd25270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:16.819320 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c2cb3-1b36-4155-9c07-74641cd25270 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:16.819517 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c2cb3-1b36-4155-9c07-74641cd25270 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:16.819820 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c2cb3-1b36-4155-9c07-74641cd25270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:16.833044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c2cb3-1b36-4155-9c07-74641cd25270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:16.834665 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c2cb3-1b36-4155-9c07-74641cd25270 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:16.845566 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1405/2819] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:03:17.319629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7558720-10c2-435b-883c-565698ddd904 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:17.321603 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b7558720-10c2-435b-883c-565698ddd904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:17.334972 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7558720-10c2-435b-883c-565698ddd904 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:17.339973 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3731827-4461-4024-906a-36298da32ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:17.340944 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3731827-4461-4024-906a-36298da32ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:17.341339 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3731827-4461-4024-906a-36298da32ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:17.341871 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3731827-4461-4024-906a-36298da32ccf admin admin] PATH_INFO: `/v3/projects/c7e70210d8064765be5bbb95d636b36c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:17.343087 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3731827-4461-4024-906a-36298da32ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e70210d8064765be5bbb95d636b36c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:17.345072 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3731827-4461-4024-906a-36298da32ccf admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:17.445831 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b3731827-4461-4024-906a-36298da32ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e70210d8064765be5bbb95d636b36c', 'request_id': 'req-b3731827-4461-4024-906a-36298da32ccf'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:17.466939 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c2cb3-1b36-4155-9c07-74641cd25270 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:17.468437 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9b5c2cb3-1b36-4155-9c07-74641cd25270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:17.480553 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c2cb3-1b36-4155-9c07-74641cd25270 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:17.528425 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940bd61-da54-4439-85ec-cefba4598dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:17.529072 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940bd61-da54-4439-85ec-cefba4598dee service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:17.529385 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940bd61-da54-4439-85ec-cefba4598dee service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:17.529670 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940bd61-da54-4439-85ec-cefba4598dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:17.531444 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3940bd61-da54-4439-85ec-cefba4598dee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:17.563338 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b3731827-4461-4024-906a-36298da32ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e70210d8064765be5bbb95d636b36c', 'request_id': 'req-b3731827-4461-4024-906a-36298da32ccf'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:17.570053 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b3731827-4461-4024-906a-36298da32ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e70210d8064765be5bbb95d636b36c', 'request_id': 'req-b3731827-4461-4024-906a-36298da32ccf'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:17.581903 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b3731827-4461-4024-906a-36298da32ccf admin admin] The token cache is being invalidate because project c7e70210d8064765be5bbb95d636b36c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:03:17.582397 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b3731827-4461-4024-906a-36298da32ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:17.583047 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b3731827-4461-4024-906a-36298da32ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:17.584829 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1415/2820] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:03:17 2022] DELETE /identity/v3/projects/c7e70210d8064765be5bbb95d636b36c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:03:17.589411 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2543c-424b-47dc-92b9-da6ff5fbe5b1 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:17.589698 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2543c-424b-47dc-92b9-da6ff5fbe5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:17.589977 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2543c-424b-47dc-92b9-da6ff5fbe5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:17.604374 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940bd61-da54-4439-85ec-cefba4598dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:17.605847 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940bd61-da54-4439-85ec-cefba4598dee service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:17.608730 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4ef2543c-424b-47dc-92b9-da6ff5fbe5b1 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:17.609964 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4ef2543c-424b-47dc-92b9-da6ff5fbe5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:17.611924 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:17.617775 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1406/2821] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:03:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:03:17.673866 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1416/2822] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:03:17.681767 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c328cc-ebeb-47f5-8133-0e973f4f9817 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:17.682054 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c328cc-ebeb-47f5-8133-0e973f4f9817 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:17.682328 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c328cc-ebeb-47f5-8133-0e973f4f9817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:17.700588 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-40c328cc-ebeb-47f5-8133-0e973f4f9817 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:17.701774 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-40c328cc-ebeb-47f5-8133-0e973f4f9817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:17.710732 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1407/2823] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:03:17.715161 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2543c-424b-47dc-92b9-da6ff5fbe5b1 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:17.726005 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2543c-424b-47dc-92b9-da6ff5fbe5b1 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:17.730599 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ee07e-bb28-4ab1-8475-dd38f61d4672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:17.731254 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ee07e-bb28-4ab1-8475-dd38f61d4672 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:17.731538 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ee07e-bb28-4ab1-8475-dd38f61d4672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:17.731812 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ee07e-bb28-4ab1-8475-dd38f61d4672 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:17.732527 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ee07e-bb28-4ab1-8475-dd38f61d4672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:03:17.732833 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ee07e-bb28-4ab1-8475-dd38f61d4672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:17.734489 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ee07e-bb28-4ab1-8475-dd38f61d4672 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:17.746323 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1417/2824] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:03:17.750592 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c328cc-ebeb-47f5-8133-0e973f4f9817 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:17.760414 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c328cc-ebeb-47f5-8133-0e973f4f9817 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:17.765083 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a287f46-6cb8-4a36-8673-86d2d1a7f37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:17.765769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a287f46-6cb8-4a36-8673-86d2d1a7f37d admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:17.766052 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a287f46-6cb8-4a36-8673-86d2d1a7f37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:17.766327 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a287f46-6cb8-4a36-8673-86d2d1a7f37d admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:17.767022 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a287f46-6cb8-4a36-8673-86d2d1a7f37d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:17.769643 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a287f46-6cb8-4a36-8673-86d2d1a7f37d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:17.835486 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1408/2825] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:03:17 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:03:17.840784 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ee07e-bb28-4ab1-8475-dd38f61d4672 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:17.853841 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ee07e-bb28-4ab1-8475-dd38f61d4672 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:17.879934 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:17.919091 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51acb100-8567-46d2-8f83-2b87c1f1052f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:17.920482 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acb100-8567-46d2-8f83-2b87c1f1052f admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:17.920798 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acb100-8567-46d2-8f83-2b87c1f1052f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:17.921076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acb100-8567-46d2-8f83-2b87c1f1052f admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:17.921858 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51acb100-8567-46d2-8f83-2b87c1f1052f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:17.923800 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51acb100-8567-46d2-8f83-2b87c1f1052f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:18.021827 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1418/2826] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:03:17 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:03:18.025860 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a287f46-6cb8-4a36-8673-86d2d1a7f37d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:18.036281 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a287f46-6cb8-4a36-8673-86d2d1a7f37d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:18.040938 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c5108-bed1-4f04-8e1a-799f7c96e9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:18.046099 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c5108-bed1-4f04-8e1a-799f7c96e9ae admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:18.046099 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c5108-bed1-4f04-8e1a-799f7c96e9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:18.046099 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c5108-bed1-4f04-8e1a-799f7c96e9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:18.046099 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c5108-bed1-4f04-8e1a-799f7c96e9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:18.046099 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c5108-bed1-4f04-8e1a-799f7c96e9ae admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:18.055167 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1409/2827] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:03:18.059644 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51acb100-8567-46d2-8f83-2b87c1f1052f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:18.070810 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51acb100-8567-46d2-8f83-2b87c1f1052f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:18.076495 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb945631-bcf0-461d-ac58-1a2ebe007fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:18.083825 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb945631-bcf0-461d-ac58-1a2ebe007fad admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:18.083825 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb945631-bcf0-461d-ac58-1a2ebe007fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:18.083825 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb945631-bcf0-461d-ac58-1a2ebe007fad admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:18.083825 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb945631-bcf0-461d-ac58-1a2ebe007fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:18.083825 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb945631-bcf0-461d-ac58-1a2ebe007fad admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:18.093333 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1419/2828] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:03:18.097609 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c5108-bed1-4f04-8e1a-799f7c96e9ae admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:18.108182 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c5108-bed1-4f04-8e1a-799f7c96e9ae admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:18.112903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826c112-b337-40ee-b88a-281c4e75b6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:18.114930 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826c112-b337-40ee-b88a-281c4e75b6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:18.114930 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826c112-b337-40ee-b88a-281c4e75b6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:18.114930 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826c112-b337-40ee-b88a-281c4e75b6ee admin admin] PATH_INFO: `/v3/projects/3ee16ff7cb7245d99a7fe1043df37b7a/users/ab49cd89bbc241e58664a1d8ba168ef5/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:18.130715 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826c112-b337-40ee-b88a-281c4e75b6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee16ff7cb7245d99a7fe1043df37b7a, user_id=ab49cd89bbc241e58664a1d8ba168ef5, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:18.133414 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826c112-b337-40ee-b88a-281c4e75b6ee admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:18.227468 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1410/2829] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:03:18 2022] PUT /identity/v3/projects/3ee16ff7cb7245d99a7fe1043df37b7a/users/ab49cd89bbc241e58664a1d8ba168ef5/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:03:18.239457 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eacf6-cc84-401f-8cde-e626fc9e6752 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:18.239774 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eacf6-cc84-401f-8cde-e626fc9e6752 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:18.240057 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eacf6-cc84-401f-8cde-e626fc9e6752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:18.268487 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4f9eacf6-cc84-401f-8cde-e626fc9e6752 None None] MFA Rules not processed for user `ab49cd89bbc241e58664a1d8ba168ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:18.269827 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4f9eacf6-cc84-401f-8cde-e626fc9e6752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:18.337673 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1420/2830] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:03:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:03:18.349070 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826c112-b337-40ee-b88a-281c4e75b6ee admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:18.351184 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4826c112-b337-40ee-b88a-281c4e75b6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:18.411282 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826c112-b337-40ee-b88a-281c4e75b6ee admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:18.414974 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef94d9-0f20-4dbe-a417-583a25bc2726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8be9c9fb92c049c18a54b25725a34a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:18.415625 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef94d9-0f20-4dbe-a417-583a25bc2726 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:18.415907 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef94d9-0f20-4dbe-a417-583a25bc2726 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:18.416184 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef94d9-0f20-4dbe-a417-583a25bc2726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:18.425390 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef94d9-0f20-4dbe-a417-583a25bc2726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:18.426851 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef94d9-0f20-4dbe-a417-583a25bc2726 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:18.436759 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1411/2831] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:03:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:03:20.141516 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3fa83-4fc6-4a55-8a0d-ac68883beba8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:20.142215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3fa83-4fc6-4a55-8a0d-ac68883beba8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:20.142215 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3fa83-4fc6-4a55-8a0d-ac68883beba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:20.162382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c8c3fa83-4fc6-4a55-8a0d-ac68883beba8 None None] MFA Rules not processed for user `4d2ab3eeb5b44979956dd223ac6b7c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:20.165146 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c8c3fa83-4fc6-4a55-8a0d-ac68883beba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:20.221391 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1421/2832] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 17:03:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:03:20.413513 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef94d9-0f20-4dbe-a417-583a25bc2726 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:20.415105 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-48ef94d9-0f20-4dbe-a417-583a25bc2726 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:20.488426 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef94d9-0f20-4dbe-a417-583a25bc2726 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:20.493667 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6721c7-842e-476f-afa8-bbcc83700b82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cc455638fb4db4939af3657ab4203e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:20.494380 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6721c7-842e-476f-afa8-bbcc83700b82 service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:20.494691 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6721c7-842e-476f-afa8-bbcc83700b82 service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:20.494970 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6721c7-842e-476f-afa8-bbcc83700b82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:20.504541 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6721c7-842e-476f-afa8-bbcc83700b82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:20.506263 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6721c7-842e-476f-afa8-bbcc83700b82 service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:20.518159 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1412/2833] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 17:03:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:03:21.487264 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dbab7-5743-4a3a-b456-1a47b77d27e6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:21.488336 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dbab7-5743-4a3a-b456-1a47b77d27e6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:21.488816 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dbab7-5743-4a3a-b456-1a47b77d27e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:21.510213 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-689dbab7-5743-4a3a-b456-1a47b77d27e6 None None] MFA Rules not processed for user `4d2ab3eeb5b44979956dd223ac6b7c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:21.511694 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-689dbab7-5743-4a3a-b456-1a47b77d27e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:21.521628 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1422/2834] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 26 17:03:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:03:21.534408 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6721c7-842e-476f-afa8-bbcc83700b82 service swift] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:21.546253 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6721c7-842e-476f-afa8-bbcc83700b82 service swift] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:21.551741 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af796e-d7cb-4d80-8458-8a3c8b018491 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cc455638fb4db4939af3657ab4203e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:21.552395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af796e-d7cb-4d80-8458-8a3c8b018491 service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:21.552702 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af796e-d7cb-4d80-8458-8a3c8b018491 service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:21.553181 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af796e-d7cb-4d80-8458-8a3c8b018491 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:21.562290 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af796e-d7cb-4d80-8458-8a3c8b018491 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:21.563882 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af796e-d7cb-4d80-8458-8a3c8b018491 service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:21.573707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1413/2835] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 17:03:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:03:22.366454 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed06cd-f1e2-4187-af92-0bd644425cca None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:22.366454 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed06cd-f1e2-4187-af92-0bd644425cca None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:22.366454 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed06cd-f1e2-4187-af92-0bd644425cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:22.370222 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-03ed06cd-f1e2-4187-af92-0bd644425cca None None] MFA Rules not processed for user `4d2ab3eeb5b44979956dd223ac6b7c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:22.371433 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-03ed06cd-f1e2-4187-af92-0bd644425cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:22.378854 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1423/2836] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 17:03:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:03:22.391262 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af796e-d7cb-4d80-8458-8a3c8b018491 service swift] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:22.402849 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af796e-d7cb-4d80-8458-8a3c8b018491 service swift] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:22.408352 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e70d2-8089-4dc9-9771-d3623ebd016e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cc455638fb4db4939af3657ab4203e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:22.409534 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e70d2-8089-4dc9-9771-d3623ebd016e service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:22.409828 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e70d2-8089-4dc9-9771-d3623ebd016e service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:22.410110 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e70d2-8089-4dc9-9771-d3623ebd016e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:22.419113 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e70d2-8089-4dc9-9771-d3623ebd016e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:22.420825 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e70d2-8089-4dc9-9771-d3623ebd016e service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:22.429912 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1414/2837] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 17:03:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:03:22.756217 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed06cd-f1e2-4187-af92-0bd644425cca None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:22.781758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:22.819801 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed06cd-f1e2-4187-af92-0bd644425cca None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:22.824435 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0299ba-de2c-4683-8797-26ed20ca8695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:22.825360 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0299ba-de2c-4683-8797-26ed20ca8695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:22.829741 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0299ba-de2c-4683-8797-26ed20ca8695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:22.829741 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0299ba-de2c-4683-8797-26ed20ca8695 admin admin] PATH_INFO: `/v3/users/ab49cd89bbc241e58664a1d8ba168ef5` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:22.829741 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0299ba-de2c-4683-8797-26ed20ca8695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab49cd89bbc241e58664a1d8ba168ef5)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:22.829741 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0299ba-de2c-4683-8797-26ed20ca8695 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:23.079963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ee03b-92ce-4bbd-8307-503d0014847d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:23.079963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ee03b-92ce-4bbd-8307-503d0014847d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:23.079963 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ee03b-92ce-4bbd-8307-503d0014847d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:23.082430 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:23.094640 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-857ee03b-92ce-4bbd-8307-503d0014847d None None] MFA Rules not processed for user `4d2ab3eeb5b44979956dd223ac6b7c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:23.095807 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-857ee03b-92ce-4bbd-8307-503d0014847d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:23.103516 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1415/2838] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 26 17:03:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:03:23.115647 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ee03b-92ce-4bbd-8307-503d0014847d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:23.127961 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ee03b-92ce-4bbd-8307-503d0014847d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:23.133614 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c91d9b-f985-4324-ad53-ac375c77fbef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cc455638fb4db4939af3657ab4203e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:23.134254 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c91d9b-f985-4324-ad53-ac375c77fbef service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:23.134540 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c91d9b-f985-4324-ad53-ac375c77fbef service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:23.134820 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c91d9b-f985-4324-ad53-ac375c77fbef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:23.144851 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c91d9b-f985-4324-ad53-ac375c77fbef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:23.146490 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c91d9b-f985-4324-ad53-ac375c77fbef service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:23.151838 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7c0299ba-de2c-4683-8797-26ed20ca8695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab49cd89bbc241e58664a1d8ba168ef5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:23.151838 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7c0299ba-de2c-4683-8797-26ed20ca8695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab49cd89bbc241e58664a1d8ba168ef5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:23.159104 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7c0299ba-de2c-4683-8797-26ed20ca8695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab49cd89bbc241e58664a1d8ba168ef5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:23.162253 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1416/2839] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 17:03:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 17:03:23.260410 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7c0299ba-de2c-4683-8797-26ed20ca8695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab49cd89bbc241e58664a1d8ba168ef5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:23.261119 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7c0299ba-de2c-4683-8797-26ed20ca8695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab49cd89bbc241e58664a1d8ba168ef5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:23.280891 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1424/2840] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:03:22 2022] DELETE /identity/v3/users/ab49cd89bbc241e58664a1d8ba168ef5 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:03:23.285558 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4adbb6-ead7-41ff-ac85-7d0f229f995b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:23.285844 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4adbb6-ead7-41ff-ac85-7d0f229f995b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:23.286145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4adbb6-ead7-41ff-ac85-7d0f229f995b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:23.304537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bd4adbb6-ead7-41ff-ac85-7d0f229f995b None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:23.305812 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bd4adbb6-ead7-41ff-ac85-7d0f229f995b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:23.369511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1417/2841] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:03:23.380183 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0299ba-de2c-4683-8797-26ed20ca8695 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:23.381850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7c0299ba-de2c-4683-8797-26ed20ca8695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:23.444399 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0299ba-de2c-4683-8797-26ed20ca8695 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:23.448112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aa9db-01e3-45a2-9204-26f1751e5224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:23.448760 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aa9db-01e3-45a2-9204-26f1751e5224 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:23.452744 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aa9db-01e3-45a2-9204-26f1751e5224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:23.452744 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aa9db-01e3-45a2-9204-26f1751e5224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:23.459183 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4aa9db-01e3-45a2-9204-26f1751e5224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:23.460621 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4aa9db-01e3-45a2-9204-26f1751e5224 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:23.470824 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1425/2842] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:03:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:03:23.994268 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4adbb6-ead7-41ff-ac85-7d0f229f995b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:23.996707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bd4adbb6-ead7-41ff-ac85-7d0f229f995b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:24.009826 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4adbb6-ead7-41ff-ac85-7d0f229f995b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:24.015030 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac99a7d-b1d9-4f11-8243-97167398377d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:24.016221 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac99a7d-b1d9-4f11-8243-97167398377d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:24.018700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac99a7d-b1d9-4f11-8243-97167398377d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:24.018700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac99a7d-b1d9-4f11-8243-97167398377d admin admin] PATH_INFO: `/v3/projects/3ee16ff7cb7245d99a7fe1043df37b7a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:24.018700 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac99a7d-b1d9-4f11-8243-97167398377d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee16ff7cb7245d99a7fe1043df37b7a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:24.020822 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac99a7d-b1d9-4f11-8243-97167398377d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:24.135867 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5ac99a7d-b1d9-4f11-8243-97167398377d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee16ff7cb7245d99a7fe1043df37b7a', 'request_id': 'req-5ac99a7d-b1d9-4f11-8243-97167398377d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:24.141487 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5ac99a7d-b1d9-4f11-8243-97167398377d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee16ff7cb7245d99a7fe1043df37b7a', 'request_id': 'req-5ac99a7d-b1d9-4f11-8243-97167398377d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:24.149888 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5ac99a7d-b1d9-4f11-8243-97167398377d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee16ff7cb7245d99a7fe1043df37b7a', 'request_id': 'req-5ac99a7d-b1d9-4f11-8243-97167398377d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:24.231736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5ac99a7d-b1d9-4f11-8243-97167398377d admin admin] The token cache is being invalidate because project 3ee16ff7cb7245d99a7fe1043df37b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:03:24.232023 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5ac99a7d-b1d9-4f11-8243-97167398377d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:24.232670 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5ac99a7d-b1d9-4f11-8243-97167398377d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:24.234269 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1418/2843] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:03:23 2022] DELETE /identity/v3/projects/3ee16ff7cb7245d99a7fe1043df37b7a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:03:25.907606 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aa9db-01e3-45a2-9204-26f1751e5224 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:25.909036 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ad4aa9db-01e3-45a2-9204-26f1751e5224 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:25.922935 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aa9db-01e3-45a2-9204-26f1751e5224 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:25.968984 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:25.982168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc00f2-b3af-4cda-8efc-89e458f0b2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:25.983050 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc00f2-b3af-4cda-8efc-89e458f0b2b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:25.983332 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc00f2-b3af-4cda-8efc-89e458f0b2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:25.983609 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc00f2-b3af-4cda-8efc-89e458f0b2b5 admin admin] PATH_INFO: `/v3/users/fd4ebe90383349929464a3dca691b92b` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:25.984800 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc00f2-b3af-4cda-8efc-89e458f0b2b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd4ebe90383349929464a3dca691b92b)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:25.986819 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc00f2-b3af-4cda-8efc-89e458f0b2b5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:26.146189 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e2bc00f2-b3af-4cda-8efc-89e458f0b2b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd4ebe90383349929464a3dca691b92b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:26.146864 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e2bc00f2-b3af-4cda-8efc-89e458f0b2b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd4ebe90383349929464a3dca691b92b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:26.154061 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e2bc00f2-b3af-4cda-8efc-89e458f0b2b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd4ebe90383349929464a3dca691b92b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:26.237852 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e2bc00f2-b3af-4cda-8efc-89e458f0b2b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd4ebe90383349929464a3dca691b92b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:26.238481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e2bc00f2-b3af-4cda-8efc-89e458f0b2b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd4ebe90383349929464a3dca691b92b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:26.256860 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1426/2844] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:03:25 2022] DELETE /identity/v3/users/fd4ebe90383349929464a3dca691b92b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:03:26.261537 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499eede9-01cc-4060-9d46-10fa72807827 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:26.266703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499eede9-01cc-4060-9d46-10fa72807827 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:26.266703 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499eede9-01cc-4060-9d46-10fa72807827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:26.280241 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-499eede9-01cc-4060-9d46-10fa72807827 None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:26.281480 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-499eede9-01cc-4060-9d46-10fa72807827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:26.351233 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1419/2845] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:03:26.360909 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc00f2-b3af-4cda-8efc-89e458f0b2b5 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:26.362484 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e2bc00f2-b3af-4cda-8efc-89e458f0b2b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:26.422560 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc00f2-b3af-4cda-8efc-89e458f0b2b5 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:26.426507 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68ef75-ad37-4bb5-9734-b3e96d38076d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:26.427733 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68ef75-ad37-4bb5-9734-b3e96d38076d service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:26.428069 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68ef75-ad37-4bb5-9734-b3e96d38076d service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:26.428360 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68ef75-ad37-4bb5-9734-b3e96d38076d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:26.437774 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68ef75-ad37-4bb5-9734-b3e96d38076d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:26.439203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68ef75-ad37-4bb5-9734-b3e96d38076d service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:26.449538 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1427/2846] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:03:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:03:26.725169 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499eede9-01cc-4060-9d46-10fa72807827 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:26.736346 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-499eede9-01cc-4060-9d46-10fa72807827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:26.742526 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499eede9-01cc-4060-9d46-10fa72807827 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:26.748555 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02bd68-0543-4f84-badc-71064f2cab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:26.749303 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02bd68-0543-4f84-badc-71064f2cab9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:26.749515 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02bd68-0543-4f84-badc-71064f2cab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:26.749787 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02bd68-0543-4f84-badc-71064f2cab9d admin admin] PATH_INFO: `/v3/projects/5709ce2fac32449a929d5a4064fdd532` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:26.751049 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02bd68-0543-4f84-badc-71064f2cab9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5709ce2fac32449a929d5a4064fdd532)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:26.752970 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02bd68-0543-4f84-badc-71064f2cab9d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:26.755423 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:26.890714 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ee02bd68-0543-4f84-badc-71064f2cab9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5709ce2fac32449a929d5a4064fdd532', 'request_id': 'req-ee02bd68-0543-4f84-badc-71064f2cab9d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:26.896774 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ee02bd68-0543-4f84-badc-71064f2cab9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5709ce2fac32449a929d5a4064fdd532', 'request_id': 'req-ee02bd68-0543-4f84-badc-71064f2cab9d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:26.904088 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ee02bd68-0543-4f84-badc-71064f2cab9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5709ce2fac32449a929d5a4064fdd532', 'request_id': 'req-ee02bd68-0543-4f84-badc-71064f2cab9d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:27.062491 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ee02bd68-0543-4f84-badc-71064f2cab9d admin admin] The token cache is being invalidate because project 5709ce2fac32449a929d5a4064fdd532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:03:27.086243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ee02bd68-0543-4f84-badc-71064f2cab9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:27.086243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ee02bd68-0543-4f84-badc-71064f2cab9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:27.086243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1420/2847] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:03:26 2022] DELETE /identity/v3/projects/5709ce2fac32449a929d5a4064fdd532 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:03:31.066862 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68ef75-ad37-4bb5-9734-b3e96d38076d service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:31.070617 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8d68ef75-ad37-4bb5-9734-b3e96d38076d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:31.086461 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68ef75-ad37-4bb5-9734-b3e96d38076d service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:31.144390 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e330310-2051-4baf-9406-5ad23dd29a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:31.145298 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e330310-2051-4baf-9406-5ad23dd29a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:31.145619 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e330310-2051-4baf-9406-5ad23dd29a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:31.146456 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e330310-2051-4baf-9406-5ad23dd29a50 admin admin] PATH_INFO: `/v3/users/284df7837ac84a98992207ac01587020` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:31.147702 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e330310-2051-4baf-9406-5ad23dd29a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=284df7837ac84a98992207ac01587020)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:31.149834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e330310-2051-4baf-9406-5ad23dd29a50 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:31.155521 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:31.332639 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4e330310-2051-4baf-9406-5ad23dd29a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '284df7837ac84a98992207ac01587020'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:31.333358 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4e330310-2051-4baf-9406-5ad23dd29a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '284df7837ac84a98992207ac01587020'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:31.340629 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4e330310-2051-4baf-9406-5ad23dd29a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '284df7837ac84a98992207ac01587020'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:31.431730 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4e330310-2051-4baf-9406-5ad23dd29a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '284df7837ac84a98992207ac01587020'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:31.432274 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4e330310-2051-4baf-9406-5ad23dd29a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '284df7837ac84a98992207ac01587020'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:31.451605 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1428/2848] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:03:31 2022] DELETE /identity/v3/users/284df7837ac84a98992207ac01587020 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:03:31.714389 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02bd68-0543-4f84-badc-71064f2cab9d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:31.715946 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ee02bd68-0543-4f84-badc-71064f2cab9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:31.729886 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02bd68-0543-4f84-badc-71064f2cab9d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:31.789743 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdf28f-83d8-4073-927c-396acc33c59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:31.790609 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdf28f-83d8-4073-927c-396acc33c59b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:31.790883 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdf28f-83d8-4073-927c-396acc33c59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:31.791170 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdf28f-83d8-4073-927c-396acc33c59b admin admin] PATH_INFO: `/v3/projects/c6ad6af479db4e92933ac0d1567f25e1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:31.792362 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbdf28f-83d8-4073-927c-396acc33c59b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6ad6af479db4e92933ac0d1567f25e1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:31.794408 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbdf28f-83d8-4073-927c-396acc33c59b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:31.914216 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2fbdf28f-83d8-4073-927c-396acc33c59b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6ad6af479db4e92933ac0d1567f25e1', 'request_id': 'req-2fbdf28f-83d8-4073-927c-396acc33c59b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:31.919612 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2fbdf28f-83d8-4073-927c-396acc33c59b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6ad6af479db4e92933ac0d1567f25e1', 'request_id': 'req-2fbdf28f-83d8-4073-927c-396acc33c59b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:31.925982 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2fbdf28f-83d8-4073-927c-396acc33c59b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6ad6af479db4e92933ac0d1567f25e1', 'request_id': 'req-2fbdf28f-83d8-4073-927c-396acc33c59b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:32.054691 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2fbdf28f-83d8-4073-927c-396acc33c59b admin admin] The token cache is being invalidate because project c6ad6af479db4e92933ac0d1567f25e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:03:32.054989 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2fbdf28f-83d8-4073-927c-396acc33c59b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:32.055637 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2fbdf28f-83d8-4073-927c-396acc33c59b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:32.057253 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1421/2849] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:03:31 2022] DELETE /identity/v3/projects/c6ad6af479db4e92933ac0d1567f25e1 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:03:32.062671 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef739c-2bc1-425c-af87-e15c3b10adec None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:32.062965 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef739c-2bc1-425c-af87-e15c3b10adec None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:32.063245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef739c-2bc1-425c-af87-e15c3b10adec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:32.083690 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-bfef739c-2bc1-425c-af87-e15c3b10adec None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:32.085006 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bfef739c-2bc1-425c-af87-e15c3b10adec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:32.147331 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1429/2850] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:03:32.207449 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b35562-bc7a-4a66-8c73-f210f3647d8a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:32.207806 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b35562-bc7a-4a66-8c73-f210f3647d8a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:32.208589 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b35562-bc7a-4a66-8c73-f210f3647d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:32.228478 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-07b35562-bc7a-4a66-8c73-f210f3647d8a None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:32.229684 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-07b35562-bc7a-4a66-8c73-f210f3647d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:32.237901 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1422/2851] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:03:32.242598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef739c-2bc1-425c-af87-e15c3b10adec None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:32.252353 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef739c-2bc1-425c-af87-e15c3b10adec None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:32.256983 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facae3b3-7437-49fa-883e-fcadc1462bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:32.257678 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facae3b3-7437-49fa-883e-fcadc1462bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:32.257962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facae3b3-7437-49fa-883e-fcadc1462bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:32.258240 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facae3b3-7437-49fa-883e-fcadc1462bd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:32.258962 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facae3b3-7437-49fa-883e-fcadc1462bd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:03:32.259269 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facae3b3-7437-49fa-883e-fcadc1462bd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:32.261342 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facae3b3-7437-49fa-883e-fcadc1462bd3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:32.273826 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1430/2852] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 17:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:03:32.278259 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b35562-bc7a-4a66-8c73-f210f3647d8a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:32.288786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b35562-bc7a-4a66-8c73-f210f3647d8a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:32.293831 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfa4bd-493b-45d4-b3a3-4c38552a26c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:32.294524 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfa4bd-493b-45d4-b3a3-4c38552a26c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:32.294808 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfa4bd-493b-45d4-b3a3-4c38552a26c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:32.295086 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfa4bd-493b-45d4-b3a3-4c38552a26c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:32.295809 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfa4bd-493b-45d4-b3a3-4c38552a26c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:32.297814 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfa4bd-493b-45d4-b3a3-4c38552a26c7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:32.309181 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:32.387608 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1423/2853] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:03:32 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:03:32.391882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facae3b3-7437-49fa-883e-fcadc1462bd3 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:32.402863 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facae3b3-7437-49fa-883e-fcadc1462bd3 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:32.461726 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cb3db-a0d9-4c20-803f-cdf6257db036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:32.462402 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cb3db-a0d9-4c20-803f-cdf6257db036 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:32.462695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cb3db-a0d9-4c20-803f-cdf6257db036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:32.462974 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cb3db-a0d9-4c20-803f-cdf6257db036 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:32.463667 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cb3db-a0d9-4c20-803f-cdf6257db036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:32.465770 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cb3db-a0d9-4c20-803f-cdf6257db036 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:32.559827 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1431/2854] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:03:32 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:03:32.563999 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfa4bd-493b-45d4-b3a3-4c38552a26c7 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:32.574769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfa4bd-493b-45d4-b3a3-4c38552a26c7 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:32.579555 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d0da5-1768-4801-8818-240e7e332c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:32.580215 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d0da5-1768-4801-8818-240e7e332c8a admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:32.580501 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d0da5-1768-4801-8818-240e7e332c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:32.580780 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d0da5-1768-4801-8818-240e7e332c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:32.581572 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d0da5-1768-4801-8818-240e7e332c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:32.583193 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d0da5-1768-4801-8818-240e7e332c8a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:32.593663 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1424/2855] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:03:32.597738 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cb3db-a0d9-4c20-803f-cdf6257db036 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:32.603753 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:32.609124 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cb3db-a0d9-4c20-803f-cdf6257db036 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:32.613864 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee4eef-627b-4f67-bb45-57007c053bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:32.615161 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee4eef-627b-4f67-bb45-57007c053bfb admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:32.616689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee4eef-627b-4f67-bb45-57007c053bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:32.616689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee4eef-627b-4f67-bb45-57007c053bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:32.616689 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee4eef-627b-4f67-bb45-57007c053bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:32.618039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee4eef-627b-4f67-bb45-57007c053bfb admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:32.628882 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1432/2856] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:03:32.633914 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d0da5-1768-4801-8818-240e7e332c8a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:32.644695 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d0da5-1768-4801-8818-240e7e332c8a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:32.649652 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b7245-f5ed-49b7-a08a-1ab53158d370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:32.650544 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b7245-f5ed-49b7-a08a-1ab53158d370 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:32.650826 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b7245-f5ed-49b7-a08a-1ab53158d370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:32.651100 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b7245-f5ed-49b7-a08a-1ab53158d370 admin admin] PATH_INFO: `/v3/projects/0087e93bc2524a29b22a4adedec49ea6/users/d4864aa668bd4b3ba45d9570d94d4601/roles/cdbaa8196c574e32a331e8d4faee1a7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:32.667336 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b7245-f5ed-49b7-a08a-1ab53158d370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0087e93bc2524a29b22a4adedec49ea6, user_id=d4864aa668bd4b3ba45d9570d94d4601, role_id=cdbaa8196c574e32a331e8d4faee1a7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:32.674129 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b7245-f5ed-49b7-a08a-1ab53158d370 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:32.764272 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1425/2857] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:03:32 2022] PUT /identity/v3/projects/0087e93bc2524a29b22a4adedec49ea6/users/d4864aa668bd4b3ba45d9570d94d4601/roles/cdbaa8196c574e32a331e8d4faee1a7e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:03:32.769470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b3684-825a-4155-bb42-7231e9d65fdd None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:32.769758 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b3684-825a-4155-bb42-7231e9d65fdd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:32.770033 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b3684-825a-4155-bb42-7231e9d65fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:32.788797 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0e5b3684-825a-4155-bb42-7231e9d65fdd None None] MFA Rules not processed for user `ea68495bc01f41d2b0c2e34799485fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:32.790047 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0e5b3684-825a-4155-bb42-7231e9d65fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:32.850971 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1433/2858] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:03:32.860411 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b7245-f5ed-49b7-a08a-1ab53158d370 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:32.862158 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9a3b7245-f5ed-49b7-a08a-1ab53158d370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:32.920461 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b7245-f5ed-49b7-a08a-1ab53158d370 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:32.924202 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3c4b4-4a2b-4098-9779-d6ad5cac86d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:32.924854 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3c4b4-4a2b-4098-9779-d6ad5cac86d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:32.925134 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3c4b4-4a2b-4098-9779-d6ad5cac86d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:32.925445 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3c4b4-4a2b-4098-9779-d6ad5cac86d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:32.935603 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3c4b4-4a2b-4098-9779-d6ad5cac86d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:32.937044 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3c4b4-4a2b-4098-9779-d6ad5cac86d6 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:32.954697 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1426/2859] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:03:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:03:38.510421 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b3684-825a-4155-bb42-7231e9d65fdd None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:38.522073 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b3684-825a-4155-bb42-7231e9d65fdd None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:38.527191 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f255961-0880-47a7-b005-34ae347751d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:38.528369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f255961-0880-47a7-b005-34ae347751d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:38.528764 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f255961-0880-47a7-b005-34ae347751d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:38.529310 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f255961-0880-47a7-b005-34ae347751d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:38.532924 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5f255961-0880-47a7-b005-34ae347751d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:38.622334 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f255961-0880-47a7-b005-34ae347751d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:38.623948 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f255961-0880-47a7-b005-34ae347751d2 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:38.636517 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1434/2860] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:03:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:03:38.897455 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff5fb6-8b94-4754-b2c3-eaa5f5dc0104 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:38.898736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff5fb6-8b94-4754-b2c3-eaa5f5dc0104 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:38.899456 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff5fb6-8b94-4754-b2c3-eaa5f5dc0104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:38.948773 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-86ff5fb6-8b94-4754-b2c3-eaa5f5dc0104 None None] MFA Rules not processed for user `d4864aa668bd4b3ba45d9570d94d4601`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:38.950829 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-86ff5fb6-8b94-4754-b2c3-eaa5f5dc0104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:39.054724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1427/2861] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:03:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:03:39.059756 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f255961-0880-47a7-b005-34ae347751d2 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:39.074691 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f255961-0880-47a7-b005-34ae347751d2 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:39.082247 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95eab3-bbd2-4a9d-81c4-bc1a2eb73b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:39.083903 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95eab3-bbd2-4a9d-81c4-bc1a2eb73b17 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:39.083903 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95eab3-bbd2-4a9d-81c4-bc1a2eb73b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:39.083903 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95eab3-bbd2-4a9d-81c4-bc1a2eb73b17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:39.084342 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95eab3-bbd2-4a9d-81c4-bc1a2eb73b17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:39.086570 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95eab3-bbd2-4a9d-81c4-bc1a2eb73b17 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:39.197875 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1435/2862] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 17:03:39 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:03:39.202037 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff5fb6-8b94-4754-b2c3-eaa5f5dc0104 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:39.229961 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff5fb6-8b94-4754-b2c3-eaa5f5dc0104 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:39.313867 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:39.338243 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1e2bd-15f9-426f-90c9-e1ac6a3f09ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:39.339479 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1e2bd-15f9-426f-90c9-e1ac6a3f09ce admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:39.340045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1e2bd-15f9-426f-90c9-e1ac6a3f09ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:39.340588 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1e2bd-15f9-426f-90c9-e1ac6a3f09ce admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:39.341895 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1e2bd-15f9-426f-90c9-e1ac6a3f09ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:39.345775 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1e2bd-15f9-426f-90c9-e1ac6a3f09ce admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:39.473195 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1428/2863] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 17:03:39 2022] POST /identity/v3/users => generated 299 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:03:39.479741 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95eab3-bbd2-4a9d-81c4-bc1a2eb73b17 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:39.494964 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95eab3-bbd2-4a9d-81c4-bc1a2eb73b17 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:39.503422 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d797f8-1d42-4912-8023-70ae22d69e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:39.504245 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d797f8-1d42-4912-8023-70ae22d69e73 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:39.505189 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d797f8-1d42-4912-8023-70ae22d69e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:39.505568 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d797f8-1d42-4912-8023-70ae22d69e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:39.506598 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d797f8-1d42-4912-8023-70ae22d69e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:39.508218 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d797f8-1d42-4912-8023-70ae22d69e73 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:39.521219 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1436/2864] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:03:39.526117 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1e2bd-15f9-426f-90c9-e1ac6a3f09ce admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:39.539145 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1e2bd-15f9-426f-90c9-e1ac6a3f09ce admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:39.544468 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedea16-348e-4a50-84a9-bbb65037fd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:39.545443 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedea16-348e-4a50-84a9-bbb65037fd79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:39.545809 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedea16-348e-4a50-84a9-bbb65037fd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:39.546146 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedea16-348e-4a50-84a9-bbb65037fd79 admin admin] PATH_INFO: `/v3/projects/495755b184544ac2a11db912887d6472/users/dfb3795715994170b978f695af72e433/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:39.565784 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedea16-348e-4a50-84a9-bbb65037fd79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=495755b184544ac2a11db912887d6472, user_id=dfb3795715994170b978f695af72e433, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:39.569141 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedea16-348e-4a50-84a9-bbb65037fd79 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:39.705343 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1429/2865] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:03:39 2022] PUT /identity/v3/projects/495755b184544ac2a11db912887d6472/users/dfb3795715994170b978f695af72e433/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:03:39.710233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d797f8-1d42-4912-8023-70ae22d69e73 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:39.721303 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d797f8-1d42-4912-8023-70ae22d69e73 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:39.796261 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:39.803533 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8ad2d-3a9e-4006-bc91-f5743a759351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:39.804413 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8ad2d-3a9e-4006-bc91-f5743a759351 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:39.804767 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8ad2d-3a9e-4006-bc91-f5743a759351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:39.805112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8ad2d-3a9e-4006-bc91-f5743a759351 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:39.805966 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8ad2d-3a9e-4006-bc91-f5743a759351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:39.807696 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8ad2d-3a9e-4006-bc91-f5743a759351 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:39.827307 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1437/2866] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 17:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:03:39.831788 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedea16-348e-4a50-84a9-bbb65037fd79 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:39.843257 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedea16-348e-4a50-84a9-bbb65037fd79 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:39.848559 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3b367-4c85-4f01-9211-dbc329a8dcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:39.849545 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3b367-4c85-4f01-9211-dbc329a8dcae admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:39.849833 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3b367-4c85-4f01-9211-dbc329a8dcae admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:39.850367 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3b367-4c85-4f01-9211-dbc329a8dcae admin admin] PATH_INFO: `/v3/projects/495755b184544ac2a11db912887d6472/users/dfb3795715994170b978f695af72e433/roles/796e313fa8794ac885ccf6300d09332a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:39.852645 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3b367-4c85-4f01-9211-dbc329a8dcae admin admin] RBAC: Authorizing `identity:create_grant(project_id=495755b184544ac2a11db912887d6472, user_id=dfb3795715994170b978f695af72e433, role_id=796e313fa8794ac885ccf6300d09332a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:39.855379 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3b367-4c85-4f01-9211-dbc329a8dcae admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:39.869528 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1430/2867] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 17:03:39 2022] PUT /identity/v3/projects/495755b184544ac2a11db912887d6472/users/dfb3795715994170b978f695af72e433/roles/796e313fa8794ac885ccf6300d09332a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:03:41.906403 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8ad2d-3a9e-4006-bc91-f5743a759351 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:42.000453 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8ad2d-3a9e-4006-bc91-f5743a759351 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:42.091777 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff3215-ec19-4d0e-af92-b19e2e16a281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:42.092350 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff3215-ec19-4d0e-af92-b19e2e16a281 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:42.092859 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff3215-ec19-4d0e-af92-b19e2e16a281 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:42.093396 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff3215-ec19-4d0e-af92-b19e2e16a281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:42.097470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e2ff3215-ec19-4d0e-af92-b19e2e16a281 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:42.228729 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff3215-ec19-4d0e-af92-b19e2e16a281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:42.232092 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff3215-ec19-4d0e-af92-b19e2e16a281 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:42.268545 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1438/2868] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:03:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:03:46.488416 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3b367-4c85-4f01-9211-dbc329a8dcae admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:46.501528 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3b367-4c85-4f01-9211-dbc329a8dcae admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:46.511164 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc900187-0bbe-484c-ab5e-b83f13e2337e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:46.512326 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc900187-0bbe-484c-ab5e-b83f13e2337e service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:46.512511 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc900187-0bbe-484c-ab5e-b83f13e2337e service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:46.513050 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc900187-0bbe-484c-ab5e-b83f13e2337e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:46.515120 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bc900187-0bbe-484c-ab5e-b83f13e2337e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:46.603707 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc900187-0bbe-484c-ab5e-b83f13e2337e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:46.605409 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc900187-0bbe-484c-ab5e-b83f13e2337e service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:46.618434 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1431/2869] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:03:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:03:46.803531 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5048e-4423-4314-944b-61b64b09294b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:46.804083 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5048e-4423-4314-944b-61b64b09294b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:46.804083 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5048e-4423-4314-944b-61b64b09294b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:46.834797 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b1e5048e-4423-4314-944b-61b64b09294b None None] MFA Rules not processed for user `dfb3795715994170b978f695af72e433`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:46.836295 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b1e5048e-4423-4314-944b-61b64b09294b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:46.891685 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:46.928270 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1439/2870] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:03:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:03:46.943884 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc900187-0bbe-484c-ab5e-b83f13e2337e service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:46.945744 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bc900187-0bbe-484c-ab5e-b83f13e2337e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:47.028290 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc900187-0bbe-484c-ab5e-b83f13e2337e service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:47.032626 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a1c35-6d53-4d89-a00c-e5e5738686dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7701907eb3b24c3681352c91ad6a3aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:47.033345 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a1c35-6d53-4d89-a00c-e5e5738686dd service glance] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:47.033702 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a1c35-6d53-4d89-a00c-e5e5738686dd service glance] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:47.033980 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a1c35-6d53-4d89-a00c-e5e5738686dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:47.111927 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:47.126163 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a1c35-6d53-4d89-a00c-e5e5738686dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:47.127617 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a1c35-6d53-4d89-a00c-e5e5738686dd service glance] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:47.141801 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1432/2871] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:03:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:03:47.459485 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c48c52-9221-4595-9f3d-139c9f865d97 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:47.459782 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c48c52-9221-4595-9f3d-139c9f865d97 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:47.460039 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c48c52-9221-4595-9f3d-139c9f865d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:47.479644 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d7c48c52-9221-4595-9f3d-139c9f865d97 None None] MFA Rules not processed for user `4d2ab3eeb5b44979956dd223ac6b7c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:47.480883 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d7c48c52-9221-4595-9f3d-139c9f865d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:47.557141 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1440/2872] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 17:03:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:03:47.564310 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a1c35-6d53-4d89-a00c-e5e5738686dd service glance] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:47.566949 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ce6a1c35-6d53-4d89-a00c-e5e5738686dd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:47.671929 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a1c35-6d53-4d89-a00c-e5e5738686dd service glance] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:47.677219 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322190a5-0e84-414c-9ca0-145be7e5dfbf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cc455638fb4db4939af3657ab4203e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:47.677952 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322190a5-0e84-414c-9ca0-145be7e5dfbf service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:47.678232 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322190a5-0e84-414c-9ca0-145be7e5dfbf service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:47.678594 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322190a5-0e84-414c-9ca0-145be7e5dfbf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:47.691579 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322190a5-0e84-414c-9ca0-145be7e5dfbf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:47.695263 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322190a5-0e84-414c-9ca0-145be7e5dfbf service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:47.704670 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1433/2873] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 17:03:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:03:56.971374 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c48c52-9221-4595-9f3d-139c9f865d97 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:56.972951 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d7c48c52-9221-4595-9f3d-139c9f865d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:56.990077 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c48c52-9221-4595-9f3d-139c9f865d97 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:56.995225 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d0a61-a593-4361-a012-daf26d2eb4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:57.000319 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d0a61-a593-4361-a012-daf26d2eb4a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:57.000319 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d0a61-a593-4361-a012-daf26d2eb4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:57.000319 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d0a61-a593-4361-a012-daf26d2eb4a7 admin admin] PATH_INFO: `/v3/users/4e68c10e83634018b70ca664e1e8f08c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:57.000319 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d0a61-a593-4361-a012-daf26d2eb4a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e68c10e83634018b70ca664e1e8f08c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:57.001005 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d0a61-a593-4361-a012-daf26d2eb4a7 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:57.285373 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-565d0a61-a593-4361-a012-daf26d2eb4a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e68c10e83634018b70ca664e1e8f08c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:57.286235 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-565d0a61-a593-4361-a012-daf26d2eb4a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e68c10e83634018b70ca664e1e8f08c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:57.304494 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-565d0a61-a593-4361-a012-daf26d2eb4a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e68c10e83634018b70ca664e1e8f08c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:57.403103 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-565d0a61-a593-4361-a012-daf26d2eb4a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e68c10e83634018b70ca664e1e8f08c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:57.403740 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-565d0a61-a593-4361-a012-daf26d2eb4a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e68c10e83634018b70ca664e1e8f08c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:57.431676 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1441/2874] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:03:56 2022] DELETE /identity/v3/users/4e68c10e83634018b70ca664e1e8f08c => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:03:57.701720 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=37 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:57.712270 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322190a5-0e84-414c-9ca0-145be7e5dfbf service swift] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:57.736321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322190a5-0e84-414c-9ca0-145be7e5dfbf service swift] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:57.815302 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0f3ba-43a9-46fb-87aa-39fe6a1e3172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:57.816095 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0f3ba-43a9-46fb-87aa-39fe6a1e3172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:57.816391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0f3ba-43a9-46fb-87aa-39fe6a1e3172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:57.817179 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0f3ba-43a9-46fb-87aa-39fe6a1e3172 admin admin] PATH_INFO: `/v3/projects/b9562e9c747f4808a67c01436d9ede47` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:57.820022 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0f3ba-43a9-46fb-87aa-39fe6a1e3172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9562e9c747f4808a67c01436d9ede47)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:57.822066 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0f3ba-43a9-46fb-87aa-39fe6a1e3172 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:57.966724 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cbe0f3ba-43a9-46fb-87aa-39fe6a1e3172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9562e9c747f4808a67c01436d9ede47', 'request_id': 'req-cbe0f3ba-43a9-46fb-87aa-39fe6a1e3172'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:57.977015 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cbe0f3ba-43a9-46fb-87aa-39fe6a1e3172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9562e9c747f4808a67c01436d9ede47', 'request_id': 'req-cbe0f3ba-43a9-46fb-87aa-39fe6a1e3172'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:57.985161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cbe0f3ba-43a9-46fb-87aa-39fe6a1e3172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9562e9c747f4808a67c01436d9ede47', 'request_id': 'req-cbe0f3ba-43a9-46fb-87aa-39fe6a1e3172'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:58.246306 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cbe0f3ba-43a9-46fb-87aa-39fe6a1e3172 admin admin] The token cache is being invalidate because project b9562e9c747f4808a67c01436d9ede47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:03:58.246683 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cbe0f3ba-43a9-46fb-87aa-39fe6a1e3172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:58.247490 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cbe0f3ba-43a9-46fb-87aa-39fe6a1e3172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:58.249064 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1434/2875] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:03:57 2022] DELETE /identity/v3/projects/b9562e9c747f4808a67c01436d9ede47 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:03:58.253428 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d0a61-a593-4361-a012-daf26d2eb4a7 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:58.256275 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-565d0a61-a593-4361-a012-daf26d2eb4a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:58.271834 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d0a61-a593-4361-a012-daf26d2eb4a7 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:58.334298 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:58.344548 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff081f9-adb1-4801-8f4e-e4bb65c92219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:58.350714 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff081f9-adb1-4801-8f4e-e4bb65c92219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:58.350714 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff081f9-adb1-4801-8f4e-e4bb65c92219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:58.350714 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff081f9-adb1-4801-8f4e-e4bb65c92219 admin admin] PATH_INFO: `/v3/users/e45a747f756b46b982b4ab6091a592cf` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:58.350714 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff081f9-adb1-4801-8f4e-e4bb65c92219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e45a747f756b46b982b4ab6091a592cf)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:58.351886 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff081f9-adb1-4801-8f4e-e4bb65c92219 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:58.800455 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5ff081f9-adb1-4801-8f4e-e4bb65c92219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e45a747f756b46b982b4ab6091a592cf'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:58.801167 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5ff081f9-adb1-4801-8f4e-e4bb65c92219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e45a747f756b46b982b4ab6091a592cf'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:58.808233 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5ff081f9-adb1-4801-8f4e-e4bb65c92219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e45a747f756b46b982b4ab6091a592cf'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:58.923173 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5ff081f9-adb1-4801-8f4e-e4bb65c92219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e45a747f756b46b982b4ab6091a592cf'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:58.923797 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5ff081f9-adb1-4801-8f4e-e4bb65c92219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e45a747f756b46b982b4ab6091a592cf'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:58.942799 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1442/2876] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:03:58 2022] DELETE /identity/v3/users/e45a747f756b46b982b4ab6091a592cf => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:03:59.257126 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0f3ba-43a9-46fb-87aa-39fe6a1e3172 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:03:59.258783 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cbe0f3ba-43a9-46fb-87aa-39fe6a1e3172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:03:59.274528 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0f3ba-43a9-46fb-87aa-39fe6a1e3172 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:03:59.348942 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea07c1-a329-42c4-8a96-bfb9a51062e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:03:59.349787 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea07c1-a329-42c4-8a96-bfb9a51062e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:59.350329 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea07c1-a329-42c4-8a96-bfb9a51062e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:59.350607 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea07c1-a329-42c4-8a96-bfb9a51062e7 admin admin] PATH_INFO: `/v3/projects/c47b3f47f4274f978c20a051237a844f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:59.351953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea07c1-a329-42c4-8a96-bfb9a51062e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c47b3f47f4274f978c20a051237a844f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:03:59.354078 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea07c1-a329-42c4-8a96-bfb9a51062e7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:03:59.483045 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:59.495705 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ecea07c1-a329-42c4-8a96-bfb9a51062e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c47b3f47f4274f978c20a051237a844f', 'request_id': 'req-ecea07c1-a329-42c4-8a96-bfb9a51062e7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:59.501736 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ecea07c1-a329-42c4-8a96-bfb9a51062e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c47b3f47f4274f978c20a051237a844f', 'request_id': 'req-ecea07c1-a329-42c4-8a96-bfb9a51062e7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:59.509205 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ecea07c1-a329-42c4-8a96-bfb9a51062e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c47b3f47f4274f978c20a051237a844f', 'request_id': 'req-ecea07c1-a329-42c4-8a96-bfb9a51062e7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:59.633245 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ecea07c1-a329-42c4-8a96-bfb9a51062e7 admin admin] The token cache is being invalidate because project c47b3f47f4274f978c20a051237a844f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:03:59.633652 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ecea07c1-a329-42c4-8a96-bfb9a51062e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:59.634161 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ecea07c1-a329-42c4-8a96-bfb9a51062e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:03:59.635760 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1435/2877] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:03:59 2022] DELETE /identity/v3/projects/c47b3f47f4274f978c20a051237a844f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:03:59.944522 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a7775-a6be-4e22-a2f2-993feaf941d2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:03:59.945083 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a7775-a6be-4e22-a2f2-993feaf941d2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:03:59.945083 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a7775-a6be-4e22-a2f2-993feaf941d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:03:59.963390 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0c0a7775-a6be-4e22-a2f2-993feaf941d2 None None] MFA Rules not processed for user `d4864aa668bd4b3ba45d9570d94d4601`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:03:59.964623 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0c0a7775-a6be-4e22-a2f2-993feaf941d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:00.024464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1443/2878] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 17:03:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:00.286679 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea07c1-a329-42c4-8a96-bfb9a51062e7 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:00.288580 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ecea07c1-a329-42c4-8a96-bfb9a51062e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:00.347332 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea07c1-a329-42c4-8a96-bfb9a51062e7 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:00.353065 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e899bd-7c03-4bb6-9ecd-5a23d66317e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:00.353772 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e899bd-7c03-4bb6-9ecd-5a23d66317e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:00.354096 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e899bd-7c03-4bb6-9ecd-5a23d66317e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:00.354379 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e899bd-7c03-4bb6-9ecd-5a23d66317e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:00.356238 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-28e899bd-7c03-4bb6-9ecd-5a23d66317e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:00.366552 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e899bd-7c03-4bb6-9ecd-5a23d66317e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:00.367980 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e899bd-7c03-4bb6-9ecd-5a23d66317e2 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:00.376067 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1436/2879] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:04:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:00.783811 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a7775-a6be-4e22-a2f2-993feaf941d2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:00.785473 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0c0a7775-a6be-4e22-a2f2-993feaf941d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:00.864444 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a7775-a6be-4e22-a2f2-993feaf941d2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:00.869458 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567520b-8f26-4d3a-92a2-286aa09bf276 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beeefb9b8d394407a5e7a32f5a00ffad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:00.870192 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567520b-8f26-4d3a-92a2-286aa09bf276 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:00.870470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567520b-8f26-4d3a-92a2-286aa09bf276 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:00.870740 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567520b-8f26-4d3a-92a2-286aa09bf276 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:00.872670 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9567520b-8f26-4d3a-92a2-286aa09bf276 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:00.885610 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567520b-8f26-4d3a-92a2-286aa09bf276 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:00.887265 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567520b-8f26-4d3a-92a2-286aa09bf276 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:00.898348 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1444/2880] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:04:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:04.170391 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24dc4a-aa9d-4844-bd7b-90ad2eee26b3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:04.170889 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24dc4a-aa9d-4844-bd7b-90ad2eee26b3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:04.170978 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24dc4a-aa9d-4844-bd7b-90ad2eee26b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:04.190363 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1a24dc4a-aa9d-4844-bd7b-90ad2eee26b3 None None] MFA Rules not processed for user `4d2ab3eeb5b44979956dd223ac6b7c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:04:04.191591 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1a24dc4a-aa9d-4844-bd7b-90ad2eee26b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:04.258995 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1437/2881] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 17:04:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:04:04.275207 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567520b-8f26-4d3a-92a2-286aa09bf276 service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:04.275207 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9567520b-8f26-4d3a-92a2-286aa09bf276 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:04.284191 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:04.347407 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567520b-8f26-4d3a-92a2-286aa09bf276 service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:04.354130 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95672e61-d53f-462d-918e-4cf54374fc9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cc455638fb4db4939af3657ab4203e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:04.354812 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95672e61-d53f-462d-918e-4cf54374fc9b service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:04.355099 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95672e61-d53f-462d-918e-4cf54374fc9b service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:04.355384 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95672e61-d53f-462d-918e-4cf54374fc9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:04.364858 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95672e61-d53f-462d-918e-4cf54374fc9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:04.366932 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95672e61-d53f-462d-918e-4cf54374fc9b service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:04.375731 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1445/2882] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 17:04:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:04:04.575922 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24dc4a-aa9d-4844-bd7b-90ad2eee26b3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:04.577628 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1a24dc4a-aa9d-4844-bd7b-90ad2eee26b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:04.592394 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24dc4a-aa9d-4844-bd7b-90ad2eee26b3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:04.599100 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f48b5-8694-4219-a193-5bee270efaea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:04.600405 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f48b5-8694-4219-a193-5bee270efaea service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:04.600737 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f48b5-8694-4219-a193-5bee270efaea service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:04.601237 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f48b5-8694-4219-a193-5bee270efaea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:04.604390 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-858f48b5-8694-4219-a193-5bee270efaea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:04.616698 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f48b5-8694-4219-a193-5bee270efaea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:04.618286 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f48b5-8694-4219-a193-5bee270efaea service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:04.630905 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1438/2883] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:04:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:05.676593 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95672e61-d53f-462d-918e-4cf54374fc9b service swift] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:05.687059 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-95672e61-d53f-462d-918e-4cf54374fc9b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:05.873122 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95672e61-d53f-462d-918e-4cf54374fc9b service swift] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:05.880881 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df18a97-0d47-47ee-9163-179e47f165db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:05.881682 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df18a97-0d47-47ee-9163-179e47f165db service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:05.882157 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df18a97-0d47-47ee-9163-179e47f165db service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:05.882612 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df18a97-0d47-47ee-9163-179e47f165db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:05.886131 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5df18a97-0d47-47ee-9163-179e47f165db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:05.903824 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df18a97-0d47-47ee-9163-179e47f165db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:05.906070 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df18a97-0d47-47ee-9163-179e47f165db service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:05.923074 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1446/2884] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:04:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:14.625225 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=69,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:15.917919 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=63 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:18.614836 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f48b5-8694-4219-a193-5bee270efaea service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:18.628512 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f48b5-8694-4219-a193-5bee270efaea service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:18.634157 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed6df6-7ca4-4e6b-a522-cfe1d4f6f79e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:18.634741 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed6df6-7ca4-4e6b-a522-cfe1d4f6f79e service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:18.635022 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed6df6-7ca4-4e6b-a522-cfe1d4f6f79e service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:18.635299 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed6df6-7ca4-4e6b-a522-cfe1d4f6f79e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:18.637081 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-94ed6df6-7ca4-4e6b-a522-cfe1d4f6f79e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:18.650406 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed6df6-7ca4-4e6b-a522-cfe1d4f6f79e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:18.652040 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed6df6-7ca4-4e6b-a522-cfe1d4f6f79e service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:18.663680 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1439/2885] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:04:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:28.658358 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:33.509699 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df18a97-0d47-47ee-9163-179e47f165db service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:33.524470 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df18a97-0d47-47ee-9163-179e47f165db service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:33.528732 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ee366-1b54-434d-9a08-8da60abf35b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:33.529434 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ee366-1b54-434d-9a08-8da60abf35b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:33.529719 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ee366-1b54-434d-9a08-8da60abf35b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:33.530001 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ee366-1b54-434d-9a08-8da60abf35b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:33.531964 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1d7ee366-1b54-434d-9a08-8da60abf35b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:33.651651 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ee366-1b54-434d-9a08-8da60abf35b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:33.653542 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ee366-1b54-434d-9a08-8da60abf35b7 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:33.666381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1447/2886] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:04:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:04:36.205418 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed6df6-7ca4-4e6b-a522-cfe1d4f6f79e service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:04:36.276969 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed6df6-7ca4-4e6b-a522-cfe1d4f6f79e service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:04:36.283441 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d844dd-01fe-4f81-afa0-4779021b38ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c9fa9c29494ff9b1f749974dca2719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:04:36.284148 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d844dd-01fe-4f81-afa0-4779021b38ee service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:04:36.284427 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d844dd-01fe-4f81-afa0-4779021b38ee service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:04:36.284699 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d844dd-01fe-4f81-afa0-4779021b38ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:04:36.286936 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-66d844dd-01fe-4f81-afa0-4779021b38ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:04:36.324563 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d844dd-01fe-4f81-afa0-4779021b38ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:04:36.327858 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d844dd-01fe-4f81-afa0-4779021b38ee service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:04:36.347593 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1440/2887] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:04:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:04:43.661143 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=45 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:46.340424 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=24 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:00.557388 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ee366-1b54-434d-9a08-8da60abf35b7 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:00.588572 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ee366-1b54-434d-9a08-8da60abf35b7 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:00.593634 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed3806-3bfe-4ebf-86f6-c84394e72725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd577b5295f9e4a4388bb6293d1c33d0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:00.594693 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed3806-3bfe-4ebf-86f6-c84394e72725 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:00.595154 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed3806-3bfe-4ebf-86f6-c84394e72725 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:00.596382 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed3806-3bfe-4ebf-86f6-c84394e72725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:00.598713 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-51ed3806-3bfe-4ebf-86f6-c84394e72725 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:00.713730 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed3806-3bfe-4ebf-86f6-c84394e72725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:00.716552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed3806-3bfe-4ebf-86f6-c84394e72725 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:00.747481 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1448/2888] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:05:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:05:05.412119 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d844dd-01fe-4f81-afa0-4779021b38ee service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:05.415256 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-66d844dd-01fe-4f81-afa0-4779021b38ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:05.464398 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d844dd-01fe-4f81-afa0-4779021b38ee service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:05.469957 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460676f-0d82-4874-8281-09d6e878fe72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beeefb9b8d394407a5e7a32f5a00ffad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:05.470658 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460676f-0d82-4874-8281-09d6e878fe72 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:05.470937 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460676f-0d82-4874-8281-09d6e878fe72 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:05.471230 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460676f-0d82-4874-8281-09d6e878fe72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:05.474321 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8460676f-0d82-4874-8281-09d6e878fe72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:05.490944 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460676f-0d82-4874-8281-09d6e878fe72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:05.492805 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460676f-0d82-4874-8281-09d6e878fe72 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:05.505730 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1441/2889] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:05:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:10.122701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed3806-3bfe-4ebf-86f6-c84394e72725 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:10.127165 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-51ed3806-3bfe-4ebf-86f6-c84394e72725 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:10.154059 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed3806-3bfe-4ebf-86f6-c84394e72725 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:10.162180 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be427c5-8547-4da6-b814-f94ee26906d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:10.163681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be427c5-8547-4da6-b814-f94ee26906d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:10.164177 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be427c5-8547-4da6-b814-f94ee26906d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:10.164686 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be427c5-8547-4da6-b814-f94ee26906d0 admin admin] PATH_INFO: `/v3/users/5d6ddab73db44710bcb5bba4c0cfbcfa` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:10.166981 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be427c5-8547-4da6-b814-f94ee26906d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d6ddab73db44710bcb5bba4c0cfbcfa)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:10.170793 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be427c5-8547-4da6-b814-f94ee26906d0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:10.426188 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8be427c5-8547-4da6-b814-f94ee26906d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d6ddab73db44710bcb5bba4c0cfbcfa'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:10.426898 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8be427c5-8547-4da6-b814-f94ee26906d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d6ddab73db44710bcb5bba4c0cfbcfa'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:10.435692 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8be427c5-8547-4da6-b814-f94ee26906d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d6ddab73db44710bcb5bba4c0cfbcfa'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:10.520914 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8be427c5-8547-4da6-b814-f94ee26906d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d6ddab73db44710bcb5bba4c0cfbcfa'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:10.521580 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8be427c5-8547-4da6-b814-f94ee26906d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d6ddab73db44710bcb5bba4c0cfbcfa'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:10.544379 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1449/2890] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:05:10 2022] DELETE /identity/v3/users/5d6ddab73db44710bcb5bba4c0cfbcfa => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:11.273530 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460676f-0d82-4874-8281-09d6e878fe72 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:11.293909 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460676f-0d82-4874-8281-09d6e878fe72 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:11.400743 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689b591-959e-4400-a81a-1b15f060f81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:11.402353 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689b591-959e-4400-a81a-1b15f060f81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:11.402871 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689b591-959e-4400-a81a-1b15f060f81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:11.403390 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689b591-959e-4400-a81a-1b15f060f81d admin admin] PATH_INFO: `/v3/projects/895a592d480548ddb6afdb1e7c45ed92` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:11.405638 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689b591-959e-4400-a81a-1b15f060f81d admin admin] RBAC: Authorizing `identity:delete_project(project_id=895a592d480548ddb6afdb1e7c45ed92)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:11.409009 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689b591-959e-4400-a81a-1b15f060f81d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:11.549611 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0689b591-959e-4400-a81a-1b15f060f81d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '895a592d480548ddb6afdb1e7c45ed92', 'request_id': 'req-0689b591-959e-4400-a81a-1b15f060f81d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:11.560244 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0689b591-959e-4400-a81a-1b15f060f81d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '895a592d480548ddb6afdb1e7c45ed92', 'request_id': 'req-0689b591-959e-4400-a81a-1b15f060f81d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:11.568712 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0689b591-959e-4400-a81a-1b15f060f81d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '895a592d480548ddb6afdb1e7c45ed92', 'request_id': 'req-0689b591-959e-4400-a81a-1b15f060f81d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:11.671139 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0689b591-959e-4400-a81a-1b15f060f81d admin admin] The token cache is being invalidate because project 895a592d480548ddb6afdb1e7c45ed92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:11.671437 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0689b591-959e-4400-a81a-1b15f060f81d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:11.672150 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0689b591-959e-4400-a81a-1b15f060f81d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:11.674709 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1442/2891] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:05:11 2022] DELETE /identity/v3/projects/895a592d480548ddb6afdb1e7c45ed92 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:11.679493 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be427c5-8547-4da6-b814-f94ee26906d0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:11.680695 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8be427c5-8547-4da6-b814-f94ee26906d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:11.696108 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be427c5-8547-4da6-b814-f94ee26906d0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:11.718041 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:11.764108 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708ec50-cc7e-4717-96c7-4be6ef549ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:11.765033 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708ec50-cc7e-4717-96c7-4be6ef549ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:11.765349 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708ec50-cc7e-4717-96c7-4be6ef549ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:11.765628 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708ec50-cc7e-4717-96c7-4be6ef549ffe admin admin] PATH_INFO: `/v3/users/612d49337e10458792f7d999918e9547` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:11.767546 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708ec50-cc7e-4717-96c7-4be6ef549ffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=612d49337e10458792f7d999918e9547)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:11.769552 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708ec50-cc7e-4717-96c7-4be6ef549ffe admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:12.112181 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7708ec50-cc7e-4717-96c7-4be6ef549ffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '612d49337e10458792f7d999918e9547'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:12.113021 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7708ec50-cc7e-4717-96c7-4be6ef549ffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '612d49337e10458792f7d999918e9547'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:12.122588 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7708ec50-cc7e-4717-96c7-4be6ef549ffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '612d49337e10458792f7d999918e9547'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:12.219211 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7708ec50-cc7e-4717-96c7-4be6ef549ffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '612d49337e10458792f7d999918e9547'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:12.219908 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7708ec50-cc7e-4717-96c7-4be6ef549ffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '612d49337e10458792f7d999918e9547'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:12.242262 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1450/2892] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:05:11 2022] DELETE /identity/v3/users/612d49337e10458792f7d999918e9547 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:12.585059 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689b591-959e-4400-a81a-1b15f060f81d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:12.586986 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0689b591-959e-4400-a81a-1b15f060f81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:12.608641 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689b591-959e-4400-a81a-1b15f060f81d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:12.698263 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:12.710250 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507763f3-6a7c-4bb3-8e43-6c9d1b9ffcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:12.712025 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507763f3-6a7c-4bb3-8e43-6c9d1b9ffcfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:12.712278 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507763f3-6a7c-4bb3-8e43-6c9d1b9ffcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:12.712780 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507763f3-6a7c-4bb3-8e43-6c9d1b9ffcfd admin admin] PATH_INFO: `/v3/projects/dfa05196b0ec476999a9fd16c8307540` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:12.718317 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507763f3-6a7c-4bb3-8e43-6c9d1b9ffcfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfa05196b0ec476999a9fd16c8307540)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:12.721192 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507763f3-6a7c-4bb3-8e43-6c9d1b9ffcfd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:12.849726 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-507763f3-6a7c-4bb3-8e43-6c9d1b9ffcfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa05196b0ec476999a9fd16c8307540', 'request_id': 'req-507763f3-6a7c-4bb3-8e43-6c9d1b9ffcfd'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:12.856014 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-507763f3-6a7c-4bb3-8e43-6c9d1b9ffcfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa05196b0ec476999a9fd16c8307540', 'request_id': 'req-507763f3-6a7c-4bb3-8e43-6c9d1b9ffcfd'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:12.863842 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-507763f3-6a7c-4bb3-8e43-6c9d1b9ffcfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa05196b0ec476999a9fd16c8307540', 'request_id': 'req-507763f3-6a7c-4bb3-8e43-6c9d1b9ffcfd'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:12.966311 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-507763f3-6a7c-4bb3-8e43-6c9d1b9ffcfd admin admin] The token cache is being invalidate because project dfa05196b0ec476999a9fd16c8307540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:05:12.966546 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-507763f3-6a7c-4bb3-8e43-6c9d1b9ffcfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:12.967136 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-507763f3-6a7c-4bb3-8e43-6c9d1b9ffcfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:05:12.968775 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1443/2893] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:05:12 2022] DELETE /identity/v3/projects/dfa05196b0ec476999a9fd16c8307540 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:05:22.237442 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=43,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:22.962885 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:52.511930 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1a087-dbb8-4416-b62a-41469f0aff73 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:52.512464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1a087-dbb8-4416-b62a-41469f0aff73 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:52.512464 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1a087-dbb8-4416-b62a-41469f0aff73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:52.545769 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c6d1a087-dbb8-4416-b62a-41469f0aff73 None None] MFA Rules not processed for user `4d2ab3eeb5b44979956dd223ac6b7c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:05:52.547711 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c6d1a087-dbb8-4416-b62a-41469f0aff73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:52.618190 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1451/2894] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 26 17:05:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:05:52.667171 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507763f3-6a7c-4bb3-8e43-6c9d1b9ffcfd admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:52.668588 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-507763f3-6a7c-4bb3-8e43-6c9d1b9ffcfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:52.746953 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507763f3-6a7c-4bb3-8e43-6c9d1b9ffcfd admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:52.752116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927db258-ff90-4c10-96eb-4a0c9d2d30cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cc455638fb4db4939af3657ab4203e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:52.752782 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927db258-ff90-4c10-96eb-4a0c9d2d30cb service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:52.753060 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927db258-ff90-4c10-96eb-4a0c9d2d30cb service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:52.753395 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927db258-ff90-4c10-96eb-4a0c9d2d30cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:52.762472 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927db258-ff90-4c10-96eb-4a0c9d2d30cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:52.764089 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927db258-ff90-4c10-96eb-4a0c9d2d30cb service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:52.773354 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1444/2895] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 17:05:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:06:02.014063 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1a087-dbb8-4416-b62a-41469f0aff73 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:02.016184 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c6d1a087-dbb8-4416-b62a-41469f0aff73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:02.106272 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1a087-dbb8-4416-b62a-41469f0aff73 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:02.111197 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb47f0-c292-4049-b8e4-a3130c697477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:02.112095 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb47f0-c292-4049-b8e4-a3130c697477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:02.112381 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb47f0-c292-4049-b8e4-a3130c697477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:02.112658 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb47f0-c292-4049-b8e4-a3130c697477 admin admin] PATH_INFO: `/v3/users/d4864aa668bd4b3ba45d9570d94d4601` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:02.114112 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb47f0-c292-4049-b8e4-a3130c697477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4864aa668bd4b3ba45d9570d94d4601)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:02.116137 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb47f0-c292-4049-b8e4-a3130c697477 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:02.341871 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9feb47f0-c292-4049-b8e4-a3130c697477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4864aa668bd4b3ba45d9570d94d4601'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:02.342681 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9feb47f0-c292-4049-b8e4-a3130c697477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4864aa668bd4b3ba45d9570d94d4601'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:02.350539 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9feb47f0-c292-4049-b8e4-a3130c697477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4864aa668bd4b3ba45d9570d94d4601'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:02.447053 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9feb47f0-c292-4049-b8e4-a3130c697477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4864aa668bd4b3ba45d9570d94d4601'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:02.447709 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9feb47f0-c292-4049-b8e4-a3130c697477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4864aa668bd4b3ba45d9570d94d4601'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:02.466915 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1452/2896] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:06:02 2022] DELETE /identity/v3/users/d4864aa668bd4b3ba45d9570d94d4601 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:06:02.756975 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927db258-ff90-4c10-96eb-4a0c9d2d30cb service swift] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:02.772235 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927db258-ff90-4c10-96eb-4a0c9d2d30cb service swift] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:02.839734 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72c456-23d2-4825-8239-cb81df330c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:02.840623 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72c456-23d2-4825-8239-cb81df330c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:02.840903 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72c456-23d2-4825-8239-cb81df330c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:02.841202 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72c456-23d2-4825-8239-cb81df330c32 admin admin] PATH_INFO: `/v3/projects/0087e93bc2524a29b22a4adedec49ea6` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:02.842565 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72c456-23d2-4825-8239-cb81df330c32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0087e93bc2524a29b22a4adedec49ea6)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:02.845190 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72c456-23d2-4825-8239-cb81df330c32 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:02.985968 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8b72c456-23d2-4825-8239-cb81df330c32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0087e93bc2524a29b22a4adedec49ea6', 'request_id': 'req-8b72c456-23d2-4825-8239-cb81df330c32'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:02.992182 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8b72c456-23d2-4825-8239-cb81df330c32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0087e93bc2524a29b22a4adedec49ea6', 'request_id': 'req-8b72c456-23d2-4825-8239-cb81df330c32'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:02.999971 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8b72c456-23d2-4825-8239-cb81df330c32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0087e93bc2524a29b22a4adedec49ea6', 'request_id': 'req-8b72c456-23d2-4825-8239-cb81df330c32'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:03.088656 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8b72c456-23d2-4825-8239-cb81df330c32 admin admin] The token cache is being invalidate because project 0087e93bc2524a29b22a4adedec49ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:06:03.093146 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8b72c456-23d2-4825-8239-cb81df330c32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:03.093146 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8b72c456-23d2-4825-8239-cb81df330c32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:03.093146 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1445/2897] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:06:02 2022] DELETE /identity/v3/projects/0087e93bc2524a29b22a4adedec49ea6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:03.096958 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb47f0-c292-4049-b8e4-a3130c697477 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:03.099850 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9feb47f0-c292-4049-b8e4-a3130c697477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:03.114374 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb47f0-c292-4049-b8e4-a3130c697477 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:03.119517 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:03.192589 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f474357-7072-4722-bb32-4ce5e6bd8c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:03.193701 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f474357-7072-4722-bb32-4ce5e6bd8c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:03.194385 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f474357-7072-4722-bb32-4ce5e6bd8c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:03.194757 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f474357-7072-4722-bb32-4ce5e6bd8c8c admin admin] PATH_INFO: `/v3/users/dfb3795715994170b978f695af72e433` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:03.196619 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f474357-7072-4722-bb32-4ce5e6bd8c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb3795715994170b978f695af72e433)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:03.198668 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f474357-7072-4722-bb32-4ce5e6bd8c8c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:03.422168 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6f474357-7072-4722-bb32-4ce5e6bd8c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb3795715994170b978f695af72e433'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:03.422852 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6f474357-7072-4722-bb32-4ce5e6bd8c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb3795715994170b978f695af72e433'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:03.430369 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6f474357-7072-4722-bb32-4ce5e6bd8c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb3795715994170b978f695af72e433'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:03.515981 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6f474357-7072-4722-bb32-4ce5e6bd8c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb3795715994170b978f695af72e433'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:03.516600 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6f474357-7072-4722-bb32-4ce5e6bd8c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb3795715994170b978f695af72e433'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:03.535590 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1453/2898] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 17:06:03 2022] DELETE /identity/v3/users/dfb3795715994170b978f695af72e433 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:03.797877 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72c456-23d2-4825-8239-cb81df330c32 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:03.799405 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8b72c456-23d2-4825-8239-cb81df330c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:03.814091 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72c456-23d2-4825-8239-cb81df330c32 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:03.844478 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:03.889678 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbab26b-1c43-4857-aa26-45e299c5c635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea68495bc01f41d2b0c2e34799485fee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76a4e041bd164458a5b1a262dc443e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:03.891227 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbab26b-1c43-4857-aa26-45e299c5c635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:03.891510 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbab26b-1c43-4857-aa26-45e299c5c635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:03.891786 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbab26b-1c43-4857-aa26-45e299c5c635 admin admin] PATH_INFO: `/v3/projects/495755b184544ac2a11db912887d6472` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:03.893116 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbab26b-1c43-4857-aa26-45e299c5c635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=495755b184544ac2a11db912887d6472)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:03.895121 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbab26b-1c43-4857-aa26-45e299c5c635 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:03.996392 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5cbab26b-1c43-4857-aa26-45e299c5c635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '495755b184544ac2a11db912887d6472', 'request_id': 'req-5cbab26b-1c43-4857-aa26-45e299c5c635'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:04.002618 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5cbab26b-1c43-4857-aa26-45e299c5c635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '495755b184544ac2a11db912887d6472', 'request_id': 'req-5cbab26b-1c43-4857-aa26-45e299c5c635'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:04.008855 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5cbab26b-1c43-4857-aa26-45e299c5c635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '495755b184544ac2a11db912887d6472', 'request_id': 'req-5cbab26b-1c43-4857-aa26-45e299c5c635'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:04.093769 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5cbab26b-1c43-4857-aa26-45e299c5c635 admin admin] The token cache is being invalidate because project 495755b184544ac2a11db912887d6472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:06:04.094115 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5cbab26b-1c43-4857-aa26-45e299c5c635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:04.094851 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5cbab26b-1c43-4857-aa26-45e299c5c635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:06:04.096620 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1446/2899] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 17:06:03 2022] DELETE /identity/v3/projects/495755b184544ac2a11db912887d6472 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:06:13.531949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:14.089335 dv-cinder-836070-4-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:06:29.040564 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f474357-7072-4722-bb32-4ce5e6bd8c8c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:06:29.042270 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6f474357-7072-4722-bb32-4ce5e6bd8c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:29.144076 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f474357-7072-4722-bb32-4ce5e6bd8c8c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:06:29.224542 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da4bba-a679-4f08-9c47-308683dd4930 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beeefb9b8d394407a5e7a32f5a00ffad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3379cdd914747758e71b3b05c5921b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:06:29.225203 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da4bba-a679-4f08-9c47-308683dd4930 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:06:29.225772 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da4bba-a679-4f08-9c47-308683dd4930 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:06:29.226045 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da4bba-a679-4f08-9c47-308683dd4930 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:06:29.227949 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-18da4bba-a679-4f08-9c47-308683dd4930 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:06:29.243098 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da4bba-a679-4f08-9c47-308683dd4930 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:06:29.244735 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da4bba-a679-4f08-9c47-308683dd4930 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:06:29.256345 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1454/2900] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 17:06:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:06:39.251610 dv-cinder-836070-4-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=58 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}